Job Description

GENERATIVE AI SOFTWARE ENGINEER - Global Investment Firm

J Harlan Group is currently conducting a search for a GENERATITIVE AI SOFTWARE ENGINEER at a prominent Global Investment Firm in NYC.

Technology is foundational to everything this firm does. They are seeking exceptional engineers with a strong computer science background and hands-on experience building Generative AI systems . As a Software Developer specializing in GenAI, you will design and develop the firm’s next generation of generative AI applications and underlying infrastructure—helping make AI accessible, reliable, and impactful for both technical and non-technical users across the organization.

You will work alongside highly talented engineers, quants, and domain experts to create advanced, data-intensive AI systems. This is a role for individuals who enjoy building real, production-grade AI/ML systems, experimenting with cutting-edge technologies, and influencing the adoption of generative AI at scale.

The firm values individuals who are agile, intellectually curious, creative, and hands-on , and who thrive in a fast-paced, collaborative environment.

PRINCIPAL RESPONSIBILITIES:

As a Generative AI Software Engineer, you will help design, build, and scale the firm’s GAI capabilities. Responsibilities include:

Core GenAI Engineering

• Develop and maintain shared generative AI infrastructure , including internal LLM platforms, AI orchestration layers, and firm-wide tools enabling safe, scalable model usage.
• Build foundational components such as vector databases, embedding pipelines, LLM gateways, evaluation frameworks, and retrieval systems to support AI-powered applications across the firm.
• Leverage state-of-the-art cloud models (OpenAI, Anthropic, AWS Bedrock, etc.) to build scalable, high-availability AI services.

AI Product Development

• Work on greenfield GenAI applications , from concept to prototype to production deployment, tailored to internal users such as researchers, technologists, investment teams, and operations groups.
• Integrate LLMs with internal knowledge sources, data stores, ontologies, and documentation systems to create intelligent, context-aware tools.

Experimentation & Innovation

• Prototype and evaluate new models, techniques, and frameworks—such as RAG, multi-agent systems, and model-to-model orchestration—and collaborate with colleagues to determine where they can create real business value.
• Conduct experimentation, benchmarking, and quantitative evaluation of GenAI solutions to guide design decisions and ensure reliability and accuracy.

Cross-Functional Collaboration

• Partner closely with engineering teams, quants, operations, and business stakeholders to understand workflows and design AI solutions aligned with firm needs.
• Make AI approachable for diverse user groups by building intuitive, high-quality interfaces and abstractions for using LLMs safely and effectively.

IDEAL CANDIDATE PROFILE:

The ideal candidate combines excellence in software engineering with a deep interest in AI/ML and a practical, experimental approach to generative AI.

Technical Qualifications

• Strong computer science fundamentals, including algorithms, systems, and data structures.
• Hands-on experience with LLMs, embeddings, RAG pipelines, vector databases, or related GenAI systems .
• Deep comfort building production-quality software in Python or other high-level languages.
• Experience with cloud AI providers, model APIs, or distributed / scalable architectures.

Academic & Cognitive Strength

• Historically, successful developers at the firm have been top performers in their academic programs (CS, EE, Math, Physics, etc.).
• Ability to reason quantitatively and analytically in unfamiliar domains.

Mindset & Cultural Alignment

• A “tinkerer’s mindset”—curious, hands-on, eager to experiment with new models and techniques.
• Thrives in a collegial, collaborative, fast-paced environment.
• Strong ownership mentality: desire to build systems that matter, not just prototypes.
• Excellent communication skills and the ability to work with diverse users—including traders, researchers, engineers, and investment professionals.
  

An individual who loves solving deep and complex technical and business problems and wants to have an outsized impact with the services/ products they deliver. An individual with a passion for Generative AI, a high level of intellectual curiosity, a commitment to excellence and an unparalleled drive to deliver world-class services.

If you or anyone in your network would be interested in this opportunity, please send resume to Jerry Goldberg at jgoldberg@jharlan.com or directly contact us at (212) 792-0099

ABOUT THE CLIENT:

The firm is a prominent multinational investment management firm. The company manages a variety of investment funds that make extensive use of quantitative methods and proprietary computational technology to support fundamental research in the management of its investments.

They have a relentless focus on innovation and integration: innovation in new products, markets and businesses as well as new tools, models and technology management and performance structures; integration of fundamental research, quantitative strategies and technical analysis, all supported by an intensive focus on operational excellence and comprehensive risk management.

The talent and dedication of their people is critical to their success. They offer an opportunity for developing one’s professional career while working with individuals trained in a variety of disciplines in a collegial and dynamic environment. They offer a broad range of competitive benefits on a global basis.

They seek candidates who are high-energy self-starters who want to join an investment management firm on the leading edge of the global markets. The management team needs individuals of the highest professional caliber w ho are leaders, problem solvers, analytic, detail-oriented, and entrepreneurial. Everyone at the firm works side-by-side with the firm’s senior management in a highly collaborative and charged environment.

Successful candidates are :

• Analytic and relentless in pursuit of the right answer
• Strong communicators who excel at rapid synthesis
• Able to demonstrate sound business judgment
• Able to digest complexity while maintaining an understanding of the “big picture” of business needs
• Team players who are energized by a collaborative enterprise

The firm’s employees maintain the highest professional and ethical standards. The firm has earned a reputation for honesty, fair dealing, and transparency in a competitive industry. They believe that these standards are the foundation for superior investment performance and are critical to delivering performance to clients

SALARY RANGE : The expected annual base salary for this position is $200,000 to $250,000. Our compensation and benefits package includes variable compensation in the form of a year-end bonus, guaranteed in the first year of hire, and benefits including medical and prescription drug coverage, 401(k) contribution matching, wellness reimbursement, family building benefits, and a charitable gift match program.

'J Harlan Group, LLC' is an executive search and advisory firm specializing in recruiting for Financial Services, Management Consulting and Public Accounting companies. The organization is a global leader in professional staffing and consulting services working with major companies in the US and Global investment capitals around the world. Built by industry leaders to meet the talent demand needs for highly professional and specialized roles, J Harlan Group, LLC operates under the highest level of professional and quality standards providing a customized project approach for each client and search assignment.

Job Tags

Similar Jobs