Senior Lead AI Engineer (LLM Gateway, FM Hosting)
Capital OneBase Salary
$251k - $286k/yr
Responsibilities
- Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products.
- Design, develop, test, deploy, and support AI software components for foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability.
- Develop state-of-the-art LLM training and inference optimization techniques to improve scalability, hardware utilization, cost, latency, and throughput.
- Contribute to the technical vision and long-term roadmap for foundational AI systems.
- Lead and mentor engineering teams and influence cross-functional stakeholders.
Requirements
- Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus at least six years of experience developing AI and ML algorithms or technologies, or a master's degree in a related field plus at least four years of such experience.
- At least six years of programming experience with Python, Go, Scala, or Java.
- Preferred: seven years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud.
- Preferred: experience designing, developing, integrating, delivering, and supporting complex AI systems.
- Preferred: experience developing AI and ML technologies including LLM inference, similarity search, VectorDBs, guardrails, and memory using Python, C++, C#, Java, or Go.
- Preferred: experience optimizing training and inference software for hardware utilization, latency, throughput, and cost.
- Preferred: ability to lead and mentor engineering teams, influence stakeholders, communicate complex AI concepts, and apply current AI research in production.
Benefits
- Eligible for performance-based incentive compensation, including cash bonuses and/or long-term incentives.
- Capital One offers health, financial, and other benefits supporting employee well-being, with eligibility varying by employment status and management level.
- Employment authorization sponsorship may be considered for qualified applicants.
- The role is available in Cambridge, Massachusetts; McLean, Virginia; New York, New York; and San Jose, California, with location-specific salary ranges.
- Applications are expected to be accepted for at least five business days, and reasonable accommodations are available.
About Capital One
At Capital One, we're making things better for our customers and associates through innovation and collaboration. We were founded on the belief that everyone deserves financial freedom—and are dedicated to a world where all have equal opportunity to prosper. Banking is in our DNA, but we are so much more than a bank. We always think about what’s next—and how we can bring our customers the tools needed to improve their financial lives. Your ideas, experiences and skills will help make banking better. You’ll be part of a supportive culture while earning amazing benefits. That’s life at Capital One. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. View our Social Media Community Guidelines https://www.capitalone.com/digital/social-media/