AI Engineer 3 (AI Foundations)
Capital One2 days ago
Cambridge, MA, USA +3 moreSenior
Base Salary
$162k - $201k/yr
Responsibilities
- Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products.
- Design, develop, test, deploy, and support AI software components including foundation-model training, LLM inference, agents, multi-agent workflows, similarity search, guardrails, evaluation, governance, and observability.
- Develop optimization techniques to improve the scalability, cost, latency, throughput, and hardware utilization of production AI systems.
- Lead development and benchmarking of multi-turn conversational and tool-using agent workflows with measurable performance and safety metrics.
- Implement scalable pipelines for training, fine-tuning, and deploying foundation and domain-specific models.
- Collaborate on dataset curation and model evaluation methodologies.
- Contribute to governance and security efforts involving model traceability, lineage documentation, and version control.
- Mentor junior AI engineers and promote engineering excellence, reproducibility, and responsible experimentation.
Requirements
- Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus at least three years of experience developing AI and ML algorithms or technologies, or a relevant master's degree plus at least one year of such experience.
- At least three years of programming experience with Python, Go, Scala, CUDA, or Java.
- Experience making cost, latency, throughput, and accuracy tradeoffs in AI systems.
- Preferred experience deploying scalable and responsible AI solutions on AWS, Google Cloud, Azure, or equivalent private cloud.
- Experience developing, delivering, and supporting AI services and optimizing training or inference software.
- Experience with LLM inference, similarity search, vector databases, guardrails, memory, agentic AI systems, and agentic workflows.
- Ability to evaluate and optimize LLM performance using quantitative metrics.
- Hands-on experience with retrieval-augmented generation, vector database integrations, fine-tuning workflows, prompt engineering, safety guardrails, and red-teaming methodologies.
Benefits
- Capital One offers health, financial, and other benefits supporting employee well-being, with eligibility varying by employment status and management level.
- The role is available in Cambridge, Massachusetts; McLean, Virginia; New York, New York; and San Jose, California, with location-dependent annual salary ranges.
- The position is eligible for performance-based incentive compensation, including potential cash bonuses and/or long-term incentives.
- Applications will be accepted for a minimum of five business days.
Categories
About Capital One
Capital One is a U.S. consumer and commercial bank that offers credit cards, checking and savings accounts, auto financing, and lending to small and large businesses. It earns revenue from interest income and interchange/fees across its card and banking products, and develops cloud-based digital services. Founded in 1994, Capital One is publicly traded on the NYSE (COF) and is headquartered in McLean, Virginia.