1 year ago
Arlington, VA, USAMid Level
Base Salary
$159k - $263k/yr
Responsibilities
- Create, clean, and maintain training and evaluation datasets for specialized AI use cases.
- Fine-tune language models and implement post-training and alignment methods such as continued pre-training, SFT, RLHF, DPO, PPO, and GRPO.
- Build retrieval-augmented generation systems and integrate AI capabilities into applications and workflows.
- Develop and optimize model-serving infrastructure for production deployments across cloud and on-premises environments.
- Design evaluation frameworks and test harnesses to measure quality, latency, and regressions.
- Collaborate with product and engineering partners to identify use cases and deliver AI solutions.
- Document models, datasets, and operational processes.
Requirements
- At least 4 years of professional software development experience building and supporting ML/AI-enabled applications.
- Strong Python skills and deep learning experience with PyTorch, TensorFlow, or JAX.
- Hands-on experience with LLM post-training methods, including continued pre-training, SFT, RLHF, DPO, PPO, or GRPO.
- Experience curating, cleaning, and preprocessing training and evaluation datasets.
- Working knowledge of relational, graph, and vector database concepts.
- Experience designing or using evaluation metrics and testing procedures for LLMs and agents.
- Experience integrating LLM or agent systems with Pydantic-AI, LangChain/LangGraph, or CrewAI.
- Bachelor’s degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience.
- U.S. citizenship and eligibility to obtain and maintain a U.S. Government security clearance.
- Preferred qualifications include production model deployment, distributed training, performance debugging, quantization, inference optimization, prompt engineering, model alignment, and MLOps/LLMOps/AgentOps experience.
Benefits
- Onsite, full-time position.
- Medical, dental, vision, life, AD&D, and disability plan options.
- Paid parental leave, including 12 weeks for birthing parents, 4 weeks for non-birthing parents, and 6 weeks for adoptive, foster, or intended parents through surrogacy.
- Paid holidays and flexible PTO.
- 401(k) with pre-tax and Roth options, plus HSA/FSA and dependent care FSA options.
- Benefits vary by location, role, and eligibility.
Tech Stack
Categories
