about 3 hours ago
Base Salary
$160k - $170k/yr
Responsibilities
- Design and implement multi-agent orchestration frameworks using various agent SDKs.
- Build and maintain MCP servers and integrations to enhance AI system capabilities.
- Optimize RAG pipelines, including embedding strategies and retrieval quality tuning.
- Integrate with managed LLM services for deployment and cost optimization.
- Fine-tune and deploy open-source deep learning models for production use.
- Apply systems thinking to optimize AI and LLM systems for quality and scalability.
- Design automated evaluation frameworks to assess LLM system performance.
- Utilize reinforcement learning techniques to improve model alignment.
- Architect and manage high-throughput data pipelines using Kafka.
- Deploy and scale production AI services on AWS using modern practices.
- Implement observability frameworks to track system performance metrics.
- Identify and resolve production bottlenecks in distributed systems.
- Conduct code reviews and contribute to team standards.
- Communicate progress and outcomes to stakeholders.
- Continuously learn and adapt to advancements in NLP and Generative AI.
Requirements
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- 5+ years of experience as an AI Engineer or similar role.
- Deep Python expertise with a track record of shipping production systems.
- Experience designing and deploying LLM-driven applications.
- Hands-on experience with automated evaluation frameworks for LLM systems.
- Solid understanding of machine learning concepts and production systems.
- Experience with GPUs for model training and inference.
- Practical experience with cloud-based deployments and infrastructure tools.
- Strong problem-solving and systems thinking skills.
- Excellent communication and collaboration skills.
- Strong ownership and initiative in driving projects.
Benefits
- Competitive health benefits.
- Matched 401k and pension plans.
- Generous parental leave.
- Gym subsidies.
- Educational reimbursements for career development.
- Recognition programs.
- Pet-friendly offices (US only).
