about 2 hours ago
Remote, Worldwide +2 moreSenior / Staff+
Responsibilities
- Design and implement model routers for selecting appropriate models for each interaction.
- Develop portable provider and protocol abstractions that maintain authentication and context signals.
- Define versioned schemas and contracts for various AI components.
- Build systems to discover and validate agent skills across different harnesses.
- Research user-owned memory and context management.
- Create benchmark suites for evaluating AI systems on multiple criteria.
- Design evaluations to test the impact of model and provider changes.
- Investigate advanced agent training and skill generation techniques.
- Write robust research software and APIs for experimentation.
- Collaborate with teams to translate research into secure systems.
- Communicate research findings through reports and publications.
Requirements
- Profound understanding of machine learning and large language models.
- Deep expertise in areas like model routing, agent systems, or distributed systems.
- Experience with building and evaluating language-model systems.
- Ability to design and analyze machine learning experiments rigorously.
- Strong software engineering skills, particularly in Python.
- Experience with APIs, data schemas, and CI/CD practices.
- Ability to reason about security and user control in agent systems.
- Experience implementing research ideas across various domains.
- Strong communication and technical leadership skills.
- PhD in a relevant field or equivalent practical experience.
Benefits
- Competitive compensation.
- Career growth and learning opportunities.
- Flexibility and ownership in your work.
- Collaborative and innovative culture.
- Opportunity to work on impactful AI projects.
- International environment with talented teams.
Tech Stack
Categories
AI & MLData Science