about 3 hours ago
Bengaluru, IndiaSenior / Mid Level
Responsibilities
- Design and own synthetic data generation pipelines to enhance model performance.
- Develop evaluation datasets for domain-specific languages to identify model weaknesses.
- Build and maintain automated data quality checks and large-scale research data pipelines.
- Define structured rubrics for evaluating AI outputs on research tasks.
- Create continuous monitoring and performance optimization systems for AI models.
- Lead research on solutions for long-context handling and cascading error challenges.
- Drive prompt engineering strategy and experimentation frameworks.
Requirements
- 4+ years of engineering experience, with 2 years focused on LLM systems or applied ML in production.
- Deep hands-on experience with LLMs, synthetic data pipelines, and AI system optimization.
- Strong Python skills; Go or TypeScript experience is a plus.
- Solid understanding of prompt engineering and model fine-tuning.
- Experience building and operating production AI systems.
- Strong instincts for debugging complex system failures.
- High ownership and ability to drive problems to resolution independently.
Benefits
- Full family health insurance.
- $1,000 USD annual learning and development budget.
- Dedicated mentor and coaching support.
- Free snacks and dinner at the office.
Tech Stack
Categories
AI & MLData Engineering