about 3 hours ago
Bengaluru, IndiaMid Level / Senior
H1B Sponsor
Responsibilities
- Design and build large-scale evaluation pipelines for measuring AI quality.
- Evaluate model releases and build infrastructure for understanding regressions and launch readiness.
- Develop agent observability infrastructure, including telemetry pipelines and dashboards.
- Own backend systems from architecture to production rollout and monitoring.
- Collaborate with product, ML, and infrastructure engineers to integrate evals into AI feature shipping.
- Connect eval results and customer feedback to drive product improvements.
- Mentor other engineers and contribute to the engineering culture.
Requirements
- 4+ years of software engineering experience in backend systems or distributed systems.
- Strong coding skills in Go, Python, Java, C++, or similar languages.
- Experience with distributed data pipelines and cloud-native infrastructure.
- Analytical mindset focused on real user experience metrics.
- Ability to work in customer-focused, cross-functional environments.
- Deep commitment to quality in systems and AI products.
- Experience with LLM applications, evals, or ML infrastructure is a plus.