Staff Software Engineer, Agent Quality
Databricks5 days ago
Base Salary
$200k - $265k/yr
Responsibilities
- Build foundational evaluation infrastructure for Genie Agents.
- Develop benchmarking, regression detection, and quality measurement systems.
- Connect production signals and evaluation results to agent training and iterative development.
- Shape the technical direction of agent-quality infrastructure and the agent development platform.
- Partner with researchers and engineers to build robust internal platforms and influence roadmap execution across teams.
Requirements
- 6+ years of industry experience building software systems.
- Strong Python programming skills and experience building production or research infrastructure.
- Experience building or operating distributed systems, data pipelines, or large-scale infrastructure with a focus on reliability, correctness, and operational maturity.
- Ability to design pragmatic, rigorous systems that produce trustworthy and reproducible signals for complex applications.
- Ability to work across research and product boundaries and influence roadmap and execution across multiple teams.
- Preferred: experience with devtools, CI/CD platforms, testing frameworks, observability tooling, benchmarking infrastructure, or LLM and agent quality measurement.
Benefits
- Comprehensive benefits and perks are offered, with specific details varying by region.
Tech Stack
Categories
About Databricks
Databricks builds a cloud-based data and AI platform centered on the lakehouse architecture, combining data engineering, analytics, and machine learning with Apache Spark, Delta Lake, and MLflow. It sells subscriptions and cloud services to enterprises that need to unify data pipelines and develop large-scale AI and analytics. Founded in 2013 by the creators of Apache Spark and headquartered in San Francisco, the company is privately held and serves organizations across many industries.