Base Salary
$143k - $275k/yr
Responsibilities
- Own CADET’s end-to-end architecture, integration contracts, and technical execution across customer-signal and evaluation workflows.
- Build scalable services and pipelines for customer-grounding data generation, intent classification, deduplication, clustering, taxonomy assignment, coverage analysis, loss detection, and work-item routing.
- Automate evaluation execution and quality gates with scheduling, versioning, reproducibility, failure handling, and result publication.
- Establish extensible data contracts and schemas for signals, workflows, evaluation cases, rubrics, graders, runs, results, attribution, and regression assets.
- Develop automated diagnosis and human-review workflows that route quality losses, track remediation, and verify customer-impact improvements.
- Create observability and benchmarks for pipeline health, agent behavior, data quality, grader health, coverage, cost, latency, reliability, and regression detection.
- Design human-in-the-loop gates for ambiguous data, sensitive evidence, taxonomy changes, evaluation publication, and consequential quality decisions.
- Mentor engineers and improve engineering quality through interfaces, testing, security, operational discipline, and documentation.
Requirements
- Bachelor’s degree in computer science or a related technical field and 6+ years of technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
- Extensive experience designing and delivering large-scale distributed systems, data platforms, developer platforms, or AI infrastructure in production is preferred.
- Preferred experience includes AI/ML platforms, LLM or agent systems, evaluation infrastructure, experimentation systems, model pipelines, retrieval, tool-using agents, prompt and rubric management, human-in-the-loop systems, or automated diagnosis.
- Preferred experience includes batch, streaming, unstructured, and human-generated data platforms; RLEs, synthetic environments, post-training pipelines, or large-scale evaluation execution.
- Experience integrating customer feedback, product telemetry, and engineering work-management systems is preferred.
- Experience operating high-availability services and driving platform adoption across multiple product teams is preferred.
- Strong understanding of security, privacy, data governance, responsible engineering, communication, collaboration, and cross-organizational technical leadership is preferred.
Benefits
- Base pay is listed at USD $142,800–$274,800 per year across the U.S.; the San Francisco Bay Area and New York City metropolitan area range is USD $188,000–$304,200 per year.
- Certain roles may be eligible for benefits and other compensation.
- The position is open for a minimum of 5 days, with applications accepted on an ongoing basis until filled.
- Microsoft is an equal opportunity employer and provides reasonable accommodations during the application process.
Tech Stack
Categories
About Microsoft
Every company has a mission. What's ours? To empower every person and every organization to achieve more. We believe technology can and should be a force for good and that meaningful innovation contributes to a brighter world in the future and today. Our culture doesn’t just encourage curiosity; it embraces it. Each day we make progress together by showing up as our authentic selves. We show up with a learn-it-all mentality. We show up cheering on others, knowing their success doesn't diminish our own. We show up every day open to learning our own biases, changing our behavior, and inviting in differences. Because impact matters. Microsoft operates in 190 countries and is made up of approximately 228,000 passionate employees worldwide.