18 hours ago
Responsibilities
- Architect and build scalable platforms for agentic evaluation, production audits, and human-in-the-loop review.
- Develop AI-agent workflows that gather evidence, analyze cases, compare decisions, and assist human reviewers while preserving oversight and accountability.
- Build reviewer experiences that present evidence, explanations, uncertainty, and recommended actions effectively.
- Design distributed orchestration systems for long-running workflows involving models, agents, tools, automated checks, and human decisions.
- Provide technical leadership across engineering, applied science, product, design, operations, and policy teams.
- Own substantial systems from initial architecture through rollout, adoption, and production operations.
Requirements
- Bachelor’s or master’s degree in Computer Science, Engineering, or a related technical field.
- 8+ years of relevant industry experience.
- Strong production-coding skills in at least one of C++, C#, Java, Python, or TypeScript.
- Experience designing, building, and operating large-scale distributed services or software platforms.
- Strong system-design skills across APIs, workflow orchestration, event-driven systems, storage, concurrency, fault tolerance, and service reliability.
- Experience building AI evaluation, agent orchestration, human-in-the-loop, audit, experimentation, or LLMOps platforms.
- Preferred background in advertising, trust and safety, fraud, responsible AI, search, recommendations, or another high-scale complex decision domain.
Tech Stack
Categories
About Microsoft
Every company has a mission. What's ours? To empower every person and every organization to achieve more. We believe technology can and should be a force for good and that meaningful innovation contributes to a brighter world in the future and today. Our culture doesn’t just encourage curiosity; it embraces it. Each day we make progress together by showing up as our authentic selves. We show up with a learn-it-all mentality. We show up cheering on others, knowing their success doesn't diminish our own. We show up every day open to learning our own biases, changing our behavior, and inviting in differences. Because impact matters. Microsoft operates in 190 countries and is made up of approximately 228,000 passionate employees worldwide.