Microsoft

Principal Applied AI Engineer

Microsoft
Apply
2 days ago
Atlanta, GA, USA or Redmond, WA, USAStaff+
H1B sponsor

Base Salary

$143k - $304k/yr

Responsibilities

  • Architect and build production agentic AI systems with LLM orchestration, multi-agent workflows, RAG pipelines, tool integrations, memory and state management, and human-in-the-loop experiences.
  • Write, review, and maintain production C# and Python code, including critical components, prototypes, reference implementations, and reusable platform capabilities.
  • Own end-to-end technical delivery from ambiguous customer-support scenarios and architecture through experimentation, implementation, deployment, operation, and improvement.
  • Define architecture patterns, API and data contracts, code-quality standards, evaluation practices, deployment strategies, and observability standards for AI services.
  • Design evaluation frameworks using rubrics, golden datasets, simulation, judge models, and offline and online evaluation, with quality thresholds for autonomous operation.
  • Own production quality and reliability, diagnose complex issues, lead incident response and root-cause analysis, and engineer systemic improvements.
  • Embed responsible AI, privacy, prompt-injection defenses, authorization, data boundaries, action controls, auditability, and fail-safe behavior into systems.
  • Evaluate models, frameworks, platforms, and architectures using experiments and production telemetry while balancing quality, reliability, latency, cost, and complexity.
  • Influence product and platform roadmaps with product managers, researchers, platform engineers, and Azure service teams.
  • Instrument systems and improve automation accuracy, case-volume reduction, resolution time, engineering efficiency, and customer satisfaction.
  • Lead architecture reviews, resolve technical disagreements, align partner organizations, and communicate with engineers, senior leaders, and non-technical stakeholders.
  • Mentor engineers and raise organizational capability in system design, software engineering, applied AI, and evaluation-driven development.

Requirements

  • Bachelor's degree in Computer Science or a related technical field and 6+ years of technical engineering experience with coding, or equivalent experience.
  • Ability to meet Microsoft, customer, and/or government security-screening requirements, including the Microsoft Cloud Background Check.
  • Preferred: 15 years of professional software engineering and enterprise architecture experience with complex enterprise-scale production systems.
  • Preferred: master's degree and 8+ years of technical engineering experience, or bachelor's degree and 12+ years of technical engineering experience, or equivalent experience.
  • Deep hands-on software development and enterprise architecture experience designing scalable, resilient, and maintainable systems.
  • Proficiency in C# and/or Python and experience designing production-quality services and distributed systems.
  • Experience with applied AI systems, including LLM applications, prompt engineering, RAG architectures, agent frameworks, or machine learning services.
  • Experience with cloud platforms, preferably Azure, and cloud-native engineering practices including microservices, APIs, containers, CI/CD, infrastructure as code, and observability.
  • Ability to influence technical direction and align multiple teams without direct management authority.
  • Experience implementing agent-security patterns such as prompt-injection defense, identity propagation, least-privilege tool access, data-boundary enforcement, approval gates, and auditable actions.
  • Ability to move between strategic architecture and detailed implementation while debugging interactions across models, prompts, tools, data, and distributed services.
  • Business acumen connecting technical investments to measurable customer outcomes, plus experience mentoring senior engineers and raising engineering standards.
  • Background in customer-support engineering, supportability, diagnostics, or customer-experience platforms is a plus.

Benefits

  • Certain roles may be eligible for benefits and other compensation.
  • Applications are accepted on an ongoing basis until the position is filled.
Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me