Microsoft

Principal Applied AI Engineer

Microsoft
Apply
2 days ago
Atlanta, GA, USA or Redmond, WA, USAStaff+
H1B sponsor

Base Salary

$143k - $304k/yr

Responsibilities

  • Architect and build scalable production agentic AI systems, including LLM orchestration, multi-agent workflows, RAG pipelines, tool integrations, memory, state management, and human-in-the-loop experiences.
  • Write, review, and maintain production-quality C# and Python code, including foundational components, reference implementations, prototypes, and reusable platform capabilities.
  • Own end-to-end technical delivery from ambiguous customer-support scenarios and architecture through experimentation, implementation, deployment, operation, and continuous improvement.
  • Define architecture patterns, API and data contracts, code-quality expectations, evaluation practices, deployment strategies, and observability standards for AI services.
  • Design evaluation frameworks using rubrics, golden datasets, simulation, judge models, and offline and online evaluation, with quality thresholds for autonomous operation.
  • Ensure production services meet standards for correctness, availability, latency, scalability, cost, and safety; diagnose incidents and lead root-cause analysis.
  • Implement responsible-AI and agent-security controls, including prompt-injection defenses, privacy protections, authorization, data boundaries, action controls, auditability, and fail-safe behavior.
  • Evaluate models, frameworks, platforms, and architectural approaches using experiments and production telemetry.
  • Influence product and platform roadmaps with product managers, researchers, platform engineers, and Azure service teams.
  • Lead architecture reviews, resolve technical disagreements, align partner organizations, and mentor engineers across teams.

Requirements

  • Bachelor's degree in computer science or a related technical field and 6+ years of technical engineering experience with coding, or equivalent experience.
  • Ability to pass Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check.
  • Preferred qualifications include 15 years of professional software engineering and enterprise architecture experience with complex production systems at enterprise scale.
  • Preferred qualifications include a master's degree with 8+ years of experience, or a bachelor's degree with 12+ years of experience, or equivalent experience.
  • Proficiency in C# and/or Python and experience designing production-quality services and distributed systems.
  • Experience with applied AI systems, LLM-based applications, prompt engineering, RAG architectures, agent frameworks, or machine learning services.
  • Experience with cloud platforms, preferably Azure, and cloud-native engineering practices.
  • Experience implementing agent-security patterns such as prompt-injection defense, identity propagation, least-privilege tool access, data-boundary enforcement, approval gates, and auditable actions.
  • Ability to move between strategic architecture and detailed implementation while debugging complex interactions across models, prompts, tools, data, and distributed services.
  • Ability to influence technical direction across teams without direct management authority and connect technical investments to measurable customer outcomes.
  • Track record of mentoring senior engineers and raising engineering standards without formal people-management responsibilities.
  • Background in customer support engineering, supportability, diagnostics, or customer-experience platforms is a plus.

Benefits

  • The typical U.S. base pay range is USD $142,800-$274,800 per year, with a separate San Francisco Bay Area and New York City metropolitan area range of USD $188,000-$304,200 per year.
  • Certain roles may be eligible for benefits and other compensation.
  • The position will remain open for a minimum of five days and accepts applications on an ongoing basis until filled.
Microsoft

About Microsoft

10,000+ employees

Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.

Contact me