13 hours ago
Hyderābād, IndiaMid Level
Responsibilities
- Design, build, and maintain AI systems that host ML models, tools, APIs, state, and memory for multi-step workflows.
- Own the ML/DL development lifecycle through production, including deployment, monitoring, live-site reliability, and evaluation-first development.
- Define success criteria, create evaluation datasets and automated harnesses, and conduct human-in-the-loop reviews.
- Debug AI behavior using logs, data inspection, and model and tool-call traces, then convert failure patterns into improvements.
- Establish AI quality metrics such as accuracy, relevance, and hallucination rate and integrate them into release gates.
- Optimize token usage, inference cost, latency, caching, model routing, and batching while operating continuous improvement loops.
- Partner with product, design, and domain stakeholders on use cases, acceptance criteria, and rollout plans for AI features.
Requirements
- Bachelor's degree in computer science, data science, or a related technical field.
- At least 5 years of experience building and maintaining ML/AI systems.
- At least 4 years of experience with MLOps, AIOps, and shipping at least two large-scale ML/AI services or applications on cloud platforms such as Azure, AWS, or GCP.
- At least 4 years of technical engineering experience coding in C#, Python, and PyTorch, with proficiency in production-quality software development.
- One to two years of experience with LLMs and open-source generative AI frameworks such as LangChain, LlamaIndex, Haystack, Transformers, AutoGen, or DSPy.
- Experience with agent-based orchestration, prompt engineering, retrieval-augmented generation, fine-tuning, and evaluation.
- Ability to meet Microsoft, customer, and government security screening requirements.
Benefits
- Required to pass the Microsoft background and Microsoft Cloud background check upon hire or transfer and every two years thereafter.
- Applications are accepted on an ongoing basis until the position is filled.
- Microsoft is an equal opportunity employer and provides reasonable accommodations during the application process.
Tech Stack
Categories
About Microsoft
Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.