2 days ago
Haifa, Israel or Tel Aviv-Yafo, IsraelSenior
Responsibilities
- Design and build AI agents that plan, use tools and APIs, manage state and memory, and complete multi-step workflows.
- Own AI features from design through production, including deployment, monitoring, evaluation, and live-site reliability.
- Create evaluation datasets, automated evaluation harnesses, quality metrics, release gates, and human-in-the-loop review processes.
- Develop and version prompt, retrieval, memory, and tool-schema strategies, and debug model behavior using traces and data inspection.
- Optimize token usage, inference cost, latency, caching, model routing, batching, and monitoring for continuous improvement.
- Partner with product, design, and domain stakeholders on use cases, acceptance criteria, and rollout plans.
- Mentor engineers and influence AI architecture and platform direction across sovereign and regulated cloud environments.
Requirements
- At least 7 years of professional software development experience, including at least 4 years of software engineering experience building and shipping AI, ML, or generative AI features in production.
- Proven experience building AI agents.
- Hands-on experience with AI evaluation methodologies and integrating quality standards and guardrails into delivery.
- Proficiency in Python and/or C#, with experience using REST APIs and SDKs.
- Deep understanding of AI system design, ML fundamentals, generative AI concepts, and cloud-native architectures.
- Bachelor's degree in computer science or engineering, or equivalent practical experience, is preferred.
- Experience with Azure, production AI features, LLM observability and tracing, evaluation tooling, retrieval systems, grounding techniques, responsible AI, and inference optimization is preferred.
- Strong context engineering, AI debugging, cross-disciplinary collaboration, independent ownership, and innovation skills are preferred.
Categories
About Microsoft
Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.