Staff Machine Learning Engineer
ServiceNow8 hours ago
Hyderābād, IndiaStaff+
Responsibilities
- Lead the design and architecture of AI solutions involving reasoning, memory, and orchestration.
- Own end-to-end delivery from design through deployment for scalable, reliable, and performant systems.
- Build and optimize LLM-powered applications, AI pipelines, and agent frameworks using Java and Python.
- Apply prompt engineering, modern AI frameworks, open-source SDKs, and agentic AI techniques.
- Build logging, metrics, observability, and automated evaluation frameworks for production AI workloads.
- Evaluate model performance and optimize inference latency, cost, and end-to-end system efficiency.
- Mentor engineers, conduct code reviews, and define engineering best practices.
- Partner with product managers, architects, and leadership to translate business requirements into technical solutions.
- Stay current with LLM and Agentic AI advancements and incorporate relevant techniques into the platform roadmap.
Requirements
- At least 11 years of experience designing and implementing complex enterprise applications.
- Proven success with conversational AI and NLP platforms.
- Strong production development skills in Java and Python for AI or ML systems.
- Hands-on expertise with LLM-powered applications and tooling, including LangChain, LangGraph, OpenAI, and Anthropic APIs.
- Deep understanding of agentic reasoning pipelines, evaluation frameworks, and advanced NLP techniques.
- Experience evaluating model performance and improving latency, cost, and system efficiency.
- Ability to communicate complex AI concepts and business value to technical and non-technical stakeholders.
- Experience providing technical leadership and guiding AI or ML engineering projects across teams or domains.
- Experience leveraging AI or critically evaluating AI integration into work processes, decision-making, and problem-solving.
- Preferred qualifications include publications, technical blogs, conference talks, or open-source contributions related to LLMs, generative AI, or AI systems engineering.
Benefits
- Regular employee position in the APAC region.
- Flexible work persona, with work arrangements determined by role and assigned location.
- ServiceNow provides an accessible and inclusive application experience with reasonable accommodations available.
Categories
About ServiceNow
ServiceNow builds a cloud platform for enterprise digital workflows, covering IT service management, customer service, HR service delivery, security operations, and operations management, plus tools for custom app development. It sells subscription SaaS to large organizations and public-sector agencies to automate processes and connect data across systems. Founded in 2004 and headquartered in Santa Clara, California, ServiceNow is a public company listed on the NYSE under the ticker NOW.