Vanguard

Lead AI Engineer – Generative AI & Data Platforms

Vanguard
Apply
3 days ago
Hyderābād, IndiaStaff+

Responsibilities

  • Lead architecture, development, and delivery of Generative AI, RAG, agentic AI, Knowledge Graph, and AI-enabled data solutions.
  • Design governed AI-ready data pipelines, reusable AI services, APIs, agent tools, retrieval components, and engineering frameworks.
  • Architect secure RAG and Knowledge Graph systems with document processing, embeddings, vector and graph search, reranking, citations, and access controls.
  • Design agentic workflows using tool and function calling, structured outputs, state and memory management, and multi-step orchestration.
  • Establish AI evaluation, responsible AI, security, privacy, guardrail, human oversight, latency, and cost practices.
  • Define standards for automated testing, infrastructure as code, monitoring, observability, release readiness, and production support.
  • Evaluate AI models, platforms, frameworks, and technical approaches for quality, security, performance, scalability, maintainability, and cost.
  • Provide technical leadership through architecture, design, and code reviews, mentoring, troubleshooting, and engineering guidance.
  • Lead production incident resolution, root-cause analysis, release support, and reliability improvements.
  • Drive reusable engineering patterns, automation, operational improvements, and approved AI-assisted development practices.

Requirements

  • Minimum 8 years of relevant technology experience, including significant hands-on experience in software, AI, machine learning, or data engineering.
  • Bachelor’s degree in Computer Science, Information Technology, Engineering, Computer Applications, Data Science, or a related discipline.
  • Demonstrated experience delivering AI or Generative AI applications into production.
  • Strong experience with prompt and context engineering, RAG, agentic workflows, tool/function calling, structured outputs, and Model Context Protocol.
  • Experience with Amazon Bedrock, LangChain, LangGraph, or comparable AI platforms and frameworks.
  • Hands-on Knowledge Graph experience with technologies such as Amazon Neptune or Neo4j, including ontology/schema design, entity and relationship modeling, Graph-RAG, and Gremlin, Cypher, or SPARQL.
  • Advanced proficiency in Python, PySpark, Pandas, SQL, and secure software engineering.
  • Strong data engineering experience with scalable pipelines, ETL/ELT frameworks, structured and unstructured data processing, cloud data platforms, and distributed processing.
  • Experience with AWS Glue, Amazon S3, Redshift, Athena, Spark, Databricks, Airflow or Step Functions, and Kafka or Kinesis.
  • Experience with enterprise search and retrieval, OpenSearch Serverless, vector databases, embeddings, document chunking, metadata filtering, reranking, access controls, and retrieval evaluation.
  • Experience defining AI evaluation strategies for groundedness, retrieval relevance, hallucination, tool execution, security, privacy, latency, cost, guardrails, and human oversight.
  • Strong experience with Docker, Terraform or AWS CDK, Git, automated testing, monitoring, tracing, alerting, and observability.
  • Experience with production support, incident management, root-cause analysis, operational readiness, release support, and reliability improvement.
  • Experience using Claude Code and GitHub Copilot for engineering work.
  • Ability to lead architecture, design, and code reviews, establish reusable patterns, mentor engineers, and troubleshoot complex issues.
  • Strong product mindset, analytical and debugging skills, stakeholder communication, ownership, and ability to explain AI behavior and trade-offs to technical and non-technical audiences.
  • Ability to work amid ambiguity and evolving AI technologies, support critical incidents and releases outside regular working hours when needed, and uphold responsible AI, privacy, security, and engineering excellence.

Benefits

  • Vanguard provides financial, physical, and personal wellness support through its Total Rewards programs.
  • The role is based in Hyderabad, Telangana, India.
  • Vanguard uses a hybrid working model for most employees, supporting flexibility alongside in-person collaboration and learning.

Tech Stack

Amazon RedshiftApache AirflowApache KafkaApache SparkDatabricksDockerGitNeo4jPandasPythonSQLTerraform

Categories

AI ApplicationsData Engineering
Vanguard

About Vanguard

10,000+ employees

Vanguard is an investment management company offering low-cost index and active mutual funds, ETFs, brokerage, retirement plans, and financial advice for individual, institutional, and advisor clients. Founded in 1975 by John C. Bogle and headquartered in Valley Forge, PA, it operates a client-owned structure in which its funds own the firm. Its business model centers on asset-based management and advisory fees.

Contact me