Gen AI GCP Architect - Senior Manager- Bangalore, Gurgaon, Hyderabad
Ernst and Young29 days ago
Kolkāta, IndiaStaff+
Responsibilities
- Own end-to-end GenAI solution architecture from ideation and feasibility through PoCs, MVPs, and production implementation.
- Lead architecture workshops and translate complex business problems into scalable, secure enterprise GenAI architectures.
- Design RAG pipelines, including chunking, retrieval, embeddings, reranking, grounding, and vector database optimization.
- Define prompt engineering and evaluation standards covering correctness, faithfulness, hallucination reduction, latency, cost, and regression management.
- Architect agentic AI systems using LangChain, LangGraph, and custom orchestration layers with multi-agent coordination, tools, memory, routing, and fallback patterns.
- Design FastAPI-based services, enterprise security controls, AWS cloud deployments, DynamoDB architectures, and LLM platform strategies.
- Establish LLMOps, observability, evaluation, deployment, monitoring, versioning, rollback, governance, guardrails, and responsible AI practices.
- Review architecture decisions and production readiness while mentoring technical teams and advising leadership on GenAI adoption strategy.
Requirements
- 14+ years of experience in software engineering, solution architecture, or AI platform design.
- At least 5 years of GCP experience and strong proficiency in Python and object-oriented programming.
- Deep hands-on experience with RAG architectures, retrieval optimization, prompt engineering, prompt evaluation, Chain-of-Thought, and guardrails.
- Advanced experience with LangChain, LangGraph, FastAPI, AWS architecture, DynamoDB, JWT-based authentication, vector databases, AWS Bedrock, and Azure OpenAI.
- Strong knowledge of LLMOps, including evaluation pipelines, deployment, monitoring, versioning, and governance.
- Proven ability to turn ambiguous ideas into working PoCs and MVPs and scale GenAI solutions into enterprise platforms.
- Strong architectural ownership, stakeholder communication, technical influence, and ability to balance innovation, cost, performance, and enterprise risk.
- Experience with enterprise chatbots, copilots, analytics-driven GenAI platforms, regulated environments, GenAI governance, or insurance is preferred.
Benefits
- Continuous learning, coaching, leadership development, and access to tools and skills for career growth.
- Inclusive and diverse culture with flexibility to make a meaningful impact.
- Role based in Bangalore, Gurgaon, or Hyderabad as part of EY Global Delivery Services, collaborating across global delivery locations and EY service lines.
Tech Stack
Categories
About Ernst and Young
Ernst & Young (EY) provides audit/assurance, tax, consulting, strategy and transactions services to enterprises, financial institutions, and public‑sector clients. Structured as a global network of partner‑owned member firms, it sells professional services on a fee basis, including a dedicated Financial Services Organization for banking, insurance, and capital markets. Headquartered in London, EY was formed in 1989 from the merger of Ernst & Whinney and Arthur Young, and operates in 150+ countries.