Principal AI Engineer (AI Enablement Platform)
ABC Financial Services15 hours ago
Hyderābād, IndiaStaff+
Responsibilities
- Build and operate production AI platform services, APIs, orchestration components, evaluation systems, SDKs, templates, and internal developer tools.
- Develop reusable capabilities for chat APIs, RAG, summarization, classification, semantic search, prompt and workflow execution, and agent orchestration.
- Create orchestration patterns for retrieval, tool use, validation, fallback handling, memory and state management, and human-in-the-loop workflows.
- Build evaluation harnesses with curated test sets, scenario-based evaluations, regression checks, quality gates, and release criteria for LLM-powered systems.
- Implement AI observability covering tracing, prompt and version tracking, output quality, latency, token and cost visibility, and production feedback loops.
- Establish safe defaults and production fundamentals including structured outputs, tool permissions, prompt-injection awareness, data controls, testing, monitoring, rollout strategy, incident readiness, and performance tuning.
- Partner with SRE, Security, Platform, Product Engineering, and Data teams to improve reliability, scalability, security, observability, and cost management.
- Drive adoption of the AI Enablement Platform through technical standards, architecture reviews, documentation, code examples, internal demos, office hours, technical write-ups, and enablement sessions.
- Lead technical design reviews and architecture forums, mentor engineers, and provide hands-on technical direction across complex AI platform areas.
- Use AI-assisted engineering tools responsibly to improve software development, testing, debugging, documentation, and iteration.
Requirements
- Typically 10+ years of significant hands-on engineering experience with strong backend and platform engineering depth.
- Recent experience building and operating production backend or platform systems, including code, APIs, infrastructure, observability, debugging, and production tradeoffs.
- Proven experience building and shipping production-grade AI or LLM systems such as RAG, agent workflows, tool-calling systems, AI APIs, or LLM-powered product capabilities.
- Strong programming experience, preferably in Python and/or backend service stacks for production APIs and distributed systems.
- Deep understanding of API design, service boundaries, SDKs, integration patterns, reliability, testing, observability, performance, and cost optimization.
- Practical experience with context engineering, retrieval patterns, tool use, structured outputs, orchestration, fallback handling, and evaluation for LLM applications.
- Experience building AI evaluation and validation systems using golden datasets, scenario-based tests, regression checks, and quality gates.
- Experience deploying and operating cloud-based production systems on AWS, GCP, Azure, or similar platforms.
- Ability to make tradeoffs across speed, reliability, safety, cost, developer experience, and business impact.
- Ability to lead through hands-on technical contribution, design reviews, reference implementations, mentoring, and cross-team partnership.
- Preferred experience with internal developer platforms, SDKs, shared services, paved-path tooling, LLM observability or evaluation tooling, vector databases, embedding workflows, semantic search, retrieval tuning, and RAG productionization.
- Preferred familiarity with Langfuse, LangSmith, OpenTelemetry-based tracing, LangChain, LangGraph, LlamaIndex, Semantic Kernel, Cursor, GitHub Copilot, Claude, ChatGPT, or similar tools.
- Preferred experience writing technical blogs, engineering guides, architecture documents, enablement material, and leading technical standards or architecture forums.
Benefits
- Purpose-led company with a values-focused culture centered on Best Life, One Team, and Growth Mindset.
- Competitive PTO plans with 15 earned accrued leave days, 12 sick leave days, and 12 casual leave days per year.
- 11 holidays plus 4 quarterly Days of Disconnect.
- Group mediclaim insurance coverage of INR 500,000 for the employee, spouse, two children, and parents or parents-in-law, including EAP counseling.
- Life insurance and personal accident insurance.
- Quarterly Best Life fitness reimbursement.
- Calm App subscription for the employee and up to four dependents over age 16.
- Financial aid toward crèche facilities for working women.
- Hybrid work arrangement indicated by the posting.
Tech Stack
Categories