2 months ago
Bengaluru, IndiaStaff+
Responsibilities
- Design and build scalable LLM-powered applications, intelligent assistants, AI copilots, RAG pipelines, knowledge retrieval systems, and agentic or multi-agent workflows.
- Write production-quality code across data ingestion, embedding pipelines, orchestration logic, API layers, and AI evaluation systems, primarily in Python and secondarily in Java/CAP.
- Build agentic workflows on SAP AI Core and integrate LLM-based features into CAP/Fiori applications.
- Architect and deploy multi-tenant SaaS solutions on SAP BTP using patterns and services including MTX, service-manager, and IAS/AMS.
- Implement ontology-grounded agents, semantic search, vector databases, prompt orchestration, tool calling, memory, and context-aware reasoning.
- Contribute to fine-tuning, alignment, prompt optimization, inference optimization, and model evaluation.
- Establish LLMOps practices for deployment, monitoring, observability, governance, guardrails, and AI cost management.
- Instrument OTEL tracing, build Cloud Logging dashboards, and optimize latency, throughput, HANA Cloud queries, and AI Core inference costs.
- Apply SRE practices including monitoring, alerting, incident response, and root cause analysis.
- Build evaluation and benchmarking frameworks with domain-specific test harnesses for validating LLM outputs.
- Develop proofs of concept, accelerators, reusable AI solutions, technical publications, and patent ideas.
- Collaborate with platform, data, product, and business teams; mentor junior engineers and conduct code reviews.
Requirements
- 10–12 years of hands-on experience in AI/ML, Generative AI, Data Science, and/or Enterprise Architecture delivering production-grade LLM and AI solutions.
- Degree in Computer Science, AI, Data Science, Engineering, or a related field.
- Expert-level Python skills for AI pipelines, agent frameworks, orchestration, APIs, and evaluation systems.
- Experience with Java and SAP CAP microservices, plus strong SQL and HANA Cloud query optimization skills.
- Experience building and consuming RESTful and event-driven APIs and using asynchronous programming patterns.
- Experience with unit testing, integration testing, test harness design, Git, CI/CD pipelines, code reviews, and engineering practices at scale.
- Hands-on experience with LLMs, foundation models, agentic AI, deep learning, prompt engineering, RAG, embeddings, semantic search, fine-tuning, model evaluation, and guardrails.
- Experience with LangChain, LlamaIndex, Semantic Kernel, Hugging Face, OpenAI APIs, vector databases, TensorFlow, PyTorch, and scikit-learn.
- Knowledge of distributed systems, microservices, scalable application design, resiliency, fault tolerance, Kubernetes, Docker, and cloud AI platforms.
- Experience with SAP BTP, SAP AI Core, SAP Generative AI Hub, SAP CAP in Java or Node.js, and SAP BTP multi-tenancy patterns.
- Experience with Spark/Databricks, data pipeline design, big-data ecosystems, and HANA Cloud query design.
- Preferred qualifications include open-source contributions, publications, patents, GenAI transformation, enterprise search, copilots, autonomous agent frameworks, Responsible AI, governance, AI security, AI cost management, and production benchmarking.
Benefits
- Flexible working models and a culture focused on inclusion, health, well-being, and personal development.
- Regular full-time employment with expected travel of 0–10% and a hybrid work arrangement.
- Accessibility accommodations are available for applicants with disabilities.
- Successful candidates may be required to complete background verification.
Tech Stack
Apache SparkAWSAzureDatabricksDockerGitGoogle Cloud PlatformJavaKubernetesNode.jsPythonPyTorchscikit-learnSQLTensorFlow
Categories
About SAP
SAP builds enterprise application software and cloud services for finance, procurement, supply chain, human resources, and analytics, sold through subscriptions, licenses, and support. Its portfolio includes SAP S/4HANA, SAP Business Technology Platform, SAP Ariba, and SAP SuccessFactors. Founded in 1972 and headquartered in Walldorf, Germany, SAP is a public company listed on the NYSE and Frankfurt (ETR) and serves enterprises and public-sector organizations worldwide.