20 hours ago
Hyderābād, IndiaSenior
Responsibilities
- Design, implement, and deploy production LLM solutions and agent frameworks focused on reliability, interpretability, and safety.
- Build automated evaluation pipelines, unit and integration test suites, adversarial tests, and human-in-the-loop evaluation workflows.
- Create and operationalize guardrails including prompt patterns, policy enforcement, input sanitization, output validation, data filtering, and explainability tools.
- Prototype and productionize agentic behaviors such as RAG, multi-step planners, tool-use interfaces, state management, and safe action execution.
- Implement MLOps practices including model versioning, scalable serving, observability, and cost controls.
- Collaborate with security, privacy, regulatory, and ethics teams to embed compliance and auditability into deployments.
- Translate prototypes into production solutions and stay current with LLM and agent research and best practices.
Requirements
- 5 to 9 years of applied machine learning or software engineering experience, including at least 2 years working on production ML systems.
- B.Tech, M.Tech, or MS specializing in Computer Science.
- Hands-on experience with LLM fine-tuning, instruction tuning, retrieval augmentation, and embeddings.
- Practical experience with agent frameworks and multi-step agent behaviors.
- Strong Python software engineering skills and experience with deep learning frameworks such as PyTorch, JAX, or TensorFlow.
- Experience building evaluation suites, human-in-the-loop workflows, adversarial testing, and guardrails or safety mechanisms for NLP/LLM systems.
- Experience deploying services in cloud environments with Kubernetes and model-serving technologies.
- Experience with Agentic AI, multi-agent systems, planners, applied agent safety research, benchmarking, or continuous evaluation tooling is preferred.
- Background in regulated industries such as pharma or healthcare, and familiarity with traditional machine learning, data governance, and model risk management, are preferred.
- Advanced technical credentials or contributions to open-source or academic work in LLMs or agent systems are preferred.
- Clear communication and effective collaboration with cross-functional stakeholders are required.
Tech Stack
Categories
About Amgen
Amgen is a public biotechnology company that discovers, develops, manufactures, and sells biologic and biosimilar therapeutics for patients with serious diseases. Its portfolio and pipeline span oncology, cardiovascular disease, osteoporosis, inflammation, and rare diseases, marketed globally through direct sales and partnerships. Founded in 1980 and headquartered in Thousand Oaks, California (NASDAQ: AMGN), Amgen is a component of the Dow Jones Industrial Average and completed the acquisition of Horizon Therapeutics in 2023.