10 hours ago
Bengaluru, IndiaSenior
Responsibilities
- Design and build scalable, reliable end-to-end AI agent workflows.
- Develop and optimize RAG pipelines, including chunking, embeddings, retrieval, ranking, re-ranking, and context management.
- Create and iteratively test prompt engineering layers and chain-of-thought strategies.
- Implement tool orchestration with databases, rule engines, validation systems, and formatting tools.
- Establish automated quality checks, validation layers, evaluation frameworks, and performance tracking.
- Deploy, monitor, and maintain AI/ML solutions in production with robust error handling.
- Design feedback loops that convert expert review data into measurable agent improvements.
- Collaborate with Data Scientists to instrument and measure AI solutions.
Requirements
- 2–4 years of experience, including at least 2 years focused on LLM-based applications, RAG systems, or AI agent workflows.
- Advanced proficiency in Python.
- Hands-on experience with LangChain or LlamaIndex.
- Expertise in systematic prompt engineering and testing.
- Deep understanding of RAG architectures, embedding models, vector stores, retrieval strategies, and re-ranking.
- Experience building multi-step agent workflows with tool use and branching logic.
- Experience deploying and maintaining AI/ML solutions in production.
- Experience developing data pipelines for AI systems.
- Preferred experience with multi-agent orchestration, content generation, translation, document processing, feedback loops, RLHF, reward model training, multimodal AI, generative AI evaluation, automated scoring, and LLM cost optimization.
- Bachelor's degree in Computer Science, Data Science, Information Technology, Statistics, or a related discipline is desired.
- Preferred certifications include a machine learning or artificial intelligence certification, such as the TensorFlow Developer Certificate or AWS Certified Machine Learning – Specialty, and certification in LLM engineering or generative AI.
Categories
About Brillio
Brillio is a privately held digital engineering and enterprise AI services firm that helps Fortune 1000 companies modernize products, data, and infrastructure. It combines consulting and managed services with an accelerator platform (ADAM) across cloud, AI, data engineering, customer experience, and infrastructure workstreams. Founded in 2014 and headquartered in Dallas, it operates delivery centers across North America, Europe, and Asia, with focus areas that include healthcare and life sciences.