Sr Software Engineer III - AI (IND)
Elevance Health1 day ago
Bengaluru, IndiaSenior
Responsibilities
- Develop and maintain microservice architectures and REST and gRPC API management solutions for AI deployments.
- Collaborate with data scientists and product managers to acquire, process, and manage data for AI/ML model integration and optimization.
- Design and implement scalable enterprise-grade data pipelines for AI/ML models.
- Debug, optimize, and enhance machine learning models for quality and performance.
- Manage infrastructure with Terraform, CloudFormation, and Pulumi.
- Create and manage CI/CD pipelines using GitHub Actions and Jenkins.
- Operate Kubernetes platforms with advanced configurations and service mesh implementations for scalable ML workloads.
- Design and build scalable LLM inference architectures using GPU memory optimization and model quantization.
- Perform prompt engineering and LLM fine-tuning for semantic retrieval and chatbot development.
- Document model architectures, hyperparameter experiments, and validation results using version control and experiment tracking tools.
- Research and implement LLM optimization techniques including quantization and knowledge distillation.
- Develop healthcare-focused NLP solutions including text classification, sentiment analysis, and topic modeling.
- Design and execute A/B tests for machine learning models and analyze results.
- Research current AI technologies and integrate new methodologies and frameworks.
- Create specialized AI solutions for healthcare domain applications.
Requirements
- Bachelor’s degree in any engineering stream is required; Computer Science or Engineering education is preferred.
- At least 6 years of relevant AI engineering experience is required; 8 years of total experience is preferred.
- Advanced Python proficiency with NumPy, Pandas, scikit-learn, PyTorch, and TensorFlow.
- Experience with Hugging Face Transformers, LangChain, prompt engineering, LLM fine-tuning, evaluation, RAG, vector databases, and semantic search.
- Experience with Spark, SQL, Git, MLflow, and DVC.
- Expertise in microservices, test-driven development, concurrency processing, and low-level design for software architectures.
- Experience with Terraform, CloudFormation, GitHub Actions, Jenkins, Kubernetes, Helm, containerization, and service mesh implementations.
- Experience with vLLM, FastAPI, TorchServe, TF Serving, automated model retraining, and LLM deployment.
- Strong knowledge of AWS, GCP, Azure, and network security for ML systems.
- Experience developing chatbots, recommendation systems, translation services, and optimized LLM solutions.
- Strong foundation in statistics, probability, linear algebra, optimization, feature engineering, embedding optimization, dimensionality reduction, experimental design, and statistical hypothesis testing.
- Strong analytical, communication, collaboration, mentoring, project coordination, and business requirements translation skills.
Benefits
- Extensive learning and development opportunities.
- Culture focused on innovation, creativity, freedom, and growth.
- Holistic well-being support.
- Rewards and recognition programs.
- Health and medical insurance coverage.
- Best-in-class amenities and workspaces.
- Policies designed around associates.
- Full-time employment.
Tech Stack
Apache SparkAWSAzureDVCFastAPIGitGitHub ActionsGoGoogle Cloud PlatformgRPCHelmHugging Face TransformersJenkinsKubernetesMLflowNumPyPandasPythonPyTorchRustscikit-learnSQLTensorFlowTerraform
Categories
About Elevance Health
Fueled by our bold purpose to improve the health of humanity, we are transforming from a traditional health benefits organization into a lifetime trusted health partner. Our nearly 100,000 associates serve more than 118 million people, at every stage of health. We address a full range of needs with an integrated whole health approach, powered by industry-leading capabilities and a digital platform for health. We believe that improving health for everyone is possible. It begins by redefining health, reimagining the health system, and strengthening our communities.