ML Operations Engineer
DeepIntent2 months ago
Belgrade, SerbiaMid Level
Responsibilities
- Partner with Data Science and AI Engineering teams to adopt MLOps practices and migrate training and inference workloads.
- Build and maintain ML model tracking, versioning, experiment management, registries, and observability using tools such as MLflow.
- Develop CI/CD pipelines for ML and AI artifacts, container images, and automated retraining triggers.
- Improve platform reliability, cost efficiency, maintainability, and underlying code quality.
- Establish Prometheus and Grafana monitoring for GPU utilization, model latency, throughput, and custom ML metrics.
- Design and operate GPU cluster, model serving, training, and inference infrastructure.
- Build infrastructure for LLM and generative AI workloads, including fine-tuning pipelines, vector databases, RAG architectures, and inference optimization.
- Collaborate with business units and Product on ML- and AI-driven feature development.
- Manage project priorities, deadlines, and deliverables.
Requirements
- Bachelor’s degree in Computer Science or a similar technical field, or equivalent practical experience.
- Strong software engineering skills in complex, distributed, multi-language systems, with Python preferred.
- Production experience with Spark, Docker, and Kubernetes.
- Experience building and operating end-to-end distributed systems.
- Experience with open-source MLOps tools such as MLflow, Argo, Metaflow, Airflow, or Kubeflow.
- Understanding of software testing, benchmarking, and CI/CD practices.
- Understanding of Linux systems administration.
- Familiarity with LLM and generative AI tooling, model serving frameworks, embeddings, vector stores, and RAG pipelines is preferred.
- Familiarity with GPU infrastructure, CUDA, Kubernetes GPU scheduling and orchestration, NVIDIA drivers, CUDA toolkit, and cuDNN.
- Ability to work closely with data scientists and understand Jupyter, notebooks, experiment tracking, and related workflows.
Benefits
- Competitive base salary plus performance-based bonus; specific amount not stated.
- Comprehensive medical insurance and paid holidays for Europe-based employees.
- Hybrid-friendly culture with flexible work options.
- Professional development reimbursement, WiFi reimbursement, and parental leave.
- US benefits include medical, dental, and vision insurance, 401(k) matching, flexible PTO, paid holidays, remote-friendly work options, career development support, WFH and internet stipends.
- India benefits include medical insurance, paid holidays, professional development reimbursement, WiFi reimbursement, and a health and wellness allowance.
Tech Stack
Categories
About DeepIntent
DeepIntent builds a healthcare-focused demand-side platform that lets pharmaceutical brands and healthcare agencies plan, activate, and optimize programmatic advertising using privacy-safe clinical and identity data. The company generates revenue from platform and media-buying fees across display, video, CTV, and mobile channels. Founded in 2016 and headquartered in New York, DeepIntent is backed by private equity firm Vitruvian Partners.