11 hours ago
Chennai, IndiaSenior
Responsibilities
- Industrialize AI solutions into reliable, scalable, production-ready ML pipelines and services.
- Bridge Data Scientists and IT Production teams by translating business needs into production implementations.
- Manage Python environments and support security, code quality, performance, and obsolescence management.
- Develop and optimize Airflow DAGs, integrations, task dependencies, retries, parallelism, executors, and artifact handling.
- Configure and optimize Denodo virtual data layers, data services, API integrations, and VQL queries.
- Build and maintain containerized and orchestrated workloads using Docker and Kubernetes.
- Develop CI/CD workflows and automate testing, operational processes, and continuous improvements.
- Monitor systems, analyze logs, troubleshoot complex issues, and contribute to incident management.
- Collaborate with Brussels-based teams and participate proactively in remote meetings.
Requirements
- More than four years of professional Python programming experience, including object-oriented programming, decorators, code quality, security, and performance optimization.
- Strong experience with uv, pip, mamba, and micromamba for Python environment building.
- Experience with MLOps, model versioning, and model deployment.
- Proficiency with Docker and Kubernetes, including scaling and resource management.
- Advanced Jenkins and GitLab CI/CD experience, including workflows and artifact management.
- Linux, Bash scripting, cloud infrastructure, system administration, and troubleshooting experience.
- Strong PostgreSQL and SQL skills, including query optimization and schema design.
- Denodo Platform proficiency, including virtual data layers, logical views, data services, API integrations, and VQL.
- Experience integrating Denodo, PostgreSQL, S3, MLflow, or Kubeflow with Airflow using hooks, operators, or APIs.
- Experience designing and maintaining scalable Airflow DAGs and optimizing workflow execution.
- Familiarity with Django API design, Spark, Hadoop, ETL/ELT pipelines, model quantization or pruning, Kafka, Kibana, ELK, or Grafana is preferred.
- Bachelor’s degree, postgraduate degree, or equivalent qualification.
- Excellent spoken and written English and experience collaborating in multicultural, international environments.
- Experience with Agile and Scrum and relevant business experience.
Benefits
- Innovation-focused work culture delivering technology and transformation projects for financial-services clients.
- Ongoing learning opportunities to acquire new skills and deepen existing expertise.
- Flat, non-hierarchical structure with opportunities to work directly with senior partners and clients.
- Diverse, inclusive, meritocratic, and flexible work culture.
- Location: Chennai, with remote collaboration and participation in Brussels meetings.
Tech Stack
Apache AirflowApache HadoopApache KafkaApache SparkBashDjangoDockerGitLab CI/CDGrafanaJenkinsKibanaKubernetesLinuxMLflowPostgreSQLPythonSQL
Categories
Data EngineeringML Engineering
About Capco
Capco is a global technology and management consultancy focused on financial services, helping banks, capital markets, insurance, and wealth firms with digital transformation, risk and compliance, and data/AI-enabled modernization. Founded in 1998 and headquartered in London, it operates as a Wipro company. Its business model centers on project-based consulting, managed services, and solution delivery across strategy, engineering, and platforms for regulated institutions.