16 days ago
Rivne, Ukraine +3 moreSenior
Responsibilities
- Design, build, and maintain scalable ETL/ELT pipelines.
- Develop and support batch and streaming data workflows.
- Improve data-platform reliability, monitoring, performance, quality, consistency, and availability.
- Build integrations between internal and external data sources.
- Implement data-gathering mechanisms on remote IoT-connected devices.
- Troubleshoot production issues and perform root cause analysis.
- Collaborate with software engineers, analysts, and platform teams.
- Participate in architecture and technical design discussions.
- Contribute to automation, testing, and CI/CD practices.
- Support production data platforms and drive technical solutions from requirements through production.
Requirements
- Strong experience with Python and SQL.
- Strong experience building ETL/ELT pipelines.
- Strong Linux fundamentals.
- Experience with data warehousing solutions such as ClickHouse and Redshift.
- Strong experience with cloud-based data platforms.
- Hands-on experience with Airflow or similar orchestration tools.
- Experience with Kafka or other event-driven and data-streaming technologies.
- Knowledge of CI/CD and automated testing.
- Strong debugging and problem-solving skills.
- Ability to work independently and take ownership.
- Preferred experience with Spark/PySpark, Terraform, Kubernetes, Docker, data modeling, data governance, large-scale production data platforms, and AI/ML data pipelines.
Benefits
- Health insurance from the first days of employment, regardless of the probationary period.
- Company Christmas holidays from 25 December to 31 December.
- Support through the Superhumans center and Veteran HUB, including psychological counseling and military- and veteran-friendly workplace policies.
Tech Stack
Amazon RedshiftApache AirflowApache KafkaApache SparkClickHouseDockerKubernetesLinuxPythonSQLTerraform
Categories
Data Engineering
About Capgemini
Capgemini is a global IT services and consulting firm that delivers strategy, cloud, AI, software engineering, and managed services to large enterprises and public-sector clients. Founded in 1967 and headquartered in Paris, it is publicly traded on Euronext Paris and operates in 50+ countries. The group expanded its engineering capabilities by acquiring Altran in 2020, now operating as Capgemini Engineering.