18 days ago
Wrocław, Poland +3 moreSenior
Responsibilities
- Design and develop scalable cloud-based data platforms using AWS, Azure, or GCP.
- Build, optimize, and maintain batch and streaming data pipelines.
- Integrate diverse data sources and expose data through APIs, semantic layers, and data warehouses.
- Use orchestration, compute, processing, and event-driven cloud services such as Dataflow, Databricks, Snowflake, EventBridge, Pub/Sub, and Event Hub.
- Design and optimize data models and bronze/silver/gold processing architectures.
- Optimize SQL and NoSQL solutions for efficient performance.
- Collaborate with data scientists and engineering teams to operationalize machine learning models.
- Document data architectures, workflows, and technical processes.
- Ensure platform security, compliance, encryption, identity/access management, and data governance.
- Participate in architectural discussions and technology recommendations.
Requirements
- Practical experience building data platforms with AWS, Azure, or GCP.
- Strong understanding of large-scale data processing with Spark, Hive, Snowflake, Delta Lake, or similar technologies.
- Excellent SQL skills and experience with relational and/or NoSQL databases.
- Programming skills in Python or Scala.
- Experience with CI/CD tools including Azure DevOps, GitHub Actions, GitLab CI, or Jenkins.
- Hands-on experience with Docker and Kubernetes.
- Knowledge of DataOps principles, data testing, and monitoring.
- Understanding of data security, encryption, and identity/access management.
- Familiarity with cloud AI/ML services or generative AI tools is preferred.
- Very good command of English.
Benefits
- Medical care through Medicover, private life insurance, Sports card, and access to the Capgemini Helpline for therapeutic support.
- Access to more than 70 training tracks with certification opportunities through the NEXT platform.
- Free access to Education First, Pluralsight, TED Talks, Coursera, and Udemy Business learning materials and training.
- Opportunity to work with cutting-edge technologies and platforms in a stable, supportive organization recognized as Top Employer Poland 2024.
Tech Stack
Apache HiveApache SparkAWSAzureDatabricksDockerGitHub ActionsGitLab CI/CDGoogle Cloud PlatformJenkinsKubernetesPythonScalaSnowflakeSQL
Categories
Data EngineeringDevOps
About Capgemini
Capgemini is a global IT services and consulting firm that delivers strategy, cloud, AI, software engineering, and managed services to large enterprises and public-sector clients. Founded in 1967 and headquartered in Paris, it is publicly traded on Euronext Paris and operates in 50+ countries. The group expanded its engineering capabilities by acquiring Altran in 2020, now operating as Capgemini Engineering.