3 days ago
Aguascalientes, MexicoMid Level
Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines.
- Integrate data from REST APIs, relational databases, structured and semi-structured files, external systems, and enterprise platforms.
- Implement data ingestion, transformation, and loading processes.
- Optimize processing performance and costs.
- Manage data lake and data warehouse storage platforms.
- Model data for analytical consumption and reporting.
- Implement data validation, quality controls, monitoring, and process tracking.
- Ensure data integrity, consistency, and availability.
- Prepare reliable datasets for advanced analytics and data models.
- Collaborate with BI, Analytics, and Data Science teams.
- Document pipelines, transformations, and operational processes.
- Apply data engineering, security, governance, access control, and compliance best practices.
- Participate in continuous improvement and automation initiatives.
- Support the analysis, design, development, implementation, and integration of technology solutions for Capgemini clients.
Requirements
- At least 3 years of experience in data engineering.
- Proficiency in Python, advanced SQL, PySpark, ETL/ELT, Azure Data Factory, Azure Databricks, Azure Synapse, Spark, data lakes, Parquet, and Delta Lake.
- Experience with SQL Server, PostgreSQL, or MySQL, and Git.
- Technical strategic leadership, architectural thinking, business vision, executive stakeholder management, influence, negotiation, and effective communication skills.
- Ability to solve complex problems and work under pressure with a quality- and results-oriented approach.
- Preferred experience with Snowflake, Airflow, dbt, Great Expectations, pytest, Kafka, and Azure DevOps.
- DP-203 certification is a plus.
Benefits
- Competitive compensation and benefits superior to those required by law.
- Hybrid work arrangement in Mexico City.
- Collaborative team environment with professional development and career-planning opportunities.
- Recruitment and onboarding support focused on building professional skills.
- The role supports client-facing consulting work with functional, technical, and business specialists.
Tech Stack
Apache AirflowApache KafkaApache SparkDatabricksdbtGitMicrosoft SQL ServerMySQLPostgreSQLpytestPythonSnowflakeSQL
Categories
Data Engineering
About Capgemini
Capgemini is a global IT services and consulting firm that delivers strategy, cloud, AI, software engineering, and managed services to large enterprises and public-sector clients. Founded in 1967 and headquartered in Paris, it is publicly traded on Euronext Paris and operates in 50+ countries. The group expanded its engineering capabilities by acquiring Altran in 2020, now operating as Capgemini Engineering.