2 months ago
Aguascalientes, MexicoStaff+
Responsibilities
- Design and implement enterprise-scale data ingestion frameworks using Databricks Native Data Loader, Lakeflow Connect, and other Databricks-native capabilities.
- Build and optimize batch and streaming data pipelines from Oracle, MySQL, SQL Server, APIs, and other enterprise data sources.
- Develop ELT and ETL pipelines using Databricks, Spark, Delta Lake, and cloud-native technologies.
- Implement end-to-end data movement, transformation, validation, monitoring, and governance solutions.
- Lead architectural decisions for data ingestion, storage, processing, and governance.
- Lead and mentor data engineers and provide technical guidance to junior engineers.
- Collaborate with Product, Engineering, Analytics, Architecture, and business stakeholders to deliver data solutions.
- Drive coding, DevOps, CI/CD, testing, and documentation best practices.
- Participate in architecture reviews, code reviews, technical design discussions, sprint planning, and estimation activities.
Requirements
- Deep expertise in data engineering, large-scale data integration, and cloud-based data platforms.
- Hands-on experience with Databricks Native Data Loader, Lakeflow Connect, Delta Lake, and enterprise data migration.
- Experience working with relational databases such as Oracle, MySQL, and SQL Server.
- Ability to design, develop, and optimize scalable data ingestion and processing solutions.
- Ability to lead data engineering initiatives, mentor engineering teams, and collaborate with business and technology stakeholders.
Benefits
- Meaningful projects using technology to solve real-world challenges.
- Continuous learning through internal academies, certifications, mentorship, and digital learning platforms.
- Career growth in a collaborative global community.
Tech Stack
Categories
Data Engineering
About Capgemini
Capgemini is a global IT services and consulting firm that delivers strategy, cloud, AI, software engineering, and managed services to large enterprises and public-sector clients. Founded in 1967 and headquartered in Paris, it is publicly traded on Euronext Paris and operates in 50+ countries. The group expanded its engineering capabilities by acquiring Altran in 2020, now operating as Capgemini Engineering.