1 day ago
Base Salary
$89k - $166k/yr
Responsibilities
- Define and deploy end-to-end data architectures incorporating Databricks medallion architecture.
- Design, build, and optimize scalable data solutions and ETL/ELT pipelines on the Databricks Lakehouse Platform.
- Lead large teams of engineers and developers delivering Databricks solutions.
- Manage senior client stakeholders.
- Extract and integrate structured and unstructured data from multiple sources and databases.
- Apply data modeling, data warehousing, database engineering, performance tuning, orchestration, and production deployment practices.
- Work with Unity Catalog, Delta Sharing, Databricks Marketplace, Databricks Apps, Genie, AI/BI, and Databricks data visualization capabilities.
Requirements
- At least 6 years of experience in data engineering.
- At least 4 years of experience designing and delivering data engineering solutions with Databricks.
- Expert hands-on development skills in PySpark and Python.
- Expert hands-on SQL development skills.
- Hands-on experience with at least two of Azure, AWS, and Google Cloud.
- Prior expertise deploying Delta Lake solutions into production.
- Experience working with large and complex data sets from varied sources and databases.
- Strong understanding of database engineering and design principles.
- Background working with orchestration tools such as Airflow.
- Strong knowledge of Unity Catalog.
- Experience with ETL tools such as Informatica, Talend, or Matillion is desired.
- Expertise with Delta Sharing and Databricks Marketplace.
- Experience working with Databricks Apps.
- Working knowledge of Databricks Genie, AI/BI, and Databricks data visualization capabilities.
- Preferred experience with conceptual, logical, and physical data modeling.
- Familiarity with CI/CD methods is desired.
Benefits
- Comprehensive benefits package for regular, full-time employees, subject to local policy and eligibility.
- Paid time off including vacation, company holidays, personal days, and sick leave.
- Medical, dental, and vision coverage, or provincial healthcare coordination in Canada.
- Retirement savings plans such as 401(k) in the U.S. or RRSP in Canada.
- Life and disability insurance.
- Employee assistance programs.
Tech Stack
Categories
Data Engineering
About Capgemini
Capgemini is a global IT services and consulting firm that delivers strategy, cloud, AI, software engineering, and managed services to large enterprises and public-sector clients. Founded in 1967 and headquartered in Paris, it is publicly traded on Euronext Paris and operates in 50+ countries. The group expanded its engineering capabilities by acquiring Altran in 2020, now operating as Capgemini Engineering.