Capgemini

Senior Data Engineer - Databricks

Capgemini
Apply
1 day ago
Atlanta, GA, USA or Bridgewater, NJ, USASenior
H1B sponsor

Base Salary

$84k - $156k/yr

Responsibilities

  • Design, develop, and deploy scalable data engineering solutions on the Databricks Lakehouse Platform.
  • Define and implement Databricks Medallion Architecture using Bronze, Silver, and Gold layers.
  • Lead and mentor data engineers and developers delivering enterprise data modernization initiatives.
  • Develop and optimize complex data pipelines with PySpark, Python, and SQL.
  • Build and operate production Delta Lake solutions focused on data quality, reliability, and performance.
  • Implement data sharing and collaboration through Delta Sharing and Databricks Marketplace.
  • Design and manage data governance frameworks with Unity Catalog.
  • Extract, transform, and integrate structured and unstructured data from diverse sources and platforms.
  • Partner with business stakeholders and senior clients to gather requirements and communicate technical recommendations.
  • Use Databricks AI/BI, Genie, Apps, and data visualization capabilities to provide insights and self-service analytics.
  • Develop and maintain orchestration workflows using tools such as Apache Airflow.
  • Support CI/CD pipelines, DevOps practices, data modeling, and adherence to architecture, governance, and security standards.

Requirements

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
  • At least 6 years of data engineering experience.
  • At least 4 years of hands-on Databricks experience delivering enterprise-scale solutions.
  • Proven experience architecting and deploying end-to-end platforms using Databricks Medallion Architecture.
  • Expert proficiency in PySpark, Python, and SQL.
  • Strong production experience implementing and managing Delta Lake.
  • Hands-on experience with at least two of Microsoft Azure, Amazon Web Services, and Google Cloud Platform.
  • Strong understanding of database design, data engineering principles, and distributed data processing.
  • Experience leading and mentoring data engineering and development teams.
  • Demonstrated success managing and influencing senior client stakeholders.

Benefits

  • Hybrid work arrangement based in Atlanta, Georgia, or New Jersey.
  • Comprehensive benefits package for regular full-time employees, including paid time off, company holidays, personal days, and sick leave.
  • Medical, dental, and vision coverage, or provincial healthcare coordination in Canada.
  • Retirement savings plans such as 401(k) in the U.S. and RRSP in Canada.
  • Life and disability insurance and employee assistance programs.
  • Additional benefits are available according to local policy and eligibility.

Tech Stack

Categories

Data Engineering
Capgemini

About Capgemini

10,000+ employees

Capgemini is a global IT services and consulting firm that delivers strategy, cloud, AI, software engineering, and managed services to large enterprises and public-sector clients. Founded in 1967 and headquartered in Paris, it is publicly traded on Euronext Paris and operates in 50+ countries. The group expanded its engineering capabilities by acquiring Altran in 2020, now operating as Capgemini Engineering.

Contact me