Capgemini

Lead Data Engineer - Databricks Architect

Capgemini
Apply
1 day ago
Atlanta, GA, USAStaff+
H1B sponsor

Base Salary

$103k - $184k/yr

Responsibilities

  • Architect and deliver scalable, secure, and high-performance data platforms using Databricks and cloud-native technologies.
  • Establish data architecture standards, frameworks, and best practices across programs and client engagements.
  • Lead technical strategy, solution design, and architecture reviews for enterprise data initiatives.
  • Provide technical leadership and mentorship to data engineers, developers, and technical leads throughout the software development lifecycle.
  • Design and optimize data ingestion, transformation, storage, and consumption patterns using modern lakehouse architectures.
  • Collaborate with business and technical stakeholders to define data strategies aligned with organizational objectives.
  • Drive governance, security, reliability, and performance best practices across the data ecosystem.
  • Support pre-sales activities, solution proposals, and executive-level client discussions as a trusted advisor.

Requirements

  • 12+ years of experience in data engineering, data platforms, and analytics solutions.
  • 4+ years of hands-on experience designing, architecting, and delivering enterprise data solutions using Databricks.
  • Proven experience serving as a Lead Architect across multiple complex data transformation engagements.
  • Ability to independently define, design, and implement end-to-end modern data architectures using Databricks and cloud-native technologies.
  • Extensive experience leading and mentoring large teams of data engineers, developers, and technical leads.
  • Expert-level hands-on development experience with PySpark, Python, and distributed data processing frameworks.
  • Strong expertise in advanced SQL development, performance tuning, and data modeling.
  • Hands-on experience with at least two major cloud platforms: Azure, AWS, or Google Cloud Platform.
  • Proven success designing and deploying Delta Lake solutions in production environments.
  • Experience building scalable batch and real-time data pipelines processing large volumes of structured, semi-structured, and unstructured data.
  • Strong understanding of data architecture principles, database design, data governance, and performance optimization.
  • Experience working directly with senior business and technology stakeholders, including executive leadership.

Benefits

  • Comprehensive benefits package for regular, full-time employees, subject to local policy and eligibility.
  • Paid time off including vacation, company holidays, personal days, and sick leave; vacation is listed as 12–25 days depending on employee grade.
  • Medical, dental, and vision coverage, or provincial healthcare coordination in Canada.
  • Retirement savings plans such as 401(k) in the U.S. and RRSP in Canada.
  • Life and disability insurance.
  • Employee assistance programs and other locally applicable benefits.

Categories

Data Engineering
Capgemini

About Capgemini

10,000+ employees

Capgemini is a global IT services and consulting firm that delivers strategy, cloud, AI, software engineering, and managed services to large enterprises and public-sector clients. Founded in 1967 and headquartered in Paris, it is publicly traded on Euronext Paris and operates in 50+ countries. The group expanded its engineering capabilities by acquiring Altran in 2020, now operating as Capgemini Engineering.

Contact me