27 days ago
Base Salary
$86k - $127k/yr
Responsibilities
- Design, build, and operate Bronze-through-Gold medallion data architecture on Databricks.
- Implement DLT and Lakeflow pipelines for batch and structured-streaming ingestion.
- Own schema enforcement, schema evolution, identity resolution, feature engineering, and governed serving tables.
- Build unstructured document-processing pipelines using Databricks AI Functions or ai_query.
- Manage Unity Catalog access control, lineage, tenant isolation, and pipeline-level PII governance.
- Develop data-quality frameworks covering reconciliation, deduplication, and lineage checks.
- Operate the Gold serving layer supporting twelve analytical models and agentic live-query workloads.
- Own CI/CD, infrastructure-as-code, cost management, observability, latency, and serving reliability for the Databricks environment.
Requirements
- 5–7 years of data engineering experience, including 2+ years of production Databricks experience.
- Hands-on experience with Delta Lake, Unity Catalog, DLT or Lakeflow, structured streaming, and SQL warehouses.
- Strong Python skills for transformation logic, data-quality automation, and pipeline orchestration.
- Expert-level SQL and experience designing schemas for analytical and serving workloads.
- Fluency with GCP, including BigQuery, Cloud Storage, Cloud Run, and IAM.
- Hands-on experience with at least one clean room or privacy-preserving data exchange technology.
- Knowledge of PII governance, data residency, consent frameworks, GLBA, Fair Lending, and UDAAP in a regulated industry.
- Preferred experience with Databricks AI Functions, ai_query, Vertex AI, dbt, identity resolution, RampID, UID2, LiveRamp, AMC, GMP, XMi, LangSmith, or LangGraph.
Benefits
- Paid time off including 12–25 vacation days depending on employee grade, company holidays, personal days, and sick leave.
- Medical, dental, and vision coverage, or provincial healthcare coordination in Canada.
- Retirement savings plans such as 401(k) in the U.S. or RRSP in Canada.
- Life and disability insurance.
- Employee assistance programs and other benefits based on local policy and eligibility.
- Benefits are available to regular, full-time employees and depend on local policy and eligibility.
Tech Stack
Categories
Data Engineering
About Capgemini
Capgemini is a global IT services and consulting firm that delivers strategy, cloud, AI, software engineering, and managed services to large enterprises and public-sector clients. Founded in 1967 and headquartered in Paris, it is publicly traded on Euronext Paris and operates in 50+ countries. The group expanded its engineering capabilities by acquiring Altran in 2020, now operating as Capgemini Engineering.