7 days ago
Vila Nova de Gaia, PortugalSenior
Responsibilities
- Own and develop end-to-end data ingestion and processing pipelines across SAP, Kafka, APIs, and databases.
- Build scalable data solutions with Azure Data Factory, Databricks, Spark, SQL, Delta Lake, and Unity Catalog.
- Implement data quality, observability, monitoring, alerting, and data contract enforcement.
- Design performant, cost-efficient, reusable data engineering frameworks and components.
- Maintain CI/CD pipelines and collaborate with DataOps, ML Engineering, AI, Analytics, and product teams.
- Deliver trusted, curated data products supporting analytics and AI use cases.
- Mentor Data Engineers, conduct code reviews, and provide technical leadership.
- Apply source-aligned data engineering, governance, producer-consumer data models, and data mesh principles.
Requirements
- Strong experience with Python or Scala, advanced SQL, Spark, Delta Lake, and Databricks.
- Experience building batch, CDC, and streaming data pipelines with Azure Data Factory and related Azure data services.
- Strong knowledge of data quality, monitoring, observability, alerting, CI/CD, Git, and Unity Catalog.
- Experience with cross-functional stakeholders in complex data and AI environments.
- Experience mentoring team members, sharing knowledge, and providing technical leadership.
- Excellent collaboration, communication, stakeholder management, problem-solving, prioritization, and decision-making skills.
- Experience with SAP, high-volume transactional data, and data mesh principles is preferred.
- Experience with Kafka, Spark Structured Streaming, SAP S/4HANA, BW, BDC, embeddings, vector databases, and document processing is preferred.
Benefits
- Flexible hybrid work environment allowing employees to manage working hours and work from the office or remotely according to company policy.
- Career Acceleration Programs supporting growth, reskilling, and new skill development.
- Autonomy and collaborative peer relationships in the workplace.
- Health and life insurance, referral program with bonuses, and other partnership-related fringe benefits.
Tech Stack
Categories
Data Engineering
About Capgemini
Capgemini is a global IT services and consulting firm that delivers strategy, cloud, AI, software engineering, and managed services to large enterprises and public-sector clients. Founded in 1967 and headquartered in Paris, it is publicly traded on Euronext Paris and operates in 50+ countries. The group expanded its engineering capabilities by acquiring Altran in 2020, now operating as Capgemini Engineering.