Senior Data Engineer
Mastercard2 months ago
Lisbon, PortugalSenior
Responsibilities
- Design, build, deploy, and maintain scalable batch, streaming, and real-time data pipelines.
- Develop reusable frameworks and services for data ingestion, transformation, orchestration, and data delivery.
- Build and support enterprise data lake, warehouse, and lakehouse solutions.
- Lead initiatives for platform scalability, performance, reliability, resiliency, and operational efficiency.
- Implement data quality, observability, governance, security, lineage, and monitoring capabilities.
- Partner with product, engineering, analytics, and business teams to deliver data solutions and measurable outcomes.
- Support modernization and cloud migration toward modern cloud-native architectures.
- Enable analytics, reporting, AI/ML, experimentation, and customer insights through trusted data foundations.
- Establish engineering standards, CI/CD automation, infrastructure-as-code, and data platform operational practices.
- Troubleshoot complex production issues and lead root-cause analysis.
- Mentor engineers, provide technical leadership, and contribute to architectural decisions and technology roadmaps.
Requirements
- Extensive experience designing scalable data platforms and distributed data processing solutions.
- Strong expertise with Spark, Kafka, Hadoop ecosystem technologies, cloud-native data services, and large-scale data processing frameworks.
- Proficiency in one or more of Python, Java, Scala, or SQL.
- Experience developing data pipelines for analytics, reporting, machine learning, and operational data products.
- Deep understanding of data modeling, ETL/ELT design patterns, data architecture, and data lifecycle management.
- Experience building and supporting solutions on AWS, Azure, or GCP.
- Knowledge of data governance, security, privacy, lineage, metadata management, and regulatory compliance.
- Experience with CI/CD practices, DevOps automation, infrastructure-as-code, and observability frameworks.
- Ability to diagnose and resolve complex technical challenges in distributed environments.
- Experience leading technical initiatives, influencing architecture, and mentoring engineering teams.
- Strong communication and stakeholder management skills.
- Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related technical discipline; an advanced degree is preferred.
- Passion for innovation, continuous learning, operational excellence, and high-quality enterprise-scale data solutions.
Tech Stack
Categories
Data Engineering
About Mastercard
Mastercard builds and operates a global payments network used by banks, merchants, fintechs, and governments, offering card processing, real-time payments, tokenization, and fraud/risk services. It generates revenue from transaction processing and assessment/service fees across more than 200 countries and territories. Founded in 1966 and headquartered in Purchase, New York, Mastercard is a public company listed on the NYSE (ticker: MA).