Lead Data Engineer
Mastercard20 hours ago
Hyderābād, IndiaStaff+
Responsibilities
- Set and enforce design standards, patterns, and best practices for data pipelines built with Databricks, Spark, Python, PySpark, and dbt.
- Provide technical leadership, architecture ownership, and direction to a team of engineers.
- Lead the team’s CI/CD, DataOps, and data observability strategy.
- Own Databricks platform administration standards and deployment governance using Databricks Asset Bundles.
- Resolve complex technical challenges across data pipelines and the platform.
- Mentor engineers and establish strong code review and quality practices.
- Partner with product teams and stakeholders on roadmaps, prioritization, and technical trade-offs.
- Own deployment, migration, and upgrade strategies for data platforms.
Requirements
- Bachelor’s or Master’s degree in computer science or a related technical field.
- At least 8 years of data engineering experience, including demonstrated technical leadership.
- Expert hands-on experience with Databricks, including administration, Spark, Python, and PySpark.
- Deep expertise in dbt, TDD, and CI/CD using GitLab and Jenkins.
- Ability to define engineering standards and lead team engineering practices.
- Strong architecture and platform ownership across observability, cost, and performance.
- Excellent communication and stakeholder management skills.
- Experience in banking, e-commerce, credit cards, or payment processing is preferred.
- Exposure to both SaaS and premises-based architectures is preferred.
- A post-secondary degree in computer science, mathematics, or quantitative science is preferred.
Tech Stack
Categories
Data Engineering
About Mastercard
Mastercard builds and operates a global payments network used by banks, merchants, fintechs, and governments, offering card processing, real-time payments, tokenization, and fraud/risk services. It generates revenue from transaction processing and assessment/service fees across more than 200 countries and territories. Founded in 1966 and headquartered in Purchase, New York, Mastercard is a public company listed on the NYSE (ticker: MA).