Lead Data Engineer
Mastercard16 days ago
Base Salary
$161k - $266k/yr
Responsibilities
- Design and develop cloud-native data and BI solutions using Databricks and Snowflake on AWS.
- Build scalable data pipelines, analytics frameworks, ETL/ELT pipelines, data integration frameworks, and distributed data solutions.
- Implement multi-cloud architectures across AWS and Azure, including Azure Databricks and ADLS Gen2.
- Integrate Databricks, Snowflake, AWS services, and Azure services across compute engines and cloud providers.
- Build CI/CD pipelines, automation frameworks, and Infrastructure as Code for data platform provisioning and deployment.
- Implement governed and secure access patterns using RBAC, IAM, service principals, and enterprise identity integration.
- Establish standards for development, testing, deployment, monitoring, documentation, and operational excellence.
- Optimize platforms and workloads for performance, scalability, reliability, resiliency, and cost efficiency.
- Lead technical design reviews and influence architecture and platform engineering decisions.
- Partner with Product, Architecture, Engineering, Data, and Business teams to translate requirements into technical solutions.
- Provide technical leadership and mentorship while driving initiatives from design through implementation.
Requirements
- Deep hands-on experience as a Lead or Senior Data Engineer building enterprise-scale cloud data, analytics, and BI platforms.
- Strong expertise with Databricks, Snowflake, and AWS, including S3, Glue, EMR, and IAM.
- Advanced proficiency with Apache Spark/PySpark, Delta Lake, SQL, and Python for large-scale data processing and analytics.
- Experience designing multi-cloud data architectures across AWS and Azure; Azure Databricks and ADLS Gen2 experience is a plus.
- Experience with CI/CD, Infrastructure as Code, automation, Git/GitHub, and DevOps practices for data platforms.
- Experience implementing enterprise security, governance, access controls, data lineage, metadata management, and observability.
- Knowledge of modern and open data architectures and formats, including Delta Lake and Apache Iceberg.
- Understanding of FinOps, cloud cost optimization, performance, and scalability for large-scale data workloads.
- Ability to lead technical design and architecture decisions, drive complex cross-team engineering initiatives, mentor engineers, and communicate technical trade-offs and recommendations.
- Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related STEM discipline, or equivalent practical experience.
Benefits
- Hybrid work arrangement based in Arlington, Virginia, requiring three days onsite per week.
- Competitive base salary of $161,000–$266,000 in Arlington, Virginia, with potential annual bonus or commissions depending on the role.
- Medical, prescription drug, dental, vision, disability, and life insurance.
- Flexible spending account and health savings account.
- Paid leaves including 16 weeks of new parent leave and up to 20 days of bereavement leave.
- 80 hours of Paid Sick and Safe Time, 25 vacation days, five personal days, and 10 U.S. observed holidays.
- 401(k) with company match and deferred compensation for eligible roles.
- Fitness reimbursement or onsite fitness facilities and potential tuition reimbursement.
- Mastercard intends to fill the position by January 17, 2027, or as soon as possible if the date has passed.
About Mastercard
Mastercard builds and operates a global payments network used by banks, merchants, fintechs, and governments, offering card processing, real-time payments, tokenization, and fraud/risk services. It generates revenue from transaction processing and assessment/service fees across more than 200 countries and territories. Founded in 1966 and headquartered in Purchase, New York, Mastercard is a public company listed on the NYSE (ticker: MA).