Visa

Staff Data Engineer

Visa
Apply
3 days ago
Foster City, CA, USAStaff+
H1B sponsor

Base Salary

$157k - $251k/yr

Responsibilities

  • Translate stakeholder and business requirements into scalable data architectures and technical designs.
  • Develop, debug, and optimize distributed data workloads using Apache Spark, Scala, Hadoop, Hive, and Kafka.
  • Build and operate high-volume batch and streaming pipelines with orchestration, incremental processing, historical backfills, and automated data quality controls.
  • Deliver curated datasets, reusable data products, and secure API-based data services for enterprise consumption.
  • Own pipelines end to end, including deployment, monitoring, troubleshooting, documentation, and technical debt reduction.
  • Write maintainable code and enforce code reviews, automated testing, CI/CD, and secure coding standards.
  • Use AI-assisted development tools and coding agents while validating generated code for quality and security.
  • Improve system performance, reliability, observability, and cost efficiency through automation and operational metrics.
  • Ensure compliance with data governance, security, privacy, retention, and regulatory requirements.
  • Mentor engineers and lead technical problem-solving and cross-functional delivery.

Requirements

  • At least 5 years of relevant experience with a bachelor's degree, at least 2 years with an advanced degree, no required experience with a PhD, or at least 8 years of relevant experience.
  • Strong hands-on Apache Spark and Scala expertise, including experience with Hadoop, Hive, Kafka, distributed storage, debugging, and performance tuning.
  • Experience with complex batch and streaming pipelines, SQL, data modeling, orchestration, incremental processing, historical backfills, and automated data quality controls.
  • Experience delivering scalable data services, curated datasets, reusable data products, and secure API-based access.
  • Experience with cloud data engineering on AWS, Azure, or Google Cloud, including cloud-native storage, processing, security, observability, and cost optimization.
  • Experience with AI-assisted development tools, coding agents, intelligent automation, and validation against engineering and security standards.
  • Strong analytical and coding skills, design and problem-solving ability, stakeholder alignment experience, and experience mentoring engineers.
  • Experience with code reviews, automated unit, integration, and end-to-end testing, CI/CD, containerization, orchestration tools, production monitoring, and troubleshooting.
  • Experience applying secure coding practices and meeting regulatory, data privacy, access, and retention requirements.
  • Knowledge of Databricks, Clean Rooms, Spark workloads, workflow orchestration, Delta Lake, Unity Catalog, Apache Iceberg, and storage-compute separation is preferred.
  • Experience with Hadoop, Hive, Kafka, Redis, NoSQL, or relational database systems; production code deployment; real-time systems; and technical documentation.

Benefits

  • Medical, dental, vision, 401(k), FSA/HSA, life insurance, paid time off, and wellness program, with eligibility varying by position.
  • At least 3 days per week in the office, with specific expectations confirmed by the Hiring Manager.
  • The position requires 5–10% travel.
  • Work hours vary according to department needs.

Tech Stack

Apache HadoopApache HiveApache KafkaApache SparkAWSAzureDatabricksGoogle CloudRedisScalaSQL

Categories

Data Engineering
Visa

About Visa

10,000+ employees

Visa builds and operates a global digital payments network that connects consumers, merchants, financial institutions, and governments. It earns fees for processing card transactions and offering risk, data, and value‑added services through VisaNet and products like tokenization and tap‑to‑pay. Founded in 1958 and headquartered in Foster City, California, Visa is a public company (NYSE: V) serving clients in more than 200 countries and territories.

Contact me