Visa

Sr. Data Engineer

Visa
Apply
3 days ago
Foster City, CA, USASenior
H1B sponsor

Base Salary

$132k - $204k/yr

Responsibilities

  • Partner with stakeholders to clarify requirements, define acceptance criteria, and design data pipelines, datasets, and services.
  • Develop, debug, test, and optimize distributed batch and streaming workloads using Apache Spark, Scala, Hadoop, Hive, Kafka, and distributed storage.
  • Build and operate high-volume ETL/ELT pipelines with orchestration, incremental processing, change data capture, historical backfills, and recovery procedures.
  • Create curated datasets, reusable data products, and secure data services accessible through tables, APIs, and other approved interfaces.
  • Own pipelines and services through implementation, deployment, monitoring, incident investigation, root-cause analysis, documentation, and technical debt reduction.
  • Implement automated data quality checks, schema validation, and data contracts.
  • Apply unit, integration, and end-to-end testing, CI/CD, secure coding, observability, workload analysis, and operational automation.
  • Use approved AI-assisted development tools and coding agents while validating generated code, tests, and documentation for correctness, performance, and security.
  • Apply data access, privacy, governance, retention, and regulatory requirements and partner on remediation.
  • Mentor junior engineers, explain technical trade-offs, coordinate dependencies, and escalate architectural, security, and delivery risks.

Requirements

  • At least 2 years of relevant work experience with a bachelor's degree, or at least 5 years of relevant work experience.
  • Strong hands-on Apache Spark and Scala expertise plus experience with Hadoop, Hive, Kafka, distributed storage, debugging, and performance tuning.
  • Experience with complex batch and streaming pipelines, SQL, data modeling, orchestration, incremental processing, historical backfills, and automated data quality controls.
  • Experience delivering scalable data services, curated datasets, reusable data products, and secure API-based access.
  • Knowledge of or hands-on experience with AWS, Azure, or Google Cloud and cloud-native storage, processing, security, observability, and cost optimization.
  • Familiarity with Databricks, Clean Rooms, Delta Lake, Unity Catalog, Apache Iceberg, workflow orchestration, and storage-compute separation.
  • Experience using AI-assisted development tools, coding agents, intelligent automation, containerization, orchestration tools, and CI/CD.
  • Experience monitoring and troubleshooting production systems, improving reliability and performance, applying secure coding practices, and meeting privacy, access, retention, and regulatory requirements.
  • Strong analytical and coding skills, technical design experience, problem-solving ability, mentoring experience, and stakeholder communication skills.
  • Experience with data technologies such as Redis, NoSQL, and RDBMS and with presenting technical solutions, addressing client requests, and keeping current with industry trends.

Benefits

  • Medical, dental, vision, 401(k), FSA/HSA, life insurance, paid time off, and wellness program eligibility.
  • At least 3 days per week in the office, with exact expectations confirmed by the Hiring Manager.
  • The position requires 5–10% travel.
  • Work hours vary according to department needs.
  • The position is performed in an office setting.

Tech Stack

Apache HadoopApache HiveApache KafkaApache SparkAWSAzureDatabricksGoogle CloudRedisScalaSQL

Categories

Data Engineering
Visa

About Visa

10,000+ employees

Visa builds and operates a global digital payments network that connects consumers, merchants, financial institutions, and governments. It earns fees for processing card transactions and offering risk, data, and value‑added services through VisaNet and products like tokenization and tap‑to‑pay. Founded in 1958 and headquartered in Foster City, California, Visa is a public company (NYSE: V) serving clients in more than 200 countries and territories.

Contact me