1 month ago
Bengaluru, IndiaStaff+
Responsibilities
- Understand data ecosystems, security, privacy, retention, governance, and data-quality requirements.
- Clarify stakeholder and business requirements and translate them into architecture designs for data-system components.
- Write extensible, maintainable, reusable, testable, and efficient code and participate in code reviews.
- Own data products and data pipelines end to end, including technical-debt mitigation, documentation, and troubleshooting.
- Build automation for transforming, managing, accessing, deploying, and monitoring batch and real-time data processes.
- Write queries and implement orchestration for end-to-end data extraction pipelines.
- Develop unit, integration, end-to-end, security, and other required testing and address issues identified by testing.
- Manage applicable software upgrades and server patches for security remediation.
- Develop troubleshooting procedures and technical documentation for advanced production problems.
- Partner with cross-functional stakeholders and mentor junior engineers.
Requirements
- Bachelor’s degree with 6+ years of relevant experience, an advanced degree with at least 2 years of relevant experience, a PhD with 0 years of experience, or 8+ years of relevant experience.
- Experience solving data problems with data technologies and designing large-scale data pipelines and processing jobs.
- Experience with Hadoop, Hive, HBase, Spark, Trino, or comparable distributed data systems.
- Experience with data pipelines, ETL/ELT, data-quality frameworks, Java or Python, SQL, Git, and production troubleshooting.
- Experience writing, modifying, and reviewing high-quality, testable, efficient code.
- Experience developing automated unit, integration, and end-to-end tests.
- Experience building and maintaining CI/CD pipelines, containerized deployments, and orchestration processes.
- Experience monitoring production applications and troubleshooting with observability tools.
- Experience integrating AI or ML services into applications and analyzing metrics for optimization.
- Experience partnering with stakeholders, applying secure coding practices, and complying with regulatory standards.
- Preferred: enterprise-class high-availability, low-latency, scalable systems experience with depth across storage and compute separation, query and table formats, streaming, metadata, governance, and interoperability.
- Preferred: experience contributing to open-source components, building and pushing production code, supporting real-time systems, using or building AI agents and agentic patterns, mentoring junior engineers, and writing technical documentation.
Tech Stack
Categories
Data Engineering
About Visa
Visa builds and operates a global digital payments network that connects consumers, merchants, financial institutions, and governments. It earns fees for processing card transactions and offering risk, data, and value‑added services through VisaNet and products like tokenization and tap‑to‑pay. Founded in 1958 and headquartered in Foster City, California, Visa is a public company (NYSE: V) serving clients in more than 200 countries and territories.