QA Data Engineering Lead
Sumitomo Mitsui Banking Corporation9 days ago
Tralee, IrelandStaff+
Responsibilities
- Own the overall data QA strategy, testing governance, quality standards, controls, and measures across delivery.
- Lead Database QA Engineers and provide technical direction on testing strategy, coverage, and execution.
- Develop testing plans for complex data pipelines, ETL processes, and data warehouse solutions.
- Review requirements to identify testable conditions, data-quality risks, gaps, and acceptance criteria.
- Assess data quality, testing progress, risks, and release readiness for senior stakeholders.
- Design, develop, and execute ETL, database, data-pipeline, and end-to-end validation tests.
- Validate data integrity across the Bronze, Silver, and Gold layers of Databricks Medallion Architecture.
- Write advanced SQL queries and Python scripts using PySpark and Pandas to validate large datasets.
- Review Databricks jobs and pipeline runs, investigate failures and inconsistencies, and support resolution with engineering teams.
- Define and track test scenarios and cases, manage defects through Jira, and drive escalation and remediation of significant data-quality issues.
- Improve QA processes, data-testing standards, automation practices, and testing governance.
Requirements
- Bachelor’s degree in Computer Science, Engineering, Data, or a related discipline, or equivalent relevant experience.
- 7+ years of experience in database, ETL, data warehouse, or data-quality testing, including complex QA delivery leadership.
- Proven experience leading QA teams and providing technical direction across complex data environments.
- Strong hands-on experience with Databricks, advanced SQL, Python, PySpark, and Pandas.
- Strong SQL skills with window functions, complex joins, and common table expressions for large-scale data validation.
- Strong experience with Databricks Notebooks and cluster management.
- Strong understanding of ETL processes, data pipelines, data warehouses, and end-to-end data validation.
- Experience validating data across Databricks Bronze, Silver, and Gold layers.
- Experience with Azure or AWS environments.
- Experience developing test strategies, establishing QA governance, and assessing release readiness.
- Experience with Jira and Agile/Scrum delivery environments.
- Ability to improve data-testing processes, standards, and automation practices.
- Strong analytical, problem-solving, communication, and stakeholder-management skills across global teams.
- Experience with CI/CD pipelines, automated testing, Git-based version control, automated data-testing frameworks, or enterprise-scale data transformation and migration programs is advantageous.
Benefits
- Hybrid work arrangement with work-from-home and office opportunities.
- At least three days per work week at the Tralee office is required.
- Employees must live within a reasonable commuting distance of their office location.
- Reasonable accommodations are available during candidacy for applicants with disabilities.
About Sumitomo Mitsui Banking Corporation
Sumitomo Mitsui Banking Corporation provides corporate, investment, and commercial banking services—such as lending, capital markets, global trade finance, treasury/FX, and transaction banking—to corporate, institutional, and consumer clients. Headquartered in Tokyo, it is the core banking subsidiary of Sumitomo Mitsui Financial Group (SMFG), one of Japan’s three major banking groups, whose shares trade in Tokyo and as NYSE ADRs (SMFG). SMBC serves clients through a network spanning nearly 40 countries.