23 hours ago
Pune, IndiaSenior

Responsibilities

  • Design, build, maintain, develop, and test scalable production-grade ETL/ELT data pipelines from extraction through consumption for the GPN Lakehouse.
  • Manage ETL processes, data modeling, data warehouse and lake architecture, pipeline performance, reliability, and data quality.
  • Integrate machine learning models for automated data classification, anomaly detection, data quality assessment, and automated decision-making within ETL operations.
  • Establish and manage deployment pipelines for reliable code promotion across development, staging, and production environments.
  • Translate complex business requirements from Business Analysts, Architects, and Development Leads into scalable technical solutions.
  • Own unit testing, code quality assurance, defect prevention, technical issue investigation, tracking, and resolution.
  • Collaborate with technical and non-technical stakeholders, participate in meetings and knowledge sharing, and contribute to continuous improvement.
  • Document and monitor time allocation across concurrent projects and priorities while optimizing existing applications.
  • Build expertise in TSYS and Global Payments business operations, payment processing platforms, credit card industry standards, and regulatory requirements.

Requirements

  • Advanced proficiency with Google Cloud Platform and services including BigQuery, Cloud SQL, Cloud Functions, Cloud Storage, and Cloud Datastore.
  • Strong knowledge of data warehouse architecture, ETL design patterns, and data modeling best practices.
  • Experience with Apache Airflow, dbt, and Spark for data pipeline development.
  • Experience using YAML, JSON, and Google Cloud Shell scripting.
  • Experience with GitHub, Jira, Confluence, Rally, and VSTS for version control, collaboration, and project workflows.
  • Preferred experience integrating and deploying machine learning models in production data workflows and collaborating with data scientists on MLOps.
  • Preferred experience developing AI-powered data transformation, enrichment, intelligent data routing, AI agents, and natural language processing for unstructured data extraction.
  • Strong communication, attention to detail, prioritization, adaptability, and cross-functional collaboration skills.

Benefits

  • Global and inclusive team environment with opportunities to learn from experienced industry professionals.
  • Opportunities for professional growth, continuous learning, and career development in a global payments company.

Tech Stack

Apache AirflowApache SparkdbtGoogle BigQueryGoogle CloudGoogle Cloud Platform

Categories

Data Engineering
Contact me