JPMorgan Chase

Lead Data Engineer - Python, Pyspark, AWS, Snowflake, AI

JPMorgan Chase
Apply
1 day ago
Hyderābād, IndiaStaff+

Responsibilities

  • Build and operate scalable batch and event-driven data pipelines on AWS using PySpark.
  • Own end-to-end architecture and delivery within the Data Delivery Platform, including ingestion, transformation, publishing, and service-level objectives.
  • Build curated data layers and data products in Snowflake, including data modeling, loading, performance tuning, cost tuning, and access controls.
  • Implement database backup, recovery, archiving, monitoring, alerting, logging, runbooks, and on-call-ready practices.
  • Lead root-cause analysis and remediation for pipeline incidents.
  • Embed data validation, schema and versioning discipline, metadata and lineage readiness, and secure handling of sensitive data.
  • Evaluate access-control processes and support data asset security, resiliency, traceability, and auditability.
  • Apply AI-assisted techniques for code scaffolding, test generation, documentation, runbook automation, and operational assistants while validating outputs.

Requirements

  • Formal training or certification in data engineering concepts and at least 5 years of applied experience.
  • Hands-on expertise designing and implementing robust PySpark pipelines on AWS.
  • Experience with AWS services including S3, Athena, Step Functions, Airflow, EventBridge, RDS, IAM, CloudWatch, KMS, and networking capabilities.
  • Experience engineering Snowflake data products and curated layers, including loading patterns, data modeling, performance and cost tuning, and access controls.
  • Experience with monitoring, alerting, logging, runbooks, incident response, and root-cause remediation for data pipelines.
  • Knowledge of data quality, governance, schema/versioning, metadata, lineage, security, code quality, testing, documentation, and reusable pipeline frameworks.
  • Experience applying enterprise-authorized Copilot- or LLM-based techniques to data engineering workflows.
  • Ability to review and validate AI-assisted outputs, follow data sensitivity requirements, and escalate uncertainty appropriately.
  • Ability to work as a technical owner and stakeholder partner without people management responsibilities.

Tech Stack

Apache AirflowAWSPythonSnowflake

Categories

Data Engineering
JPMorgan Chase

About JPMorgan Chase

10,000+ employees

JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.

Contact me