JPMorgan Chase

Lead Data Engineer - Data Engineering, Databricks, Model Serving, ML Ops, Data Architecture and modeling

JPMorgan Chase
Apply
3 days ago
Mumbai, IndiaStaff+

Responsibilities

  • Architect and maintain large-scale batch and streaming data pipelines using Apache Spark and distributed computing frameworks.
  • Develop, optimize, and productionize Databricks notebooks, jobs, and workflows for analytical and machine learning use cases.
  • Design data architectures, dimensional models, lakehouse structures, and schemas for scalable and governed data storage.
  • Write, debug, and optimize complex SQL queries for transformation, validation, and performance tuning.
  • Support production ML model serving infrastructure, including deployment, monitoring, and scaling.
  • Collaborate on MLOps practices including model versioning, ML artifact automation, monitoring, and automated retraining.
  • Translate business requirements from analytics, risk, and platform engineering stakeholders into technical data solutions.
  • Maintain data quality, lineage, security, governance, and compliance standards.
  • Use authorized AI-assisted development tools responsibly to improve engineering productivity while validating outputs for correctness, performance, and security.

Requirements

  • Formal training or certification in data engineering concepts and at least 5 years of applied experience.
  • Hands-on proficiency with Apache Spark or comparable distributed computing frameworks, including performance and cost optimization at scale.
  • Experience with distributed computing, cloud data platforms, and production ML infrastructure.
  • Production-level Databricks experience with notebooks, Delta Lake, job orchestration, and cluster management.
  • Strong SQL skills for writing, debugging, and optimizing complex queries across large datasets.
  • Experience supporting production ML model serving and familiarity with MLOps practices such as monitoring, versioning, and deployment automation.
  • Strong foundation in data architecture and operational and analytical data modeling.
  • Working knowledge of AWS, Azure, or GCP cloud data platforms.
  • Proficiency with version control systems such as Git.
  • Hands-on experience with enterprise-authorized AI-assisted software development tools and the ability to evaluate, validate, and refine generated outputs.
  • Understanding of responsible AI use, data sensitivity, secure input and output handling, resiliency, and security expectations.
  • Preferred experience with Airflow or Databricks Workflows, Docker, Kubernetes, and data or machine-learning workflows.
  • Preferred familiarity with MLflow, feature stores, model registries, Kafka, and Spark Structured Streaming.
  • Preferred experience in financial services or another highly regulated industry with data governance and compliance requirements.

Categories

Data EngineeringML Engineering
JPMorgan Chase

About JPMorgan Chase

10,000+ employees

JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.

Contact me