JPMorgan Chase

Senior Lead Software Engineer - Big Data

JPMorgan Chase
Apply
1 day ago
Bengaluru, IndiaStaff+

Responsibilities

  • Own data-platform architecture, roadmap, reliability, cost management, operational health, and production support.
  • Mentor and guide engineers, set technical direction, remove blockers, delegate work, and remain accountable for team delivery and code quality.
  • Architect and build Databricks data warehouses and lakes using sound data modeling, history tracking, and data organization practices.
  • Create reusable ETL and processing frameworks for ingestion, transformation, data quality, reconciliation, and auditability.
  • Design and govern full and incremental ingestion from databases, files, APIs, and event sources, including high-volume batch and streaming pipelines using Spark/PySpark and Kafka/Kinesis.
  • Tune performance and cost across Spark, Databricks, SQL engines, NoSQL stores, and AWS data services.
  • Govern reporting models, aggregates, and data marts to ensure accurate, reconciled, timely, and performant business and regulatory reporting.
  • Drive adoption of approved AI-assisted engineering practices for code review, refactoring, testing, release readiness, incident analysis, design analysis, and documentation.
  • Enforce modular design, code reviews, automated testing, monitoring, CI/CD, Git-based workflows, and secure, auditable engineering practices.
  • Work with application, API, and UI teams to guide integration decisions across the software stack.

Requirements

  • Formal software engineering training or certification and at least 5 years of applied experience.
  • Data engineering experience with a track record of leading teams, mentoring engineers, resolving obstacles, and owning delivery, platform stability, and incident resolution.
  • Expertise designing and developing data warehouses and data lakes on Databricks, with strong data modeling skills and familiarity with Snowflake, Redshift, BigQuery, or Azure Synapse.
  • Exceptional SQL skills, including complex queries, optimization, large-dataset analysis, reporting layers, BI tools, dashboard performance, and accuracy controls.
  • Production-grade Python and PySpark skills with an emphasis on clean, efficient, testable, and maintainable code.
  • Experience building enterprise ETL frameworks and operating batch and streaming workloads.
  • Broad knowledge of relational databases, NoSQL stores, and AWS data services, including performance tuning and technology selection.
  • Experience leading enterprise-authorized AI-assisted software development and validating AI outputs for correctness, performance, and security.
  • Understanding of responsible AI use in engineering workflows, data sensitivity, secure input/output handling, resiliency, security expectations, and compliant usage controls.
  • Well-rounded software engineering and application development knowledge, including design principles, microservices, APIs, front-end concepts, troubleshooting, CI/CD, and Git workflows.
  • Preferred experience with AWS infrastructure provisioning through Terraform or AWS CloudFormation.
  • Preferred Databricks or AWS certifications, Snowflake experience or data-platform migration experience, orchestration and data-governance tools, Docker/Kubernetes, and regulated financial-services environments.

Tech Stack

Amazon DynamoDBAmazon RedshiftApache AirflowApache CassandraApache KafkaApache SparkAWSDatabricksDockerGoogle BigQueryKubernetesMongoDBPostgreSQLPythonSnowflakeSpring BootSQLTerraform

Categories

Data Engineering
JPMorgan Chase

About JPMorgan Chase

10,000+ employees

JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.

Contact me