Lead Software Engineer - Data Engineering | Data Technology
JPMorgan Chase28 days ago
Responsibilities
- Design, develop, and optimize large-scale ETL data pipelines.
- Build modular, reusable, logged, and tested Python applications.
- Develop and maintain distributed data processing solutions using PySpark.
- Design and validate large-scale end-to-end testing approaches.
- Implement and support workflow orchestration using Control-M or Apache Airflow.
- Develop cloud-native data solutions using AWS Glue, Athena, Lambda, and CloudWatch.
- Design and manage data lake architectures using Iceberg and/or Delta Lake.
- Administer and optimize Snowflake environments, including streams, tasks, roles, and warehouses.
- Participate in code reviews and promote engineering, testing, and CI/CD standards.
- Drive secure and responsible adoption of enterprise-authorized AI-assisted development tools and automation.
- Mentor engineers and lead technical delivery initiatives.
Requirements
- Formal training or certification in software engineering concepts and 5+ years of applied experience focused on data engineering.
- Experience developing, debugging, and maintaining software in a large corporate environment.
- Strong Python experience and secondary experience with Java or another modern programming language.
- Hands-on experience with PySpark or other distributed data processing frameworks.
- Strong expertise in DBT and modern ETL development practices.
- Experience with Control-M or Apache Airflow, including MWAA.
- Expertise with AWS data services including Glue, Athena, CloudWatch, and Lambda.
- Knowledge of Iceberg and/or Delta Lake.
- Experience with Snowflake administration and development.
- Strong SQL skills and experience with modern database technologies.
- Experience with Kafka, Flink, or other streaming technologies is preferred.
- Familiarity with LLMs, prompt engineering, vector search, responsible AI, and AI-assisted development tools such as GitHub Copilot or Claude is preferred.
- Financial services experience, large-scale enterprise data environment experience, and experience mentoring engineers are preferred.
Benefits
- Competitive total rewards package with role-, experience-, skill-, and location-based base salary, plus eligible incentive compensation.
- Comprehensive health care coverage and access to on-site health and wellness centers.
- Retirement savings plan, backup childcare, tuition reimbursement, mental health support, and financial coaching.
- Equal opportunity employment and reasonable accommodations for religious practices, mental health needs, and physical disabilities.
Tech Stack
Categories
Data Engineering
About JPMorgan Chase
JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.