Lead Software Engineer - Big Data(Data Engineer), Python, and AWS
JPMorgan Chase6 hours ago
Responsibilities
- Design, develop, maintain, and troubleshoot scalable data pipelines, data platforms, and data products.
- Deliver secure data collection, storage, access, analytics, and semantic-layer solutions.
- Develop production-quality software, review and debug code, and resolve application and data-workflow issues.
- Configure and orchestrate AWS services for data workflows, automation, scripting, and recovery validation.
- Evaluate access-control effectiveness and support data-asset security, resiliency, and auditability.
- Implement data matching solutions, data modeling, data integration, and Iceberg-based semantic layers.
- Automate recurring remediation and improve operational stability across software applications and systems.
- Use enterprise-authorized AI capabilities to support data engineering, model-design analysis, documentation, and operational routines with appropriate validation.
Requirements
- Formal training or certification in data engineering concepts and 5+ years of applied experience.
- Proficiency processing and analyzing large datasets with Apache Spark, Redshift, SQL databases, RDS, and Databricks.
- Experience designing and implementing scalable data pipelines on AWS using Python.
- Hands-on experience configuring S3, Step Functions, EMR, Glue, Lambda, RDS, EventBridge, and API Gateway.
- Strong experience with Databricks and distributed data processing technologies.
- Understanding of data architecture, data modeling, data integration, and data-product principles.
- Experience designing and operating large-scale data platforms and products in complex enterprise environments.
- Experience developing semantic layers using Iceberg tables and APIs.
- Experience implementing continuous integration and deployment processes with infrastructure-as-code tools such as Terraform.
- Experience with relational and NoSQL databases and advanced proficiency in at least one programming language.
- Advanced understanding of application resiliency, security, and the listed delivery practices.
- Preferred: experience with modern enterprise data platforms, cloud-native data architectures, real-time or analytical data use cases, AI/ML-oriented data use cases, or Databricks, Snowflake, AWS Cloud, or data engineering certifications.
Benefits
- Competitive total rewards package with benefits determined by eligibility, including comprehensive health care coverage, on-site health and wellness centers, retirement savings, backup childcare, tuition reimbursement, mental health support, and financial coaching.
- Eligible roles may include commission-based pay or discretionary incentive compensation, including cash or forfeitable equity.
- JPMorganChase provides equal employment opportunity and reasonable accommodations for qualifying needs.
Tech Stack
Categories
Data Engineering
About JPMorgan Chase
JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.