Senior Lead Software Engineer - Python, PySpark, Big Data, Data pipeline, ML/AI
JPMorgan Chase2 days ago
Responsibilities
- Design, develop, debug, troubleshoot, and maintain secure, high-quality production software solutions.
- Lead adoption and governance of approved AI-assisted engineering practices, including code review, refactoring, testing, troubleshooting, documentation, and incident analysis.
- Define architecture for complex deliverables and promote reusable engineering patterns and automation.
- Build and optimize data pipelines, process large datasets, and create visualizations and reporting for continuous improvement.
- Develop and deploy machine learning models and apply AI/ML delivery and software engineering best practices.
- Configure and optimize Spark clusters and maintain algorithms that operate with dependent systems.
- Lead technologists in solving complex technical issues and improving coding hygiene, system architecture, and operational stability.
Requirements
- At least five years of applied software engineering experience and at least two years leading technologists on complex technical work.
- Formal training and certification in software engineering concepts.
- Hands-on experience with system design, application development, testing, and operational stability.
- Experience developing, debugging, and maintaining code in a large corporate environment using modern programming and database querying languages.
- Hands-on experience with enterprise-authorized AI-assisted software development tools and the ability to validate and refine generated outputs for correctness, performance, and security.
- Strong SQL skills for validating features and data quality at scale.
- Experience with Python, PySpark, big data, data pipelines, machine learning, and Spark cluster configuration and optimization.
- Hands-on experience with AWS services including EMR, EC2, S3, and CloudWatch.
- Working knowledge of Databricks for creating data pipelines and deploying machine learning models.
- Preferred experience includes Java, Spring Boot, high-volume APIs, Pandas, NumPy, Apache Airflow, AWS certifications, and modern LLM techniques.
Benefits
- Competitive total rewards and benefits package, with eligibility-based health care coverage, retirement savings, backup childcare, tuition reimbursement, mental health support, financial coaching, and on-site health and wellness centers.
- Additional total compensation and benefits details are provided during the hiring process.
Tech Stack
Categories
Data EngineeringML Engineering
About JPMorgan Chase
JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.