Software Engineer III – PySpark/AWS/Databricks
JPMorgan Chase2 months ago
Responsibilities
- Design, develop, execute, debug, and maintain secure, high-quality production software solutions.
- Create architecture and design artifacts for complex applications and ensure implementation meets design constraints.
- Build and optimize large-scale data-processing solutions using Python, PySpark, Spark, AWS, and Databricks.
- Create Databricks data pipelines and deploy machine learning models.
- Gather, analyze, visualize, and report on large and diverse datasets to improve software applications and systems.
- Use enterprise-authorized AI-assisted development tools for coding, refactoring, testing, troubleshooting, and documentation while validating outputs for correctness, performance, and security.
- Identify data patterns and hidden problems and use findings to improve coding practices and system architecture.
- Support application resiliency, operational stability, secure coding, and software development lifecycle practices.
Requirements
- Formal training or certification in software engineering concepts and at least 3 years of applied experience.
- Hands-on experience with system design, application development, testing, operational stability, and maintaining code in a large corporate environment.
- Experience with one or more modern programming languages, frameworks, and database querying languages.
- Hands-on experience using and critically evaluating enterprise-authorized AI-assisted software development tools.
- Understanding of responsible AI use, data sensitivity, secure handling of inputs and outputs, resiliency, and security expectations.
- Knowledge of software development lifecycle practices, application resiliency, security, and agile development practices.
- Knowledge of machine learning modeling as an engineer.
- Experience with Python, PySpark, big data, data pipelines, or machine learning technologies.
- Strong SQL skills for validating features and data quality at scale.
- Experience configuring and optimizing Spark clusters for large-scale processing.
- Hands-on experience with AWS services including EMR, EC2, S3, and CloudWatch.
- Working knowledge of Databricks for creating data pipelines and deploying machine learning models.
- Preferred: familiarity with modern front-end technologies and cloud technologies.
- Preferred: knowledge of Python machine learning libraries and ecosystems, including Pandas and NumPy.
- Preferred: AWS certification such as Solutions Architect Associate.
- Preferred: exposure to Apache Airflow or Control-M.
Benefits
- Competitive total rewards and benefits package, with eligibility-based benefits and programs.
- Comprehensive health care coverage and on-site health and wellness centers.
- Retirement savings plan and backup childcare.
- Tuition reimbursement, mental health support, and financial coaching.
- Equal opportunity employer with reasonable accommodations for religious practices, mental health needs, and disabilities.
Tech Stack
Categories
Data Engineering
About JPMorgan Chase
JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.