Software Engineer III- Data Engineer(Python, Databricks and AWS)
JPMorgan Chase19 days ago
Responsibilities
- Design, develop, optimize, and maintain end-to-end data pipelines and data architectures using Databricks, Apache Spark, and AWS.
- Implement and manage workflow orchestration with Airflow and integrate streaming data using Kafka.
- Develop and maintain ETL processes, data models, and data warehouses using Python and SQL.
- Collaborate with data scientists, analysts, and business stakeholders to deliver trusted data solutions.
- Ensure data quality, integrity, security, traceability, auditability, resiliency, and compliance across the data lifecycle.
- Prepare and engineer data for AI and machine learning model development and deployment.
- Monitor, troubleshoot, and optimize data workflows for performance and reliability.
- Use and validate enterprise-authorized AI capabilities for data engineering workflows, including pipeline analysis, documentation, test generation, and control validation.
Requirements
- Formal training or certification in data engineering concepts and at least 3 years of applied experience.
- Experience across the full data engineering lifecycle from ingestion through production.
- Strong hands-on expertise with Databricks, Apache Spark, AWS, Airflow, and Kafka.
- Proficiency in Python and SQL for data processing, manipulation, and analysis.
- Experience with data modeling, ETL development, and data warehousing.
- Ability to use, review, and validate enterprise-authorized AI-assisted outputs while following data sensitivity and handling requirements.
- Familiarity with AI/ML workflows and supporting data pipelines for machine learning.
- Relevant AWS, Databricks, or Spark certifications are highly desirable.
- Experience with Docker and Kubernetes is preferred.
- Knowledge of data governance and compliance standards and exposure to big data tools and frameworks are preferred.
- Strong problem-solving, attention to detail, communication, and teamwork abilities.
Benefits
- Comprehensive health care coverage.
- On-site health and wellness centers.
- Retirement savings plan.
- Backup childcare.
- Tuition reimbursement.
- Mental health support and financial coaching.
- Competitive total rewards and additional benefits based on eligibility.
Tech Stack
Categories
Data Engineering
About JPMorgan Chase
JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.