
Software Engineer III - Databricks, Python Pyspark
JPMorgan Chase12 hours ago
Mumbai, IndiaSenior
Responsibilities
- Design, develop, and maintain scalable batch and streaming data pipelines using Databricks, PySpark, Python, and AWS services.
- Build Lakehouse medallion architectures and curate raw data into business-ready datasets with quality and lineage checks.
- Write secure, high-quality production code, troubleshoot technical issues, and maintain application algorithms and systems.
- Optimize PySpark jobs, SQL queries, Databricks workloads, and cloud-native data pipelines for performance and scalability.
- Produce architecture and design artifacts while ensuring implementation meets design constraints.
- Use and validate AI-assisted coding tools for code generation, refactoring, testing, troubleshooting, and documentation.
- Collaborate with architects and governance teams on code reviews, automation, compliance, resiliency, and security.
- Identify data patterns and hidden problems to improve coding practices, data quality, and system architecture.
Requirements
- Formal training or certification in software engineering concepts and at least 3 years of applied experience.
- Hands-on experience with system design, application development, testing, operational stability, debugging, and maintaining software in a large corporate environment.
- Experience using enterprise-authorized AI-assisted software development tools and critically evaluating their correctness, performance, and security.
- Experience with Databricks, including Delta Lake, Workflows/Jobs, Unity Catalog, compute optimization, Databricks SQL, and batch and streaming pipelines.
- Proficiency in Python, PySpark, Pandas, NumPy, advanced SQL querying, and SQL performance tuning.
- Understanding of responsible AI use, data sensitivity, secure input and output handling, resiliency, security, and the ability to guide peers on safe usage.
- Knowledge of the Software Development Life Cycle and agile development practices.
- Preferred familiarity with front-end technologies, dbt, Data Vault 2.0, star and Snowflake schemas, Spark, Hadoop, Redshift, BigQuery, data lakes, Jenkins, Git, and Terraform.
Tech Stack
Categories
Data Engineering
About JPMorgan Chase
JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.