Software Engineer III - Python, Spark/PySpark, Databricks, SQL
JPMorgan Chase11 hours ago
Bengaluru, IndiaSenior
Responsibilities
- Develop ELT workflows and data pipelines using Python, Spark/PySpark, and Databricks.
- Build, test, and maintain scalable data pipelines and architectures for enterprise analytics use cases.
- Optimize pipeline performance, reliability, maintainability, data quality, and system architecture.
- Support data security, governance, and entitlements frameworks.
- Use SQL and work with relational and NoSQL data stores.
- Partner with stakeholders to translate data requirements into production-ready solutions.
- Apply testing, deployment, and operational monitoring practices to maintain pipeline stability.
- Contribute reusable frameworks and standards for pipeline delivery.
- Identify data issues, anomalies, and optimization opportunities.
- Use enterprise-authorized AI-assisted development tools responsibly, validating generated outputs for correctness, performance, and security.
Requirements
- Formal training or certification in software engineering concepts and at least 3 years of applied experience.
- Hands-on experience with Databricks, Spark/PySpark, Python, and SQL.
- Experience developing and maintaining data pipelines and data processing systems.
- Understanding of data ingestion, transformation, storage, and consumption lifecycles.
- Knowledge of AWS and distributed data processing.
- Experience with testing and deployment practices.
- Strong problem-solving and data or pipeline troubleshooting abilities.
- Ability to collaborate within agile teams and across stakeholders.
- Hands-on experience using enterprise-authorized AI-assisted software development tools and critically evaluating their outputs.
- Understanding of responsible AI use, data sensitivity, secure input and output handling, resiliency, and security expectations.
- Preferred experience with Databricks Lakehouse, Delta Lake, and medallion architecture.
- Preferred exposure to data quality, observability, metadata management, analytics, reporting, or AI/ML workloads.
- Familiarity with modern front-end technologies and cloud technologies is preferred.
Tech Stack
Categories
Data Engineering
About JPMorgan Chase
JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.