Lead Software Engineer - Data Engineer
JPMorgan Chase17 hours ago
Hyderābād, IndiaStaff+
Responsibilities
- Build automated, self-healing data operations using agentic frameworks and AI-driven workflows.
- Design and deploy data solutions using AWS S3, Lambda, EKS, and Step Functions.
- Implement Infrastructure as Code practices for reproducible and scalable deployments.
- Lead adoption of enterprise-authorized AI-assisted engineering practices and establish validation standards for secure coding, peer review, testing, and AI output quality.
- Build and optimize scalable data ingestion, transformation, analytics, and data lake solutions using Apache Spark, AWS Glue, and Apache Iceberg.
- Develop and manage batch and real-time data pipelines using Apache Kafka and Apache Flink.
- Design end-to-end data architectures and define standards for scalable, reliable, and performant data processing.
- Coach engineers on responsible, secure, and compliant use of AI-assisted development tools.
Requirements
- Formal training or certification in software engineering concepts and 5+ years of applied experience.
- Experience leading the effective use of approved AI-assisted software development tools and validating AI outputs for correctness, performance, and security.
- Understanding of responsible AI use, data sensitivity, secure input and output handling, resiliency, and security expectations.
- Experience with DataOps, data observability, and data governance.
- Deep expertise with Apache Spark, AWS Glue, Apache Iceberg, and data lake architectures.
- Experience designing and managing batch and real-time pipelines with Apache Kafka and Apache Flink.
- Strong hands-on experience with AWS S3, Lambda, EKS, and Step Functions.
- Experience building automated data operations with agentic frameworks and AI-driven workflows.
- Advanced proficiency in Python, Scala, or Java, along with strong SQL skills.
- Ability to architect end-to-end data solutions from ingestion through analytics at scale.
Tech Stack
Categories
Data Engineering
About JPMorgan Chase
JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.