Senior Lead Software Engineer - Java & Databricks
JPMorgan Chase5 hours ago
Bengaluru, IndiaStaff+
Responsibilities
- Design and develop scalable, fault-tolerant microservices and externally consumable APIs supporting rule-based and ML-based detection pipelines.
- Design and implement supervision and reviewer workflows using state machines.
- Build, optimize, and operate large-scale streaming and batch data pipelines that ingest, index, and enrich communications content and alerts.
- Design Databricks data models for surveillance, search, retention, and lifecycle management at scale.
- Use Databricks Workflows, notebooks, and CI/CD pipelines to automate data processing and deployments, and troubleshoot jobs, clusters, and pipelines for performance.
- Drive adoption of Databricks best practices for data engineering, software engineering, observability, and platform operations.
- Promote approved AI-assisted engineering practices, automation, governance, validation standards, and reusable patterns across the software development lifecycle.
- Partner with product management and compliance subject-matter experts to improve alert accuracy, reliability, and detection quality.
- Provide technical leadership and mentor engineers.
Requirements
- Formal training or certification in software engineering concepts and at least 5 years of applied experience.
- Hands-on experience with system design, application development, testing, and operational stability.
- Experience delivering resilient, scalable, enterprise-grade cloud-native products, preferably with financial-industry compliance exposure.
- Production Databricks experience with Apache Spark, Delta Lake, and Databricks Workflows.
- Expert Java or Kotlin and Python programming experience, including building headless, externally consumable APIs.
- Experience building cloud-native microservices for streaming and batch architectures using Spark or Flink.
- Proficiency with AWS services including EC2, ECS, EKS, EMR, S3, and Glacier.
- Experience with semantic search, Kafka, PostgreSQL, and operationalizing ML/LLM models and pipelines in production.
- Experience with Prometheus, Grafana, OpenTelemetry, and CI/CD pipelines using ArgoCD, Helm, Terraform, Jenkins, and GitHub Actions.
- Experience with Test-Driven Development and products with defined SLI, SLO, and SLA targets.
- Strong communication, collaboration, ownership, mentoring, and senior-level technical leadership skills.
- Preferred experience includes Unity Catalog, large-scale cloud-native batch and streaming pipelines, distributed systems, data engineering practices, and production data and ML workloads.
Tech Stack
Apache FlinkApache KafkaApache SparkAWSDatabricksGitHub ActionsGrafanaHelmJavaJenkinsKotlinPostgreSQLPrometheusPythonTerraform
Categories
BackendData Engineering
About JPMorgan Chase
JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.