Senior Lead Software Engineer, Big Data & Cloud Engineering — Risk Central (London)
JPMorgan Chase7 hours ago
London, United KingdomStaff+
Responsibilities
- Lead end-to-end delivery of complex initiatives across ingestion, transformation, storage, and consumption layers.
- Design and build high-volume batch and streaming pipelines using distributed compute.
- Engineer data products and workflows spanning Databricks and Amazon Redshift.
- Develop data models, partitioning strategies, reusable frameworks, and performance and cost optimizations for large datasets.
- Define reconciliation, consistency, lineage, governance, controls, and workload-placement approaches across both warehouses.
- Build cloud-native solutions on AWS using services such as S3, EMR, Lambda, Kinesis, MSK, Glue, EventBridge, DynamoDB, Redshift, and EKS.
- Own production stability through monitoring, alerting, incident management, root-cause analysis, SLAs/SLOs, and preventative engineering.
- Lead technical initiatives across multiple teams, mentor engineers, and communicate progress, risks, dependencies, and trade-offs to senior stakeholders.
- Partner with product managers, quants, risk managers, traders, and controllers to translate business needs into scalable technical solutions.
Requirements
- Extensive professional software engineering experience delivering production systems at scale.
- Strong programming skills in Python and/or Java or Scala, with strong computer science fundamentals in data structures, algorithms, and object-oriented design.
- Hands-on experience with Spark or other distributed data processing and with batch or streaming data pipelines.
- Experience with Databricks, Amazon Redshift, or an equivalent enterprise data warehouse or lakehouse platform.
- Strong SQL skills and understanding of data modeling and analytics patterns.
- Practical experience with cloud engineering concepts including security, networking, IAM and access controls, encryption, and observability.
- Proven ability to troubleshoot production issues and drive operational improvements.
- Strong communication skills and experience working with globally distributed teams.
- Preferred experience in Markets technology, trade lifecycle concepts, financial risk measures, P&L explain, and products such as FX, rates, credit, equities, and derivatives.
- Preferred experience with Kafka, MSK, Kinesis, near-real-time analytics, governance, data quality, reconciliations, lineage, auditability, entitlements, Iceberg, Delta, Parquet, infrastructure-as-code, containerized workloads, and DevOps practices.
- Prior experience leading multi-team initiatives, mentoring, and cross-team coordination is preferred.
Tech Stack
Categories
BackendData Engineering
About JPMorgan Chase
JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.