Lead Software Engineer- Data Engineer/Pyspark/Databricks
JPMorgan Chase7 hours ago
Responsibilities
- Develop secure, high-quality production code for data-intensive applications and platforms.
- Review code and mentor other engineers.
- Create durable, reusable software frameworks and patterns used across teams and functions.
- Drive adoption of advanced technical methods and software development practices.
- Advise cross-functional teams on technology within the role’s domain.
- Lead team adoption of approved AI-assisted engineering practices, including code review, refactoring, test acceleration, and incident analysis.
- Establish validation standards for AI outputs, including secure coding, peer review, and automated testing.
- Apply software development lifecycle tools and enterprise-authorized AI-assisted automation capabilities at scale.
Requirements
- Hands-on experience delivering system design, application development, testing, and operational stability at enterprise scale.
- Expertise in one or more programming languages, particularly Python and/or Java.
- Advanced knowledge of software application development and technical processes, with depth in areas such as cloud, AI/ML, or data engineering.
- Experience leading the effective use of approved AI-assisted software development tools and validating outputs for correctness, performance, and security.
- Understanding of responsible AI use in engineering workflows, data sensitivity, secure input and output handling, resiliency, and security expectations.
- Experience coaching engineers on safe and compliant AI-assisted delivery practices.
- Experience with large-scale data processing, microservices, API design, Kafka, Redis, MemCached, observability tools, and orchestration frameworks.
- Advanced knowledge of relational and NoSQL databases, vector stores, data lake architectures, and data governance.
- Practical cloud-native experience with AWS, Azure, or GCP.
- Ability to communicate effectively with senior leaders and executives.
- Preferred experience with Databricks or Snowflake, Spark/PySpark, big data processing technologies, Apache Iceberg, catalog services, LLM orchestration frameworks, and model-serving infrastructure or managed endpoints.
Benefits
- Competitive total rewards package with base salary determined by role, experience, skill set, and location.
- Eligible roles may receive commission-based pay and/or discretionary incentive compensation in cash or forfeitable equity.
- Comprehensive health care coverage.
- On-site health and wellness centers.
- Retirement savings plan.
- Backup childcare.
- Tuition reimbursement.
- Mental health support and financial coaching.
- Additional compensation and benefits details are provided during the hiring process.
Tech Stack
Apache AirflowApache KafkaApache SparkAWSAzureDatabricksGoogle Cloud PlatformGrafanaJavaPythonRedisSnowflakeSplunk
Categories
Data Engineering
About JPMorgan Chase
JPMorgan Chase provides consumer and commercial banking, payments, credit card, wealth management, and corporate and investment banking services to individuals, businesses, institutions, and governments. The public company (NYSE: JPM) earns revenue from interest, fees, trading, and asset management across operations in more than 100 markets. Headquartered in New York City with roots dating to 1799, it serves retail customers and prominent corporate and government clients through brands including Chase and J.P. Morgan.