
Lead Specialty Data Engineer
Wells Fargo1 day ago
Base Salary
$159k - $254k/yr
Responsibilities
- Lead, design, develop, test, and implement Data Store pipelines using PySpark and Apache Spark.
- Implement complex business transformation logic for enterprise data pipelines.
- Design logical and physical SOR data models, Oracle schemas, partitioning, and indexing.
- Optimize SQL and Spark workloads for performance and reliability.
- Implement monitoring, reconciliation, and automated recovery for pipeline reliability.
- Troubleshoot coding, testing, production pipeline, Spark workload, and complex SQL issues.
- Lead risk management and compliance activities for the supported area.
- Mentor less experienced software engineers and collaborate with managers and cross-functional stakeholders.
- Partner effectively with production support and platform engineering teams.
Requirements
- At least 5 years of specialty software engineering experience, or equivalent demonstrated through work experience, training, military experience, or education.
- At least 5 years of hands-on experience with PySpark, Apache Spark, and SQL for enterprise data pipelines.
- At least 5 years of hands-on experience with Oracle and data modeling, including schema design, partitioning, indexing, and query optimization.
- Experience troubleshooting and tuning production data pipelines, Spark workloads, and complex SQL is desired.
- Experience designing, developing, and supporting scalable applications in financial services, banking, or highly regulated environments is desired.
- Understanding of cloud-based architectures and technologies, including AWS, Azure, or Google Cloud Platform, is desired.
- Experience with AI and generative AI technologies, intelligent automation, or AI-powered application capabilities is desired.
- Ability to collaborate across engineering, product, and business teams is desired.
Benefits
- Hybrid in-office work schedule in Irving, Texas, or Columbus, Ohio.
- Health benefits, 401(k) plan, paid time off, disability benefits, life insurance, critical illness insurance, and accident insurance.
- Parental leave and critical caregiving leave.
- Discounts and savings, commuter benefits, tuition reimbursement, dependent-child scholarships, and adoption reimbursement.
Categories
Data Engineering
About Wells Fargo
Wells Fargo & Company is a U.S.-based financial services firm providing consumer and commercial banking, mortgages, credit, and wealth/investment services to individuals, small businesses, and enterprises. It earns revenue from interest income and fees across retail banking, payments, lending, and capital markets. Founded in 1852 and headquartered in San Francisco, it is publicly traded on the NYSE (WFC) and operates nationally with offices in multiple countries.