
Lead Data Engineer
Wells Fargo2 days ago
Charlotte, NC, USA or Irving, TX, USAStaff+
Responsibilities
- Design, build, and operate secure, scalable data platforms on Google Cloud using BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, and Composer.
- Create reusable ingestion, transformation, quality, orchestration, and serving frameworks for adoption by multiple product and domain teams.
- Develop batch and streaming data blueprints, configuration-driven pipelines, connectors, schema handling, error handling, and shared transformation libraries.
- Provide reusable orchestration capabilities through Cloud Composer or Cloud Workflows with DAG and template integration into development workflows.
- Implement data modeling and semantic layers, and enforce data quality, lineage, observability, security, and governance controls.
- Optimize GCP workload cost, performance, and reliability, including partitioning, clustering, storage classes, and autoscaling strategies.
- Partner with data engineering, analytics, and ML teams to onboard use cases onto platform services and frameworks.
- Document patterns and runbooks, lead enablement workshops, contribute to platform roadmaps, and evaluate GCP services and open-source components.
- Provide application development and production support during off-hours when needed.
Requirements
- At least 5 years of database engineering experience or equivalent demonstrated through work experience, training, military experience, or education.
- At least 5 years of data management experience in public cloud environments such as GCP, AWS, or Azure.
- At least 5 years of hands-on Python or Java experience plus Spark SQL for data pipelines, libraries, and automation tooling.
- At least 5 years of experience with orchestration tools such as Cloud Composer or Airflow and CI/CD workflows such as Cloud Build or Git-based workflows.
- Experience with logging and monitoring stacks, automated testing, data quality checks, and pipeline monitoring.
- Knowledge of cloud networking, security, IAM, reliability, and cost-management principles.
- Experience with BigQuery, Dataflow or Apache Beam, Dataproc, and Pub/Sub.
- Experience with Agile transformations, technology roadmaps, and distributed onshore and offshore teams.
- Ability to provide production support during off-hours.
Benefits
- Hybrid schedule with 3 days in the office and 2 days remote.
- This role is based in Charlotte, North Carolina, or Irving, Texas.
- Not eligible for visa sponsorship.
Tech Stack
Categories
Data Engineering
About Wells Fargo
Wells Fargo & Company is a U.S.-based financial services firm providing consumer and commercial banking, mortgages, credit, and wealth/investment services to individuals, small businesses, and enterprises. It earns revenue from interest income and fees across retail banking, payments, lending, and capital markets. Founded in 1852 and headquartered in San Francisco, it is publicly traded on the NYSE (WFC) and operates nationally with offices in multiple countries.