Senior Software Engineer-Python,spark,Iceberg,Hive
Wells FargoResponsibilities
- Lead moderately complex software engineering initiatives and deliverables within technical domains.
- Design, code, test, debug, document, upgrade, and deploy technology projects and programs.
- Design and implement modern enterprise data platforms, data warehouses, data lakes, and lakehouse architectures.
- Monitor, tune, troubleshoot, and optimize large-scale distributed systems, including memory, performance, partitioning, and query efficiency.
- Develop standardized patterns, frameworks, reusable components, automated code generation, and engineering best practices.
- Build RAG architectures, vector stores, and embedding pipelines and integrate data systems with enterprise AI platforms.
- Use LLMs to improve data quality, metadata extraction, and data-engineering automation.
- Review code, resolve technical challenges, lead projects, provide guidance to less experienced staff, and act as an escalation point.
- Collaborate across technical and functional teams in an Agile environment while supporting governance, security, compliance, lineage, privacy, and access-control requirements.
Requirements
- At least 4 years of software engineering experience or equivalent demonstrated through work experience, training, military experience, or education.
- Hands-on engineering experience with Python, Spark, Iceberg, Hive, Dremio or comparable virtualization, federation, or semantic-layer tools.
- Experience with at least one major cloud platform, including Azure or GCP.
- Experience with ETL tools such as Ab Initio, Informatica, or DataStage; Ab Initio is preferred.
- Experience with Oracle, Microsoft SQL Server, or Teradata databases.
- Experience with Autosys or Airflow orchestration; Airflow is preferred.
- Strong SQL development and query-tuning skills.
- Experience supporting and optimizing enterprise-scale data environments and distributed systems.
- Experience with modern data warehousing, data lakes, lakehouse architectures, cloud-native technologies, and open-table formats.
- Experience with GenAI, agentic AI, LLM adoption, RAG, vector stores, embedding pipelines, or enterprise AI platforms.
- Familiarity with data governance and security frameworks covering privacy, compliance, lineage, and access control.
- Strong communication and collaboration skills, with the ability to work in a fast-paced Agile environment.
Tech Stack
Categories
About Wells Fargo
Wells Fargo & Company (NYSE: WFC) is a diversified, community-based financial services company with approximately $1.9 trillion in assets. Wells Fargo’s vision is to satisfy our customers’ financial needs and help them succeed financially. Founded in 1852 and headquartered in San Francisco, Wells Fargo provides banking, investment and mortgage products and services, as well as consumer and commercial finance, through more than 7,300 locations, 12,000 ATMs, the internet (wellsfargo.com) and mobile banking, and has offices in over 40 countries and territories to support customers who conduct business in the global economy. With approximately 250,000 team members, Wells Fargo serves one in three households in the United States. Wells Fargo & Company was ranked No. 41 on Fortune’s 2022 rankings of America’s largest corporations. News, insights and perspectives from Wells Fargo are also available at Wells Fargo Stories. Relevant military experience is considered for veterans and transitioning service men and women. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other legally protected characteristic.© 2016 Wells Fargo Bank, N.A. All rights reserved. Member FDIC.