Sr. Enterprise Data Engineer
Stanford Medicine5 months ago
Palo Alto, CA, USASenior
Responsibilities
- Develop data ingestion processes, pipelines, data stores, data marts, and curated data products for the SHC Enterprise Data Platform.
- Design and implement logical and physical data models and complex data movement solutions.
- Develop cloud data platform solutions using Databricks, PySpark, notebooks, SQL, GitHub, and automated deployment processes.
- Research, roadmap, maintain, and improve data modeling, development, DevOps, and operational tools and processes.
- Perform data analysis, development, testing, performance tuning, troubleshooting, and root-cause analysis for complex solutions.
- Support data governance activities including metadata, data quality, data stewardship, and resolution of data quality issues.
- Consult with and support other data engineers, analysts, clinicians, users, leaders, and cross-functional project groups.
- Lead design standards, peer reviews, analytics standards, best practices, and adoption or training activities.
- Manage complex activities, tasks, dependencies, timelines, scope, and delivery expectations across multiple departments.
Requirements
- Bachelor’s degree in information technology, information systems, business management, business analytics, business administration, or a directly related field from an accredited college or university.
- Seven or more years of experience in reporting, analytics, business intelligence, or healthcare technology, or three or more years of development experience in cloud data lake technologies.
- Advanced knowledge of relational database concepts, database design, data modeling, and multiple data domains.
- Ability to develop secure, highly automated production solutions on cloud data platforms such as Azure and Databricks.
- Expert knowledge of SQL and SHC’s standard development and design tools and general DevOps practices.
- Ability to work independently, complete complex projects, communicate with varied audiences, and present ideas to senior managers and industry groups.
- Strong verbal, written, interpersonal, collaboration, troubleshooting, project leadership, and technical consultation skills.