Senior Databricks Engineer/Architect
Virtasant Inc.2 days ago
Remote, United StatesSenior
Responsibilities
- Design, develop, and maintain scalable, high-performance data pipelines.
- Architect and lead data migration strategies to the Databricks platform.
- Develop and optimize complex data transformations using PySpark.
- Build and enhance ETL/ELT processes for enterprise data initiatives.
- Ensure data quality, integrity, scalability, and performance across data platforms.
- Present technical solutions, migration roadmaps, and project progress to stakeholders.
- Bridge technical teams and business stakeholders to align data solutions with organizational objectives.
Requirements
- Senior-level experience as a Data Engineer or Data Architect specializing in scalable data pipelines, PySpark, and Databricks.
- Experience architecting and executing data migrations to Databricks and modernizing data platforms.
- Ability to build robust ETL/ELT workflows and optimize data transformations for quality, performance, and reliability.
- Ability to translate complex technical requirements into data solutions and present architecture strategies to business stakeholders and leadership.
Benefits
- 1099 contract engagement that is long-term and ongoing.
- Remote role within the United States.
Tech Stack
Databricks
Categories
Data Engineering
About Virtasant Inc.
Virtasant provides cloud and software engineering services to enterprises, focusing on cloud migration and modernization, cost optimization, and AI-enabled transformation. The privately held, fully remote company also develops Helias, a cloud cost optimization platform used to understand, govern, and reduce spend at scale. Founded in 2007 and headquartered in Austin, Texas, it serves global customers across AWS, Azure, and Google Cloud.