4 days ago
Responsibilities
- Architect and optimize scalable, reliable data solutions on Databricks.
- Develop and maintain ETL pipelines using advanced SQL, Python, and Databricks capabilities.
- Design and implement data warehouses, data models, and schemas for analytics and business intelligence.
- Develop, test, and deploy complex PL/SQL and T-SQL stored procedures for data transformations and integrations.
- Lead requirements gathering and solution architecture with cross-functional teams.
- Monitor and troubleshoot data workflows while optimizing performance, accuracy, integrity, and availability.
- Enforce data governance, security, and compliance practices in Databricks environments.
- Document technical designs, engineering processes, and operational procedures.
Requirements
- At least 5 years of experience in data engineering, including 2 or more years working with Databricks and modern data platforms.
- Expertise with the Databricks platform and ecosystem.
- Advanced ETL pipeline development and SQL, including query optimization and complex joins.
- Python programming experience for data engineering.
- Experience implementing data warehouses and data models.
- PL/SQL and T-SQL experience for stored procedure development.
- Experience with modern data platform architectures.
- Preferred experience integrating Databricks with Azure or AWS.
- Preferred proficiency with Apache Spark and distributed data processing.
- Preferred experience with CI/CD automation, data quality frameworks, and real-time data streaming and processing.
- Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related discipline is desired.
- Databricks Data Engineer Associate certification or higher is desired.
- Microsoft Certified: Azure Data Engineer Associate or equivalent SQL/Python certification is desired.
Tech Stack
Categories
Data Engineering
About Brillio
Brillio is a privately held digital engineering and enterprise AI services firm that helps Fortune 1000 companies modernize products, data, and infrastructure. It combines consulting and managed services with an accelerator platform (ADAM) across cloud, AI, data engineering, customer experience, and infrastructure workstreams. Founded in 2014 and headquartered in Dallas, it operates delivery centers across North America, Europe, and Asia, with focus areas that include healthcare and life sciences.
