4 days ago
Responsibilities
- Design scalable, high-performance data solutions using Databricks and leading cloud data platforms.
- Develop, optimize, and maintain ETL pipelines with SQL, Python, and Databricks.
- Implement data models and data warehousing solutions for analytics, reporting, and business intelligence.
- Automate data workflows and improve system efficiency and processing times.
- Monitor, troubleshoot, and resolve performance bottlenecks in data pipelines and platform components.
- Ensure data quality, consistency, and security across data assets and platforms.
- Translate business requirements into technical data architecture solutions with cross-functional teams.
- Document architecture designs, data flows, and data engineering best practices.
Requirements
- At least 7 years of experience in data architecture and engineering, including substantial hands-on Databricks and modern data platform experience.
- Advanced proficiency with the Databricks platform and ecosystem.
- Expertise designing and developing ETL pipelines with SQL and Python.
- Expert-level SQL, including advanced query optimization, plus proficiency in Python for data engineering and automation.
- Comprehensive knowledge of data warehousing concepts, design patterns, and data modeling techniques.
- Hands-on experience with PL/SQL, T-SQL, and stored procedures for data transformation.
- Experience with performance tuning and troubleshooting in distributed data environments.
- Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a closely related discipline.
- Preferred experience with Azure Data Lake, AWS S3, Google BigQuery, Delta Lake, lakehouse architecture, data engineering CI/CD practices, Scala or Java, and data governance, cataloging, and lineage tools.
- Preferred Databricks Certified Data Engineer Associate or Professional certification, or cloud data platform certifications such as Microsoft Azure Data Engineer Associate, AWS Certified Data Analytics, or Google Professional Data Engineer.
About Brillio
Brillio is a privately held digital engineering and enterprise AI services firm that helps Fortune 1000 companies modernize products, data, and infrastructure. It combines consulting and managed services with an accelerator platform (ADAM) across cloud, AI, data engineering, customer experience, and infrastructure workstreams. Founded in 2014 and headquartered in Dallas, it operates delivery centers across North America, Europe, and Asia, with focus areas that include healthcare and life sciences.
