Principal Data Engineer
Engineers and Constructors International Inc.1 month ago
Houston, TX, USAStaff+
Responsibilities
- Architect, design, and implement scalable Azure-based data lake solutions.
- Establish technology roadmaps involving Qlik Replicate, Databricks Delta Live Tables, and Unity Catalog.
- Lead data transformation pipeline development using Databricks Delta Live Tables and Structured Streaming.
- Optimize Databricks resources for high-volume processing while controlling costs.
- Oversee data governance, lineage, metadata management, compliance, security, and data quality.
- Monitor pipeline performance and resolve production issues.
- Collaborate with cross-functional teams and align technical work with business goals.
- Translate technical challenges into actionable insights for executive teams.
- Mentor and develop teams working with Azure, Databricks, and data streaming technologies.
- Facilitate knowledge transfer and lead end-to-end analytics projects.
- Design scalable ETL pipelines, data workflows, data migrations, and data platform integrations.
- Support the Freight Platform project by developing a platform to ingest, host, and distribute data across integration points.
Requirements
- Bachelor’s or master’s degree in IT or a related discipline.
- 15–17 years of experience in the IT industry delivering cost-effective cloud-based data analytics solutions.
- Proven experience building data lake architectures and optimizing performance in big data environments.
- Strong knowledge of Azure Data Factory, Azure Data Lake Storage, Databricks, Stream Analytics, Delta Live Tables, and Synapse Analytics.
- Advanced proficiency in SQL and programming languages such as Python, Scala, or Spark SQL.
- Experience designing scalable ETL pipelines and optimizing data workflows.
- Deep understanding of on-premises-to-cloud and cloud-to-cloud data migration.
- Proven ability to lead diverse teams and manage end-to-end analytics projects.
- Expertise in identifying risks and implementing mitigation strategies.
- Azure Data Engineering or Databricks certification is preferred.
- Familiarity with Hadoop, Kafka, Spark, Power BI, or Qlik Sense is preferred.
- Knowledge of AI/ML, NLP, and generative AI concepts is preferred.
- Familiarity with Agile and Kanban methodologies is preferred.
Benefits
- Houston, Texas-based contract role.
- Anticipated seven-month contract duration.
- Estimated start date of October 5, 2026.
- Applicants must be U.S. citizens or permanent U.S. residents.
- Application review uses AI-assisted tools with human oversight and GDPR-compliant data protection practices.
Tech Stack
Categories
Data Engineering
About Engineers and Constructors International Inc.
Engineers and Constructors International Inc. (ECI Group) is a multi-discipline engineering consultancy that provides process design, detailed engineering, procurement, and construction management (EPCm) for polymer, chemical, and industrial plants, plus technical staffing. It serves owners and operators across full plant lifecycles, from revamps to greenfield facilities. Founded in 1977 and headquartered in Baton Rouge, Louisiana, the privately held firm operates globally and covers instrument/control, electrical/power, mechanical/piping, civil/structural, and process engineering.