Principal Data Engineer
CG Infinity2 months ago
Dallas, TX, USA or Houston, TX, USAStaff+
Responsibilities
- Lead the architecture, design, and delivery of enterprise data engineering, data platform, and analytics solutions.
- Advise client technology, data, architecture, and business stakeholders and translate business objectives into technical strategies and roadmaps.
- Facilitate discovery sessions, requirements workshops, technical assessments, architecture reviews, and solution-design discussions.
- Design and implement batch, real-time, streaming, and event-driven data solutions.
- Build and review data pipelines, proof-of-concepts, data models, data APIs, semantic layers, and data products.
- Establish standards for code quality, testing, CI/CD, observability, metadata, lineage, documentation, security, and production support.
- Drive DataOps, infrastructure-as-code, automated testing, deployment, monitoring, and incident-management practices.
- Present technical recommendations, architecture options, delivery status, risks, and strategic roadmaps to technical and executive audiences.
- Mentor data engineers and lead cross-functional onshore/offshore delivery teams.
- Support project estimation, staffing, delivery planning, risk management, solution scoping, proposals, RFP responses, and statements of work.
- Evaluate emerging data, cloud, AI, governance, and analytics technologies for client value.
Requirements
- Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field; equivalent professional experience may be considered.
- 10+ years of progressive experience in data engineering, data warehousing, data integration, data architecture, or related technical disciplines.
- 3+ years in a technical leadership, lead engineer, solution architect, staff engineer, principal engineer, or consulting leadership capacity.
- Demonstrated experience architecting and delivering enterprise-scale data platforms and data integration solutions.
- Strong hands-on SQL expertise and proficiency in at least one modern programming language, preferably Python, Scala, Java, or C#.
- Experience with ETL/ELT, data pipelines, transformation frameworks, orchestration, workflow automation, cloud providers, and modern cloud data platforms.
- Knowledge of distributed data processing, batch and streaming solutions, dimensional modeling, data vault, normalized models, lakehouse architectures, data lakes, and data warehouses.
- Experience implementing data quality, validation, monitoring, lineage, metadata, governance, and security controls.
- Working knowledge of DevOps and DataOps, Git-based source control, CI/CD, automated testing, deployment automation, and infrastructure as code.
- Understanding of cloud security, identity and access management, encryption, secrets management, and role-based access controls.
- Ability to lead architecture discussions and make tradeoffs involving performance, scalability, reliability, maintainability, security, and cost.
- Excellent verbal, written, presentation, consulting, and client-facing delivery skills.
- Preferred experience includes AI and machine-learning data platforms, generative AI, retrieval-augmented generation, feature stores, vector databases, governance and observability tools, enterprise operational data domains, BI and semantic-layer technologies, containerization, cloud-native technologies, proposals, technical sales pursuits, and distributed delivery-team leadership.
- Preferred certifications include AWS, Azure, Google Cloud, Databricks, Snowflake, Microsoft Fabric, or other relevant data technologies.
Tech Stack
Amazon RedshiftApache AirflowApache FlinkApache HadoopApache KafkaApache SparkAWSAzureC#DatabricksdbtDockerGitGoogle BigQueryGoogle Cloud PlatformInformaticaJavaKubernetesPythonScalaSnowflakeSQLTerraform
Categories
Data Engineering
About CG Infinity
CG Infinity is an IT services and consulting firm that designs and implements enterprise software, cloud, and data solutions, including Salesforce and AWS-based contact center deployments. The privately held company, founded in 1998 and headquartered in Plano, Texas, provides custom development, systems integration, and IIoT capabilities for clients in industries such as energy and utilities and financial services.