1000000567.DATA ENGINEER LEAD.INFO TECH SERVICES
Dallas County10 days ago
USA (city not specified)Staff+
Responsibilities
- Lead the County’s data engineering function and provide technical and strategic leadership for enterprise data systems.
- Design and oversee scalable data pipelines, APIs, workflows, storage, integrations, and distributed cloud and hybrid data platforms.
- Lead real-time, streaming, event-based, batch, and analytics data architectures.
- Ensure data systems meet availability, scalability, fault tolerance, performance, reliability, privacy, accessibility, and resilience requirements.
- Establish standards for pipeline development, testing, maintenance, data quality, validation, governance, lineage, and compliance.
- Implement monitoring, logging, metrics, alerting, observability, automated incident management, recovery, and version control.
- Drive automation of workflows, code deployment, onboarding of data sources, and recurring operational processes.
- Guide containerization, infrastructure-as-code, platform provisioning, cloud cost management, resource optimization, and scaling strategies.
- Lead architectural reviews, tool and vendor evaluations, modernization initiatives, and enterprise data roadmaps.
- Provide technical leadership, mentoring, onboarding, training, workload balancing, and communities of practice for data engineering staff.
- Coordinate with DevOps, cybersecurity, IT operations, application teams, data architects, product owners, analysts, executives, and governance teams.
- Represent the data engineering function in steering committees, RFPs, vendor assessments, audits, and cross-agency collaborations.
- Support data enablement for analytics, dashboards, AI platforms, business users, digital equity, and public-sector priorities.
- Perform other duties as assigned.
Requirements
- Education and experience equivalent to a bachelor’s degree from an accredited college or university in Computer Science, Software Engineering, or a related field.
- Master’s degree is preferred.
- At least six years of experience in data engineering, cloud platforms, or AI-driven data processing, including two years in a technical leadership role.
- Proficiency with SQL, Python, and/or Scala for data transformation.
- Experience with big data frameworks such as Hadoop, Spark, Databricks, or Flink.
- Experience with Azure Data Factory, AWS Glue, or Google Dataflow.
- Knowledge of real-time streaming technologies such as Kafka, Kinesis, or Pub/Sub.
- Knowledge of cloud-based and hybrid data architectures, cloud-native data architecture, DevOps, and enterprise analytics enablement.
- Knowledge of data governance, security, compliance frameworks, AI, machine learning, and data automation strategies.
- Ability to design and implement high-performance, scalable data solutions and translate strategic goals into engineering delivery.
- Ability to lead cross-functional technical teams and communicate with executive leadership and technical and business stakeholders.
- Preferred certifications include Azure Data Engineer, AWS Big Data, GCP Professional Data Engineer, Airflow, Snowflake, Databricks, or similar platforms.
- Valid Texas Driver’s License and good driving record required, including submission of a 10-year driving history.
- Must pass and maintain eligibility for required national fingerprint-based records checks when the position has access to criminal justice databases.
Benefits
- Occasional travel to County sites, vendor meetings, conferences, and industry events is required.
- The role supports public-sector innovation, data accessibility, continuous improvement, and cross-agency collaboration.
Tech Stack
Apache AirflowApache FlinkApache HadoopApache KafkaApache SparkAWSAzureDatabricksGoogle Cloud PlatformPythonScalaSnowflakeSQL
Categories
Data Engineering
About Dallas County
Dallas County is the county government for the Dallas, Texas area, delivering public services to more than two million residents across 30 municipalities. Its departments run public and mental health programs, courts and juvenile justice, property recording, and the issuance of marriage, vehicle, and other licenses, funded by county tax revenues and fees. Founded in 1846 and headquartered in Dallas, it is the second most populous county in Texas.