1000000882.DATA ENGINEER II.INFO TECH - OPERATIONS
Dallas County1 month ago
Dallas, TX, USAMid Level
Responsibilities
- Design, develop, maintain, monitor, and troubleshoot scalable data pipelines and workflows across structured and semi-structured data sources.
- Write reusable SQL queries, scripts, and jobs for data ingestion, transformation, validation, and delivery.
- Integrate internal and external sources with enterprise data platforms, data lakes, and warehouses.
- Perform data profiling, cleansing, standardization, modeling, quality validation, and performance optimization.
- Document pipeline architecture, business rules, data logic, data sources, transformations, metadata, and lineage.
- Translate business and analytics needs into technical data specifications, pipeline designs, data models, and transformation logic.
- Support dashboards, reports, self-service analytics, data access controls, retention policies, and dataset delivery.
- Collaborate with analysts, data scientists, application developers, database administrators, DevOps and infrastructure teams, cybersecurity teams, QA teams, and business stakeholders.
- Contribute to ETL/ELT, storage, data delivery, testing, automation, version control, reproducibility, and solution architecture decisions.
- Perform root cause analysis, identify preventive actions, communicate trade-offs, and address pipeline or data inconsistencies.
- Assist with initiative scoping, estimation, deployment coordination, requirement gathering, stakeholder training, audits, and compliance documentation.
- Mentor junior data engineers or interns and contribute to internal documentation, playbooks, knowledge-sharing sessions, and communities of practice.
Requirements
- Bachelor’s degree in Computer Science, Information Systems, Data Analytics, or a related job-related field, or equivalent education and experience.
- Four years of job-related experience in data engineering, data analytics, or AI/ML data processing.
- Skill in SQL, Python, data integration tools such as SSIS, ADF, dbt, or Airflow, and/or Scala for data transformation.
- Knowledge of Azure, AWS, or GCP and data storage technologies such as SQL Server, Snowflake, or Parquet.
- Knowledge of Git, CI/CD pipelines, data catalogs, business intelligence tools, DevOps, and containerized applications including Docker and Kubernetes.
- Knowledge of data privacy and compliance regulations including HIPAA, GDPR, and CJIS.
- Knowledge of big data frameworks including Hadoop, Spark, and Databricks.
- Skill in streaming data technologies including Kafka, Kinesis, and Pub/Sub.
- Knowledge of data warehousing, data lakes, and data modeling best practices.
- Ability to analyze and solve problems, communicate and collaborate effectively, work independently, and mentor junior team members.
- Valid Texas Driver’s License, good driving record, and submission of a 10-year driving history.
- Ability to pass and maintain eligibility for required national fingerprint-based records checks for access to criminal justice databases.
Benefits
- Occasional travel to County sites and industry conferences is required.
- The role supports professional certification development, including Azure Data Engineer, AWS Data Analytics, dbt, Snowflake, and Databricks certifications.
Tech Stack
Apache AirflowApache HadoopApache KafkaApache SparkAWSAzureDatabricksdbtDockerGitGoogle Cloud PlatformKubernetesMicrosoft SQL ServerPythonScalaSnowflakeSQL
Categories
Data Engineering
About Dallas County
Dallas County is the county government for the Dallas, Texas area, delivering public services to more than two million residents across 30 municipalities. Its departments run public and mental health programs, courts and juvenile justice, property recording, and the issuance of marriage, vehicle, and other licenses, funded by county tax revenues and fees. Founded in 1846 and headquartered in Dallas, it is the second most populous county in Texas.