1000000881.DATA ENGINEER II.INFO TECH - OPERATIONS
Dallas County1 month ago
Dallas, TX, USAMid Level
Responsibilities
- Design, develop, maintain, and optimize scalable data pipelines and workflows.
- Write SQL, Python, Scala, and related scripts or jobs for data ingestion, transformation, and delivery.
- Integrate internal and external sources with enterprise platforms, data lakes, and warehouses.
- Perform data profiling, cleansing, standardization, validation, testing, and root-cause analysis.
- Monitor pipeline health, troubleshoot failures, and build reliability, error-handling, and performance improvements.
- Develop data models, flow diagrams, transformation logic, metadata, lineage, and technical documentation.
- Support dashboards, reports, self-service analytics, and stakeholder dataset delivery.
- Implement data access controls, retention policies, governance, privacy, compliance, and secure handling practices.
- Collaborate with infrastructure, DevOps, QA, cybersecurity, BI, application, database, and business teams.
- Participate in Agile planning, design reviews, backlog grooming, standups, retrospectives, sprint demos, and technical estimation.
- Coordinate data updates and multi-team initiatives involving shared pipelines or platforms.
- Mentor junior data engineers and interns and contribute to knowledge sharing, playbooks, and best practices.
Requirements
- Bachelor’s degree in Computer Science, Information Systems, Data Analytics, or a related field, or equivalent education and experience.
- Four years of job-related experience in data engineering, data analytics, or AI/ML data processing.
- Skill in SQL, Python, data integration tools such as SSIS, ADF, dbt, and Airflow, and/or Scala.
- Knowledge of Azure, AWS, or GCP and storage technologies such as SQL Server, Snowflake, and Parquet.
- Knowledge of Git, CI/CD pipelines, data catalogs, business intelligence tools, DevOps, Docker, and Kubernetes.
- Knowledge of data privacy and compliance regulations including HIPAA, GDPR, and CJIS.
- Knowledge of Hadoop, Spark, Databricks, Kafka, Kinesis, Pub/Sub, data warehousing, data lakes, and data modeling.
- Preferred certifications include Microsoft Certified: Azure Data Engineer Associate, AWS Certified Data Analytics – Specialty, and Snowflake or Databricks certification.
- Valid Texas Driver’s License, good driving record, and ability to provide a 10-year driving history.
- Ability to pass and maintain eligibility for required national fingerprint-based records checks for access to criminal justice databases.
- Strong problem-solving, communication, collaboration, documentation, independent-work, mentoring, and data-quality skills.
Benefits
- Occasional travel to County sites and industry conferences is required.
- The role is performed in a fast-paced, evolving technology environment.
- The position may require compliance with County driving-record, fingerprinting, criminal justice information, privacy, and audit requirements.
Tech Stack
Apache AirflowApache HadoopApache KafkaApache SparkAWSAzureDatabricksdbtDockerGitGoogle Cloud PlatformKubernetesMicrosoft SQL ServerPythonScalaSnowflakeSQL
Categories
Data Engineering
About Dallas County
Dallas County is the county government for the Dallas, Texas area, delivering public services to more than two million residents across 30 municipalities. Its departments run public and mental health programs, courts and juvenile justice, property recording, and the issuance of marriage, vehicle, and other licenses, funded by county tax revenues and fees. Founded in 1846 and headquartered in Dallas, it is the second most populous county in Texas.