Mid Level Data Engineer
Redhorse Corporation2 months ago
Arlington, VA, USAMid Level
Base Salary
$145k - $165k/yr
Responsibilities
- Ingest, configure, and transform structured, semi-structured, and unstructured datasets for mission partner and stakeholder needs.
- Build, automate, and maintain scalable ETL/ELT pipelines supporting rapid analytics delivery.
- Monitor data pipeline operations and environment health while implementing performance optimization and cost-reduction practices.
- Prototype new data capabilities, evaluate emerging technologies, and deploy end-to-end data solutions.
- Troubleshoot pipeline bottlenecks, optimize database structures, and implement secure data retrieval methods with cross-functional technical teams.
- Automate and maintain DoD Security Technical Implementation Guides across data systems.
Requirements
- U.S. citizenship and an active Department of War Top Secret security clearance with access to Sensitive Compartmented Information.
- Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related STEM field with 3+ years of data engineering experience, or a master’s degree with 2+ years of experience.
- Experience developing ETL/ELT pipelines and processing large-scale data with big data frameworks such as Apache Spark.
- Practical experience working in cloud environments such as AWS, Microsoft Azure, or MilCloud 2.0.
- Proficiency in data engineering programming and querying languages such as Python, SQL, or Scala.
- Familiarity with database architectures, data modeling, and automated configuration management.
- Familiarity with applying and maintaining DoD Security Technical Implementation Guides.
- Preferred experience with Databricks, Delta Lake, Lakehouse architecture, PySpark, Qlik, Advana, classified networks, multiple security domains, GitLab, Jira, Jenkins, and CI/CD or version control systems.
Tech Stack
Categories
Data Engineering
About Redhorse Corporation
Redhorse Corporation provides data analytics, AI, and digital transformation consulting to U.S. government agencies, especially in national security, infrastructure, and environmental programs. It delivers technology-agnostic solutions, systems integration, and data engineering to help the Department of Defense and civilian agencies improve decision-making and operations under professional services contracts. Founded in 2008 and headquartered in Arlington, Virginia, the company is privately held.