Data Engineer
Agile Defense19 days ago
Omaha, NE, USASenior
Responsibilities
- Design, build, and maintain scalable, reliable ETL/ELT data pipelines across data warehouses, data lakes, and other storage systems.
- Develop, deploy, and maintain low-latency real-time streaming solutions.
- Optimize and automate data workflows to handle increasing data volumes.
- Oversee data model and schema development for accurate, accessible, high-performance storage.
- Implement data validation, monitoring, and error-handling mechanisms to ensure data quality and integrity.
- Monitor and troubleshoot data-system performance bottlenecks and processing or access issues.
- Evaluate emerging data-engineering tools and methods to improve infrastructure.
- Mentor junior data engineers and promote data-engineering best practices.
Requirements
- Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or a related field, or equivalent relevant work experience substituted year-for-year.
- At least 5 years of experience in data engineering or software engineering, including complex data pipeline design and management.
- Strong understanding of data validation, model testing, and performance evaluation techniques.
- Experience with data visualization and storytelling using Tableau, Plotly, or Matplotlib.
- Excellent technical communication skills for explaining complex concepts to non-technical audiences.
- Top Secret/SCI clearance is required.
- Preferred qualifications include 4+ years of applied data science, machine learning engineering, or data pipeline development experience.
- Preferred qualifications include proficiency in Python, SQL, and distributed data frameworks such as Spark, Databricks, or PySpark.
- Preferred qualifications include experience developing machine learning models from training through deployment using scikit-learn, TensorFlow, XGBoost, or MLflow.
- Preferred qualifications include familiarity with MLOps, API development, and secure cloud environments such as AWS, Azure, or Palantir Foundry.
Benefits
- Onsite work in a SCIF in STRATCOM in Omaha, Nebraska.
- Employees are supported by a collaborative culture centered on Agile Defense’s 6Hs core values.
Tech Stack
Apache FlinkApache KafkaApache SparkAWSAzureDatabricksMatplotlibMLflowPythonscikit-learnSQLTensorFlowXGBoost
Categories
Data Engineering
About Agile Defense
Agile Defense provides IT services and cybersecurity solutions for U.S. defense and federal civilian agencies, including digital transformation, systems integration, C4ISR support, data analytics, and cloud. Headquartered in McLean, Virginia, the privately held company is owned by Enlightenment Capital and operates across North America, Europe, Asia, and the Middle East. Its work centers on securing sensitive missions and modernizing government technology environments through managed services and mission-focused engineering.