28 days ago
Cortlandt, NY, USASenior
Responsibilities
- Deliver continual data feeds and monitor data quality and ingestion health.
- Design, build, and maintain resilient real-time and near-real-time ingestion pipelines using Apache NiFi.
- Configure and monitor data flows across security domains using cross-domain guards and solutions.
- Parse, transform, validate, and route structured and unstructured Excel, CSV, JSON, and XML data.
- Use Grafana and Prometheus to visualize pipeline status, data quality, and historical trends.
- Collaborate with platform, software, and data engineers to improve ingestion reliability and performance.
- Develop scripts to monitor real-time feeds and alert on timeliness, volume, lineage, and distribution issues.
- Enforce encryption, authentication, authorization, and data-classification requirements across pipelines and cross-domain transfers.
- Document data flows, system configurations, and standard operating procedures.
Requirements
- A bachelor's degree in Computer Science, Mathematics, Electrical Engineering, Physics, Information Systems, Information Technology, or a related field.
- At least 3 years of experience in data engineering, data operations, or DevOps roles supporting production data pipelines.
- U.S. citizenship and an active TS/SCI clearance.
- Proficiency in Python, Bash, or similar scripting languages.
- Working knowledge of the Linux command line, particularly RedHat, and familiarity with Windows environments.
- Understanding of data pipelines, streaming architectures, ETL/ELT concepts, and data quality principles.
- Familiarity with parsing and transforming JSON, XML, CSV, and Excel data formats.
- Preferred experience with Kafka, JMS, Apache Flink, Spark Streaming, Grafana, Prometheus, Elasticsearch, Snowflake, cross-domain solutions, security and data-classification policies, Git, and government, defense, or intelligence-community environments.
Benefits
- The position is on-site in Honolulu, Hawaii.
Tech Stack
Apache FlinkApache KafkaApache SparkBashElasticsearchGitGrafanaLinuxPrometheusPythonSnowflakeWindows
Categories
Data Engineering
About SAIC
SAIC (Science Applications International Corporation) is a government technology integrator delivering systems engineering, enterprise IT, secure cloud, cybersecurity, C5ISR, and data analytics for U.S. defense, space, intelligence, and civilian agencies. It builds and sustains mission IT and digital engineering solutions under multi-year federal contracts and task orders. Founded in 1969, SAIC is headquartered in Reston, Virginia, and is a public company traded on the NYSE under the ticker SAIC.