Senior Apache NiFi/Data Integration Engineer
Red Arch Solutions1 day ago
Reston, VA, USASenior
Base Salary
$185k - $215k/yr
Responsibilities
- Design, develop, test, deploy, maintain, and optimize complex Apache NiFi data flows for enterprise data onboarding and integration.
- Build scalable, fault-tolerant ingestion pipelines and reusable flow frameworks for structured, semi-structured, and unstructured data.
- Develop custom Java-based NiFi processors, controller services, reporting tasks, APIs, and shared processor libraries.
- Integrate enterprise systems using REST APIs, SOAP services, JDBC/ODBC, message queues, Kafka, file transfers, and cloud storage.
- Implement metadata collection, tagging, enrichment, schema validation, data quality, cataloging, governance, and stewardship workflows.
- Implement secure data movement aligned with Zero Trust, including authentication, authorization, encryption, auditing, ABAC, PKI, TLS, and identity and access management.
- Troubleshoot complex data movement and transformation issues and optimize throughput, latency, resource utilization, and clustered flow performance.
- Collaborate with data stewards, architects, cybersecurity teams, system owners, and mission stakeholders to onboard data sources and meet enterprise standards.
Requirements
- 12+ years of data integration, ETL, or enterprise middleware experience.
- 8+ years of hands-on Apache NiFi development experience.
- 12+ years of experience working with users to define database use, data analytics, and data user experience.
- Demonstrated expertise in Apache NiFi flow design, process groups, remote process groups, Site-to-Site communications, controller services, parameter contexts, flow versioning, NiFi Registry, clustered deployments, provenance tracking, back-pressure management, performance tuning, and secure flow design.
- Strong experience with Java, Spring Framework, JSON, XML, Avro, Parquet, REST APIs, SQL, PostgreSQL, Elasticsearch, Kafka, Git, Docker, Kubernetes, and Linux.
- Understanding of Zero Trust architecture, data-centric security, PKI, TLS, identity and access management, data governance, metadata management, and enterprise architecture principles.
- Active TS/SCI clearance required.
- Bachelor's degree in Computer Science, Engineering, Information Systems, or a related technical discipline is desired.
- Experience with intelligence community customers, data catalog platforms, metadata repositories, ontology, taxonomy, semantic tagging, Cloudera DataFlow, Hortonworks DataFlow, automated onboarding workflows, and regulated or classified environments is desired.
Benefits
- Salary range is $185-215K.
- 100% paid employee healthcare premiums and CareFirst Advantage benefits.
- HaloScripts concierge prescription medication service.
- Generous PTO and 11 paid federal holidays.
- 401(k) contribution of 10%, including a 6% match vested day one and up to 4% profit sharing.
- Annualized bonus compensation and spot bonuses.
- Tuition reimbursement, a 529 college savings plan, and a college loan payback program.
- Generous referral bonuses.
Tech Stack
Categories
BackendData Engineering
About Red Arch Solutions
Red Arch Solutions is an IT and engineering services firm that builds software, cloud, cyber, data, and systems solutions for U.S. intelligence and national security customers. It operates as a government contractor, delivering mission systems integration, zero-trust architectures, and AI/ML-enabled analytics. Founded in 2004 and headquartered in Columbia, Maryland, the company is privately held and focuses on programs within the federal intelligence community.