about 4 hours ago
Responsibilities
- Develop, deploy, and continuously improve distributed big-data pipelines for network analysis, ML, data ingestion, and data fusion.
- Improve Altana’s technology scalability to meet evolving customer requirements.
- Support platform reliability, costs, controls, customer security reviews, and accreditations.
- Act as the technical expert in client-facing meetings and connect government requirements with platform architecture.
- Collaborate with engineers, data scientists, product managers, customers, and internal partner organizations.
- Evaluate and recommend tools, technologies, and practices for data pipeline development, orchestration, and deployment.
- Own the end-to-end design and operation of data solutions and promote sustainable software development, self-healing workflows, data security, governance, and knowledge sharing.
Requirements
- At least 8 years of technical experience in data engineering or closely related roles.
- Extensive experience designing, developing, and maintaining complex data models from varied sources and schemas.
- A track record of leading the full lifecycle of data ingestion and standardization pipelines at scale.
- Experience deploying and integrating software across AWS, GCP, or Azure environments, including EC2, S3, IAM, and Dockerized microservices.
- Experience leading and mentoring engineers on complex data engineering projects.
- Eligibility and willingness to obtain UK Security Check (SC) clearance, or an active clearance.
- Strong written and verbal communication skills with experience working directly with external customers and stakeholders.
- Preferred experience managing data platforms, monitoring releases, costs, and infrastructure changes; deploying ML pipelines; working in trade compliance, supply chain management, or the public sector; and using AI tools to improve output quality and pace.
Tech Stack
Categories
Data Engineering
About Altana
Altana is the world’s first agentic network for global trade, connecting importers, suppliers, logistics providers, and customs agencies around a shared source of information to keep products trade-ready — from manufacture to classification to clearance. Customers like Boston Scientific, General Atomics, L.L.Bean, Maersk, U.S. Customs and Border Protection, and the UK Department of Business and Trade use Altana to design optimal product lines, protect national security, and promote economic growth through collaboration.