Data Platform Engineer
Flow Traders2 days ago
Amsterdam, NetherlandsSenior
Responsibilities
- Own the performance, reliability, storage, processing, monitoring, and alerting of distributed data platforms under production market workloads.
- Build and maintain self-provisioned compute, scheduling, transformation, and ad-hoc data exploration capabilities as platform products.
- Make architectural decisions about data modeling, storage formats, processing patterns, latency, cost, consistency, and maintainability.
- Investigate data issues and pipeline failures, improve resource usage, and create operational tooling and runbooks.
- Develop data catalog, lineage, access-control, metadata-management, and configurable data-quality capabilities.
- Enable reliable data context for AI systems, including retrieval, semantic layers, and tool and agent interfaces.
- Use coding agents to design, write, test, and review code while owning the correctness of shipped work.
- Mentor engineers through code reviews, design discussions, and pairing, including responsible use of AI tools.
Requirements
- 8+ years building and operating multiple production data platforms across different domains.
- Strong fundamentals in storage layouts, query execution, networking, and distributed-systems behavior.
- Ability to make and explain trade-offs among latency, cost, consistency, and simplicity.
- Strong data modeling, data warehousing, and analytical-engine experience, including technologies such as BigQuery or ClickHouse.
- Hands-on experience with distributed storage, messaging such as Kafka or Pub/Sub, batch and stream processing such as Apache Beam or Spark, and container orchestration such as Kubernetes.
- Strong programming skills in Python and/or Java, with high standards for testing and code quality.
- Solid cloud experience across storage, databases, and data processing, preferably using GCP and AWS.
- Practical experience with data governance, ownership, lineage, access control, metadata management, and data-quality frameworks.
- Understanding of how AI systems consume data through retrieval, semantic layers, and tool or agent interfaces.
- Ability to translate internal-user needs into clear platform capabilities and communicate across technical and non-technical teams.
- Interest in financial markets is preferred; prior trading experience is not required.
- Experience mentoring and helping other engineers grow.
Benefits
- Thorough onboarding, Flow Academy, and opportunities to attend domain-related conferences.
- Competitive salary, annual discretionary profit share, and comprehensive benefits.
- Daily catered lunch, coffee, a stocked kitchen, and snack bar.
- In-house bar and lounge with arcade games, table tennis, billiards, and game consoles.
- In-house gym and sessions with a nutritionist or personal trainer.
- Bi-weekly massages, an annual company trip, and other company events.
- Global rotation opportunities across offices worldwide.
- Collaborative, non-hierarchical culture with substantial ownership and access to current technology.
Tech Stack
Apache BeamApache KafkaApache SparkAWSClickHouseGoogle BigQueryGoogle Cloud PlatformJavaKubernetesPython
Categories
Data Engineering
About Flow Traders
Flow Traders builds electronic trading technology and acts as a principal liquidity provider in exchange-traded products, derivatives, fixed income, and digital assets across global markets. Its revenues come from market making and proprietary trading, using in-house software to quote and manage risk on- and off-exchange for institutional counterparties. Founded in 2004 and headquartered in Amsterdam, Flow Traders is publicly listed on Euronext Amsterdam and operates across multiple financial centers.