Core Data Engineer
Flow Traders20 days ago
Amsterdam, NetherlandsSenior
Responsibilities
- Translate underspecified research questions into aligned, adjusted, point-in-time-correct, documented, and reproducible datasets with quants.
- Develop and own the end-to-end lifecycle of core data products, including pipelines, quality checks, operational fixes, and automation of manual processing.
- Design data quality checks and alerts that identify issues affecting trading strategies while minimizing noisy signals.
- Build shared foundations for reference data, instrument identifiers, corporate actions, and vendor feeds.
- Support critical data pipelines across multiple regions and continuously operating digital asset markets.
- Collaborate with technical and non-technical stakeholders to improve in-house systems, data workflows, and data usage.
Requirements
- Over five years of experience working in data engineering.
- Experience in analytics or data engineering, ideally within a startup or scale-up experiencing growth.
- Strong data modeling and data quality practices, including tests, contracts, lineage, and production observability.
- Strong proficiency in Python and ideally familiarity with another statically typed language.
- Working proficiency with SQL, relational databases, and version control systems.
- Demonstrated ability to work with large datasets and familiarity with big data solutions.
- Experience owning systems in production rather than only building them.
- Ability to work directly with data users and balance stakeholder requirements with data quality, consistency, and broad applicability.
- Strong interpersonal and communication skills for collaboration with technical and non-technical stakeholders.
- Preferred experience with financial data such as prices, market data, transactions, and instruments.
- Preferred familiarity with point-in-time data, look-ahead bias, and survivorship bias.
- Preferred experience with a modern cloud data stack, including Spark or Databricks, dbt, a cloud warehouse, and orchestration.
- Airflow, Kafka, and GCP experience, especially GKE, Dataproc, and BigQuery, are strongly preferred.
- Preferred experience with Polars, Pandas, Spark, Apache Beam, or Apache NiFi.
- Experience at a trading firm, systematic fund, brokerage, crypto exchange, or market data company is preferred.
- On-call or incident response experience is preferred.
Benefits
- Flow Academy, ongoing learning opportunities, and access to domain-related conferences.
- Daily catered lunch, coffee, a stocked kitchen, and snack bar.
- In-house bar and lounge with arcade games, table tennis, billiards, and game consoles.
- Company boat.
- In-house gym and sessions with a nutritionist or personal trainer.
- Bi-weekly massages.
- Annual company trip and events throughout the year.
- Global rotations across offices worldwide.
- Collaborative, non-hierarchical culture with onboarding, ownership, and comprehensive benefits.
Tech Stack
Apache AirflowApache BeamApache KafkaApache SparkDatabricksdbtGoogle BigQueryGoogle Cloud PlatformPandasPythonSQL
Categories
Data Engineering
About Flow Traders
Flow Traders builds electronic trading technology and acts as a principal liquidity provider in exchange-traded products, derivatives, fixed income, and digital assets across global markets. Its revenues come from market making and proprietary trading, using in-house software to quote and manage risk on- and off-exchange for institutional counterparties. Founded in 2004 and headquartered in Amsterdam, Flow Traders is publicly listed on Euronext Amsterdam and operates across multiple financial centers.