Senior Data Engineer
Qube Research & Technologies2 months ago
Amsterdam, NetherlandsSenior
Responsibilities
- Design, build, and operate high-throughput distributed data systems for quantitative research and production trading workflows.
- Develop production-grade Python services and pipelines to acquire, process, validate, and distribute market and reference data.
- Build systems for large-scale historical processing and time-critical overnight pipelines.
- Design scalable architectures across QRT’s on-premises compute infrastructure and AWS.
- Build observability and operational tooling for data freshness, completeness, quality, and pipeline health.
- Collaborate with quantitative researchers, traders, software engineers, and infrastructure teams to onboard datasets and improve research productivity.
- Own systems end-to-end from architecture and implementation through deployment, production operation, and incident resolution.
Requirements
- 5+ years of experience building and operating production-grade data platforms, distributed systems, or large-scale data-processing applications.
- Strong Python software engineering experience developing maintainable, tested, and performance-conscious production applications.
- Strong understanding of partitioning, parallelism, concurrency, fault tolerance, idempotency, and failure recovery.
- Experience designing systems that process large data volumes under demanding throughput or completion-time requirements.
- Hands-on experience with workflow orchestration technologies such as Apache Airflow.
- Experience with AWS services including S3, EC2, AWS Batch, IAM, CloudWatch, and cloud SDKs.
- Experience operating business-critical pipelines and diagnosing data, performance, and reliability issues in production.
- Ability to solve problems and collaborate across research, trading, engineering, and infrastructure teams.
- Preferred experience with market-data platforms, financial data systems, non-equity asset classes, time-sensitive overnight processing, Apache Parquet, Apache Arrow, Spark, Ray, Dask, Docker, Kubernetes, Terraform, CloudFormation, C++, high-performance computing, or hybrid cloud environments.
Benefits
- QRT offers initiatives and programs intended to support employee work-life balance.
- QRT is an equal opportunity employer and emphasizes an open, respectful, and diverse workplace.
Tech Stack
Categories
Data Engineering
About Qube Research & Technologies
Qube Research & Technologies is a global quantitative and systematic investment manager that develops and trades data-driven strategies across liquid asset classes for institutional investors. The firm manages client capital and proprietary funds, earning management and performance fees. Founded in 2018 and headquartered in London, it operates with offices in 16 locations worldwide.