Data Platform Engineer – Inventory & Observability
Qube Research & Technologies11 hours ago
London, United KingdomSenior
Responsibilities
- Design and build maintainable, performant data models for infrastructure and operational data.
- Integrate inventory, configuration, security, and observability data into a coherent queryable view.
- Automate data processing, validation, and delivery across scalable ETL/ELT pipelines.
- Build tooling to detect and resolve data-quality, freshness, performance, and reliability issues.
- Establish data provenance, lineage, ownership, and source-of-truth relationships across conflicting or incomplete sources.
- Collaborate with infrastructure, security, engineering, and observability teams to onboard sources and improve platform accuracy.
- Own systems end to end and adapt them as scale, requirements, and underlying technologies change.
Requirements
- Experience building and operating production-grade data platforms, analytical data models, or large-scale data-processing applications.
- Strong SQL and dimensional or analytical data modeling experience.
- Strong Python software engineering experience, including maintainable tested production applications and scalable ETL/ELT pipelines.
- Experience operating business-critical pipelines and diagnosing production data, performance, and reliability issues.
- Working understanding of infrastructure and observability concepts.
- Familiarity with knowledge graphs, ontologies, and taxonomies for heterogeneous operational data.
- Preferred experience with SQL-based analytical platforms, dbt, object storage, data catalogues, infrastructure inventory or CMDB data, metrics, logs, vulnerability data, observability tooling, Superset, Linux, containers, GitLab CI/CD, AWS services, and cloud SDKs.
- Background in data science, statistics, or applied machine learning for incomplete, noisy, or inconsistent data is preferred.
Benefits
- QRT offers initiatives and programs intended to support a healthy work-life balance.
- QRT is an equal opportunity employer and emphasizes an open, respectful, and diverse workplace.
About Qube Research & Technologies
Qube Research & Technologies is a global quantitative and systematic investment manager that develops and trades data-driven strategies across liquid asset classes for institutional investors. The firm manages client capital and proprietary funds, earning management and performance fees. Founded in 2018 and headquartered in London, it operates with offices in 16 locations worldwide.