
Macro Hive - Data Engineer
Cantor Fitzgerald / BGC Partners23 hours ago
London, United KingdomMid Level
Responsibilities
- Build and maintain market, economic, research, news, internal, and Fenics/BGC data pipelines.
- Design and implement scalable bronze/silver/gold data architecture for AI and quantitative models.
- Establish and monitor data quality gates and transform messy data into accurate, model-ready datasets.
- Develop and manage instrument, ticker, country, client, source, and theme metadata.
- Create APIs and tables integrating data with agent tools, dashboards, and quant models.
- Implement data lineage tracking, user entitlements, and permissions management systems.
- Monitor and optimize data pipelines for performance and efficiency.
- Collaborate with data scientists and analysts to understand data needs and provide model-ready datasets.
- Apply current best practices for time-series and complex-data analysis.
- Maintain data security and privacy compliance with applicable standards and regulations.
Requirements
- At least 2 years of relevant experience in data engineering or a similar role.
- Strong proficiency in Python and SQL.
- Experience with production-level ETL/ELT processes.
- In-depth knowledge of cloud data stack technologies such as Azure, Databricks, Delta Lake, or Snowflake.
- Experience with time-series data, complex data structures, data quality, and monitoring.
- Ability to clean and transform messy data into structured, model-ready datasets.
- Familiarity with ticker-level data processing; experience with kdb+ or similar systems is advantageous.
- Bachelor's degree in Computer Science, Engineering, or a related field preferred.
- Strong problem-solving, analytical, communication, collaboration, attention-to-detail, and continuous-improvement skills.
About Cantor Fitzgerald / BGC Partners
Cantor Fitzgerald is a global financial services firm that brokers and trades fixed income and equities, underwrites and advises via its investment bank, and provides prime brokerage, asset management, and commercial real estate financing to institutions, corporations, and governments. Founded in 1945 and headquartered in New York, it operates worldwide and is affiliated with BGC Partners (NASDAQ: BGC), which runs interdealer brokerage and related financial technology businesses.