Data Engineer
Cantor Fitzgerald / BGC Partners3 months ago
London, United KingdomMid Level
Responsibilities
- Build and maintain market, economic, research, news, internal, and Fenics/BGC data pipelines.
- Design and implement scalable bronze/silver/gold data architecture for AI and quantitative models.
- Establish and monitor data quality gates and transform messy data into structured, model-ready datasets.
- Develop and manage instrument, ticker, country, client, source, and theme metadata systems.
- Create APIs and tables integrating data with agent tools, dashboards, and quant models.
- Implement data lineage tracking, user entitlements, and permissions management systems.
- Monitor and optimize pipeline performance and efficiency.
- Collaborate with data scientists and analysts to understand data needs and provide model-ready datasets.
- Apply current best practices for time-series and complex-data analysis to the data platform.
- Ensure data security and privacy compliance with applicable standards and regulations.
Requirements
- Strong proficiency in Python and SQL.
- Experience with production-level ETL/ELT processes.
- In-depth knowledge of cloud data stack technologies such as Azure, Databricks, Delta Lake, or Snowflake.
- Experience with time-series data, complex data structures, data quality, and monitoring.
- Ability to clean and transform messy data while maintaining data integrity.
- Familiarity with ticker-level data processing; experience with kdb+ or similar systems is advantageous.
- Strong problem-solving, analytical, communication, collaboration, and attention-to-detail skills.
- A proactive, self-motivated approach and passion for data engineering and continuous improvement.
- A bachelor's degree in Computer Science, Engineering, or a related field is preferred.
- At least 2 years of relevant experience in data engineering or a similar role.
About Cantor Fitzgerald / BGC Partners
Cantor Fitzgerald is a global financial services firm that brokers and trades fixed income and equities, underwrites and advises via its investment bank, and provides prime brokerage, asset management, and commercial real estate financing to institutions, corporations, and governments. Founded in 1945 and headquartered in New York, it operates worldwide and is affiliated with BGC Partners (NASDAQ: BGC), which runs interdealer brokerage and related financial technology businesses.