Staff Data Engineer
Cantor Fitzgerald / BGC Partners5 days ago
Base Salary
$190k - $225k/yr
Responsibilities
- Own technical architecture for complex, cross-team data initiatives across ingestion, transformation, storage, and serving layers.
- Design, build, and maintain scalable data pipelines and distributed cloud data platforms.
- Lead enterprise Master Data Management, including golden records, entity resolution, data domains, reference data, hierarchies, and stewardship.
- Architect and integrate agentic AI, LLM-driven workflows, autonomous agents, RAG pipelines, and AI copilots into data platforms.
- Build data foundations for machine learning and AI, including feature stores, vector stores, embeddings, and ML/LLMOps pipelines.
- Design backend data services and REST/GraphQL APIs and expose curated datasets to applications, analytics, and BI consumers.
- Establish standards and frameworks for data quality, modeling, testing, observability, deployment, governance, lineage, and cataloging.
- Lead technical design reviews, provide architectural guidance, resolve systemic performance and scalability issues, and mentor engineers across multiple teams.
- Partner with leadership on scalable data roadmaps and evaluate emerging technologies in agentic AI, MDM, and modern data platforms.
Requirements
- Bachelor's degree in Computer Science, Engineering, MIS, or a related field is preferred.
- 12+ years of experience in data engineering or software engineering, including architecting data platforms and pipelines at scale.
- Expert SQL skills and strong Python proficiency; Scala or Java experience is a plus.
- Deep experience with cloud data platforms such as Databricks, Snowflake, Synapse, BigQuery, and Redshift, plus cloud-native architecture patterns.
- Strong understanding of distributed systems, dimensional/data vault/lakehouse modeling, ETL/ELT architecture, relational and NoSQL data stores, and Delta, Iceberg, or Parquet formats.
- Hands-on experience implementing MDM solutions involving entity resolution, match/merge, golden records, and reference or hierarchy management.
- Experience building or integrating agentic AI systems, LLM-powered applications, RAG pipelines, or orchestration frameworks such as LangChain, AutoGen, Semantic Kernel, or MCP.
- Experience building backend data services and APIs using REST or GraphQL and working across the full stack.
- Understanding of CI/CD, infrastructure as code, DevOps/DataOps, event-driven architectures, streaming, data governance, lineage, and cataloging.
- Experience with tools such as Unity Catalog, Microsoft Purview, Collibra, Alation, Kafka, Event Hubs, Kinesis, Flink, Spark Structured Streaming, Docker, Kubernetes, Airflow, Dagster, or dbt is preferred.
- Experience with multi-agent systems, tool-calling architectures, ML/AI data layers, feature stores, vector databases, embeddings, and ML/LLMOps is preferred.
- Prior experience in commercial real estate, fintech, or operations/transaction systems and evidence of technical thought leadership are preferred.
- Demonstrated ability to lead large-scale initiatives, mentor engineers, and influence technical direction without direct reporting authority.
Benefits
- Flexible working hours and hybrid work options.
- Comprehensive health, dental, and vision insurance.
- Competitive compensation, discretionary bonuses, and potential short- and long-term incentives including deferred cash or equity.
- Access to world-class learning resources, mentorship, and engineering, data, and AI resources.
- Collaborative environment focused on ownership, innovation, and technical excellence.
Tech Stack
Amazon RedshiftApache AirflowApache FlinkApache KafkaAWSAzureDatabricksdbtDockerGoogle BigQueryGoogle Cloud PlatformGraphQLInformaticaJavaKubernetesPythonScalaSnowflakeSQL
Categories
AI ApplicationsData Engineering
About Cantor Fitzgerald / BGC Partners
Cantor Fitzgerald is a global financial services firm that brokers and trades fixed income and equities, underwrites and advises via its investment bank, and provides prime brokerage, asset management, and commercial real estate financing to institutions, corporations, and governments. Founded in 1945 and headquartered in New York, it operates worldwide and is affiliated with BGC Partners (NASDAQ: BGC), which runs interdealer brokerage and related financial technology businesses.