4 months ago
Base Salary
$200k - $220k/yr
Responsibilities
- Architect and operate a 24x7 data platform with infrastructure-as-code deployments and cost controls.
- Build and evolve batch and streaming pipelines ingesting billions of market-data events each day.
- Design high-performance, cost-efficient lakehouse tables and expose curated datasets through robust, versioned APIs.
- Optimize workflows for aggressive SLAs while implementing observability and automated data-quality checks.
- Champion Git-driven infrastructure-as-code and CI/CD practices for data assets.
- Mentor junior engineers and uphold coding standards while collaborating with quants, traders, data scientists, and engineers.
Requirements
- At least 7 years of experience building production data platforms with Python and SQL.
- Deep expertise in big-data architecture, including partitioning, sharding, and columnar formats.
- Hands-on experience with SingleStore/MemSQL, Spark, Flink, EMR, Kafka, Kinesis, AWS, Terraform, and CloudFormation.
- Experience delivering data services for AI/ML workloads, feature pipelines, AI/ML feature stores, or RAG pipelines.
- Experience performance-tuning Postgres, SingleStore/MemSQL, or KDB for sub-second queries.
- Proficiency in API design, versioning, and OpenAPI/Swagger documentation.
- Preferred qualifications include market-data expertise, experience with Iceberg, Delta Lake, or Hudi on S3, real-time analytics experience, performance profiling skills, and open-source or technical-publication contributions.
Benefits
- Inclusive, collaborative culture with learning and educational offerings and opportunities to make an impact.
- Internal networks, external partnerships, and service initiatives supporting community and inclusion.
- The role may be eligible for performance bonuses and a competitive benefits package.
Tech Stack
Categories
Data Engineering
About Schonfeld
Schonfeld is a privately held, multi-manager hedge fund that allocates capital to internal and external portfolio managers across quantitative, fundamental equity, tactical trading, and discretionary macro/fixed-income strategies. The firm manages money for institutional and other sophisticated investors and supports teams with proprietary technology, infrastructure, and risk analytics. Founded in 1988 and headquartered in New York, it operates globally with an investing footprint spanning five continents.