3 days ago
Base Salary
$200k - $275k/yr
Responsibilities
- Uphold the vision, architecture, and evolution of DRW’s data platform.
- Translate business and data strategy into engineering products, platform capabilities, and sequenced technical roadmaps.
- Design, build, and operate managed services for data storage, distributed query execution, batch and streaming processing, and workload orchestration.
- Lead delivery across team boundaries, turning ambiguous requirements into practical designs and measurable outcomes.
- Drive architecture reviews and technology decisions while documenting trade-offs and building consensus.
- Own data governance capabilities for metadata management, discovery, lineage, schema evolution, and data quality.
- Partner with security and data stakeholders on access controls and usage tracking.
- Troubleshoot distributed systems, support production operations and incident response, and drive root-cause improvements and automation.
- Mentor engineers across teams through design reviews, code reviews, and hands-on collaboration.
Requirements
- Extensive experience designing, building, and operating large-scale data-intensive distributed systems with technical leadership across multiple teams.
- Experience coordinating with engineering leadership and translating data or business strategy into engineering products and technical roadmaps.
- Experience building managed platform services and owning provisioning, upgrades, reliability, support, and user feedback throughout the service lifecycle.
- Experience scaling metadata management systems such as data catalogs or lineage tracking systems across multiple storage and compute technologies.
- Expertise in Java and/or Python, with strong familiarity with SQL and Linux and a record of delivering maintainable production software.
- Deep understanding of distributed-systems trade-offs, including consistency, fault tolerance, concurrency, partitioning, and recovery from partial failures.
- Production experience building batch and stream-processing systems at scale, including state management, replay, backpressure, and delivery guarantees.
- Experience with Flink, Spark, ClickHouse, Kafka, multiple storage technologies, open table formats such as Iceberg or Delta Lake, and data formats or serialization systems such as Arrow, Parquet, Protobuf, or Avro.
- Extensive experience with data modeling, schema governance and evolution, and cloud-native data infrastructure including Kubernetes, workflow orchestration, automated deployment, and production monitoring.
- Strong written and verbal communication, technical judgment, problem-solving, prioritization, stakeholder alignment, and mentoring skills.
- Preferred qualifications include scaling managed data services across varied workloads, data governance in regulated environments, and familiarity with financial datasets and trading, quantitative research, or back-office users.
Benefits
- Annual discretionary bonus eligibility.
- Group medical, pharmacy, dental, and vision insurance.
- 401k with discretionary employer match.
- Short- and long-term disability insurance, life and AD&D insurance.
- Health savings accounts and flexible spending accounts.
Tech Stack
Categories
BackendData Engineering
About DRW
DRW is a privately held proprietary trading firm that uses its own capital to trade and invest across global markets and asset classes, powered by technology and research. Founded in 1992 and headquartered in Chicago, it develops trading systems for strategies ranging from seconds to years and manages its own risk rather than external client money. The firm operates internationally from multiple offices.