2 days ago
Base Salary
$160k - $250k/yr
Responsibilities
- Design, build, and operate managed platform services for data storage, distributed query execution, batch and streaming processing, and workload orchestration.
- Own technical designs and implementation decisions for platform services, leading delivery from requirements through deployment and ongoing support.
- Automate provisioning, configuration, upgrades, and monitoring for managed services.
- Build and integrate data catalogs, lineage tracking, metadata management, schema governance, data quality checks, access controls, and usage tracking.
- Diagnose integration and performance issues with platform users and improve shared services and processing infrastructure.
- Improve reliability and performance through observability, capacity management, testing, production support, incident response, root-cause resolution, and operational runbooks.
- Deliver platform upgrades and data migrations with validation and compatibility checks.
- Lead design and code reviews, document technical trade-offs, and improve shared architectural patterns.
- Mentor less experienced engineers through hands-on collaboration and feedback.
Requirements
- 7+ years of experience working with modern data technologies and/or building data-intensive distributed systems.
- Expertise in Java and/or Python, with strong familiarity with SQL, Bash, and Linux environments.
- Experience building and operating managed data or infrastructure services for other teams, including operational automation and production support.
- Demonstrated ownership of engineering projects or service components from technical design through deployment and ongoing operation.
- Strong understanding of distributed-systems trade-offs, including fault tolerance, concurrency, partitioning, and recovery from partial failures.
- Production experience with batch and streaming systems, including state management, retries, replay, and data consistency.
- Experience with data processing or query technologies such as Flink, Spark, or ClickHouse.
- Experience with object storage, relational or NoSQL databases, event streaming systems such as Kafka, and open table formats such as Iceberg or Delta Lake.
- Practical experience with data modeling, schema governance and evolution, data quality controls, metadata management, data cataloging, or lineage capabilities.
- Experience with data formats and serialization systems such as Arrow, Parquet, Protobuf, or Avro.
- Experience with cloud-native data infrastructure, Kubernetes, workflow orchestration, automated deployment, and production monitoring.
- Strong communication, troubleshooting, collaboration, prioritization, and problem-solving skills.
- Desirable qualifications include scaling data catalogs or lineage tools, implementing governance capabilities, and familiarity with financial datasets and trading, quantitative research, or back-office users.
Benefits
- Comprehensive employee benefits including medical, pharmacy, dental, and vision insurance.
- 401k plan with discretionary employer match.
- Short- and long-term disability insurance, life and AD&D insurance, health savings accounts, and flexible spending accounts.
- Eligible for an annual discretionary bonus.
Tech Stack
Categories
Data Engineering
About DRW
DRW is a privately held proprietary trading firm that uses its own capital to trade and invest across global markets and asset classes, powered by technology and research. Founded in 1992 and headquartered in Chicago, it develops trading systems for strategies ranging from seconds to years and manages its own risk rather than external client money. The firm operates internationally from multiple offices.