8 months ago
Base Salary
$190k - $250k/yr
Responsibilities
- Architect the transactional and metadata substrate for petabyte-scale datasets.
- Build adaptive engines that autonomously reorganize data based on access patterns.
- Optimize bit-level organization to maximize signal extraction per byte.
- Develop distributed compute systems that scale predictively and maintain reliability.
- Implement new algorithms from ongoing research in compression and optimization.
- Design systems for minimal latency between data queries and insights.
Requirements
- Depth in distributed systems including consensus, partitioning, and fault tolerance.
- Experience with columnar formats like Parquet or ORC and low-level encoding strategies.
- Understanding of metadata-driven architectures and adaptive query planning.
- Production experience with Spark, Flink, or custom distributed engines.
- Proficiency in Java, Rust, Go, or C++ with a focus on clarity and quality.
- Curiosity about the mathematics of compression, entropy, and learning efficiency.
- A pragmatic and rigorous builder's mindset with long-term systems thinking.
Benefits
- Competitive salary and meaningful equity.
- Substantial bonus for top performers.
- Flexible time off and comprehensive health coverage for you and your family.
- Support for research, publication, and deep technical exploration.