Staff Software Engineer, Batch and Realtime Streaming
The Voleon Group4 months ago
Remote, United States +2 moreStaff+
Base Salary
$315k - $405k/yr
Responsibilities
- Architect, design, and implement core components of the batch and real-time streaming platform, including ingestion pipelines, storage systems, serving layers, and API interfaces.
- Collaborate across research, legal, trading, finance operations data, and infrastructure teams to ship features for trading systems.
- Work with machine learning researchers and data scientists to design APIs, SDKs, and user interfaces for feature discovery, access, and reuse.
- Ensure data quality, consistency, lineage, versioning, monitoring, and governance for features.
- Optimize data pipelines and storage for high performance, scalability, and reliability across batch and real-time use cases.
- Drive feature-store adoption through documentation, onboarding materials, and developer support.
- Mentor junior engineers and contribute to engineering best practices and technical excellence.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field, or equivalent experience.
- 10+ years of software engineering experience with a strong background in distributed computing and data infrastructure.
- Experience with Python and Go.
- Understanding of Postgres, MySQL, Cassandra, and DuckDB, plus experience with REST and gRPC APIs.
- Strong problem-solving skills focused on high-quality, maintainable, and well-documented solutions.
- Excellent communication and collaboration skills for working with engineering and research teams.
- Preferred experience building large-scale data pipelines and storage systems with tools such as Airflow, Spark, Ray, or Iceberg.
- Preferred exposure to Python data science tooling including pandas, polars, dask, and DuckDB.
- Preferred experience with distributed-systems monitoring and observability tools such as Prometheus, Grafana, or the ELK Stack.
- Prior experience with feature stores such as Feast, Hopsworks, or custom solutions is highly desirable.
Benefits
- Competitive compensation and benefits packages.
- State-of-the-art modern office.
- Daily catered lunches.
- Regular technology talks led by in-house experts.
- Collaborative, intellectually stimulating environment with opportunities to work alongside machine learning researchers and experienced engineers.
Tech Stack
Categories
BackendData Engineering