Software Engineer - Science Platform (BE) - New York
Haus Analyticsabout 4 hours ago
Base Salary
$165k - $205k/yr
Responsibilities
- Build and evolve data pipelines that aggregate and transform KPI data from BigQuery.
- Extend and maintain the statistical estimation library by implementing new estimators and optimizing performance.
- Improve the Metaflow-based analysis orchestration system for executing daily experiment analyses.
- Design reliable systems with monitoring, alerting, and self-healing patterns for autonomous pipelines.
- Collaborate with applied scientists to translate research prototypes into production-grade code.
- Work with product engineers to ensure analysis results flow into the customer-facing API.
- Utilize AI development tools to enhance delivery and explore solutions.
- Participate in on-call rotation to maintain operational health of the science platform.
Requirements
- 3+ years of experience in building and shipping production software systems.
- Strong proficiency in Python, including familiarity with libraries like pandas and numpy.
- Experience with data-intensive applications and understanding of data pipelines or ETL systems.
- Proficient in SQL and analytical databases such as BigQuery or Snowflake.
- Comfortable with cloud-native environments, preferably GCP.
- Experience with workflow orchestration frameworks like Metaflow or Airflow is a plus.
- Ability to collaborate effectively with scientists and researchers.
- Excellent communication skills to explain technical tradeoffs clearly.
Benefits
- Flexible PTO to take time when needed.
- Equity options for part-ownership in the company's success.
- Comprehensive health, dental, and vision insurance with multiple plan options.
- WFH stipend to support a productive work setup.
- Opportunities for events and offsites to connect with the team.
- Free lunch when working from the office in hub locations.
Tech Stack
Apache AirflowGoogle BigQueryGoogle Cloud PlatformKubernetesNumPyPandaspytestPythonscikit-learnSciPySnowflakeSQL