poolside

Member of Engineering (Evaluations / Engineering)

poolside
Apply
5 months ago
Remote, EMEASenior

Responsibilities

  • Design a Python framework for implementing internal and public benchmarks in a centralized way.
  • Build and maintain distributed evaluation pipelines that run at scale.
  • Collaborate with modeling and product teams to improve experimentation and evaluation tooling.
  • Lead software projects cross-functionally and build reliable, well-tested services.

Requirements

  • Strong software engineering background with experience in distributed systems, data pipelines, distributed processing, message queues, event-driven architectures, cloud-managed services, storage, monitoring, and alerting.
  • Experience leading software projects cross-functionally and building highly reliable, well-tested services.
  • Experience with Kafka or Google Pub/Sub and cloud platforms such as GCP, AWS, or Azure.
  • Experience with Grafana, Prometheus, or Datadog is relevant to the monitoring and alerting requirements.
  • A product mindset for developer-facing software and the ability to collaborate with researchers and ML engineers.
  • Experience designing developer frameworks or tooling, MLOps, or data visualization platforms is a plus.

Benefits

  • Fully remote work with flexible hours; the team meets in person for three days monthly and attends longer offsites twice yearly.
  • 37 days per year of vacation and holidays.
  • Health insurance allowance for the employee and dependents.
  • Company-provided equipment.
  • Wellbeing, learning, and home office allowances.
  • Frequent team get-togethers and a diverse, inclusive, people-first culture.

Tech Stack

Categories

BackendData Engineering
poolside

About poolside

201-500 employees
Contact me