Staff Software Engineer, Observability
Cerebras Systems7 days ago
Responsibilities
- Own the long-term architecture and roadmap for the observability platform across metrics, logs, traces, and events.
- Design telemetry pipelines handling high-cardinality, high-frequency data from thousands of Wafer-Scale Engines, large Kubernetes clusters, and storage and networking infrastructure.
- Define SLOs, alerting strategies, and reliability tooling that reduce MTTR and improve root-cause analysis.
- Unify critical hardware health signals with software metrics in a shared observability layer.
- Design instrumentation libraries and OpenTelemetry standards for services across the organization.
- Drive adoption through RFCs, design reviews, stakeholder partnerships, and cross-team technical direction.
- Mentor senior engineers and promote operational excellence and consistent engineering practices.
Requirements
- 8+ years of software engineering experience.
- 4+ years building or operating observability or monitoring platforms at significant scale, including millions of active time series and petabytes of log data.
- Deep expertise operating, tuning, and extending observability systems such as Prometheus, Thanos, Cortex, Mimir, Elasticsearch, ClickHouse, or Loki.
- Experience with OpenTelemetry instrumentation across a polyglot services environment.
- Proficiency in Go is preferred, with strong experience in Python and the ability to write performant concurrent systems code.
- Strong distributed systems and Kubernetes expertise, including sharding, replication, consistency models, and reliable data pipelines.
- Experience with observability cost management and capacity planning at scale.
- Track record of setting technical direction and driving adoption across multiple teams.
Benefits
- Opportunity to build infrastructure for a breakthrough AI platform beyond GPU constraints.
- Opportunities to publish and open-source AI research.
- Work on one of the fastest AI supercomputers in the world.
- Job stability with startup vitality.
- Non-corporate work culture that respects individual beliefs.
- Inclusive, equal-opportunity work environment focused on learning, growth, and support.
Tech Stack
Categories
About Cerebras Systems
Cerebras Systems designs and sells AI compute systems built around its wafer-scale WSE-3 processor, delivered as the CS-3 appliance and via the Cerebras Cloud. It targets enterprises, model labs, and government users needing fast training and inference, and offers on‑prem and cloud deployments. Privately held and headquartered in Sunnyvale, California, the company announced a multi-year partnership with OpenAI to deploy large-scale inference capacity.