Sr. Software Engineer, Observability and Telemetry
Tenstorrent6 days ago
Santa Clara, CA, USA
Senior / Mid Level
H1B Sponsor
Base Salary
$100k - $500k/yr
Responsibilities
- Architect, implement, and maintain TT-Telemetry, a C++-based service for collecting and exporting device-level metrics.
- Interface with internal engineering teams to understand Tenstorrent’s architecture and identify useful metrics.
- Design efficient built-in web GUIs for observing device- and cluster-level state.
- Design ingestion pipelines for industry standard telemetry systems like Prometheus.
- Help define the long-term architecture of Tenstorrent’s distributed telemetry stack.
Requirements
- Strong C++ engineering skills with experience in low-level environments and distributed systems design.
- Experience with observability platforms such as Prometheus, OpenTelemetry, Grafana, or similar technologies.
- Solid understanding of data structures for manipulating large volumes of data.
- Familiarity with SQL databases; experience with time-series databases is a plus.
- Curiosity about networking and communication across large clusters.
Tech Stack
C++ClickHouseGrafanaPrometheusSQL
Categories
AI & MLBackendData Engineering