4 hours ago
Remote, CanadaSenior
Responsibilities
- Deliver complex, multi-month Tempo initiatives from problem framing through production rollout.
- Own components spanning ingestion, storage, query execution, and metrics generation.
- Design structured, deterministic, discoverable APIs for humans, agents, downstream products, and integrators.
- Improve query performance, autoscaling, customer limits, multi-cell operations, and high-cardinality workload handling.
- Operate services against concrete SLOs and contribute to automation, actionable alerts, incident response, and on-call.
- Collaborate with Product and sibling Grafana teams to unblock downstream observability products.
- Mentor junior and mid-level engineers through code review, design feedback, and pairing.
- Contribute to Tempo’s open-source community, including reviewing external contributions.
Requirements
- Significant hands-on experience building and operating distributed data systems in production, such as ingestion pipelines, storage engines, or query execution systems.
- Track record of delivering complex, multi-month projects spanning design, delivery, and operations.
- Strong software craftsmanship with the ability to write clean, robust, performant, maintainable software.
- Strong Go experience or strong experience in Rust, C, or C++ with a path to Go.
- Experience owning production services, carrying a pager, reducing toil, and using SLOs to guide operations.
- Ability to communicate clearly through design documents, reviews, and shipped code in a remote asynchronous environment.
- Experience with tracing, OpenTelemetry, or large-scale observability systems is preferred.
- Experience with query languages, SQL or TraceQL-like engines, programmatic APIs, columnar or analytical storage formats, or multi-tenant Kubernetes infrastructure is preferred.
- Experience building structured APIs and evaluation systems for AI or LLM consumers is preferred.
- Open-source contribution, Grafana, Prometheus, Loki, Tempo, or fully remote team experience is a bonus.
Benefits
- 100% remote position for candidates in the US and Canada, with a remote-first, globally distributed asynchronous work culture.
- Restricted Stock Units are included for all roles.
- 30 days of annual leave per year, including three Grafana Shutdown Days, subject to local legislation.
- In-person onboarding is provided.
- Career growth pathways, transparent communication, empowered teams, and a high-trust culture.
- Company-funded usage budget for modern AI coding assistants and access to frontier models from OpenAI, Anthropic, and Google.
About Grafana
Grafana Labs builds open-source observability tools and a managed SaaS, Grafana Cloud, used by engineering and SRE teams to monitor, visualize, and analyze telemetry. Its products include Grafana dashboards plus Loki (logs), Tempo (traces), and Mimir (metrics), offered as cloud subscriptions and enterprise software. Privately held and headquartered in New York, it serves customers such as Anthropic, Bloomberg, NVIDIA, Microsoft, and Salesforce.