5 months ago
Remote, United Kingdom +3 moreStaff+
Responsibilities
- Write production code and reliability improvements in services, tooling, and the Mimir, Loki, and Tempo codebases.
- Build automation and platform tooling across regions and cloud providers to reduce operational toil.
- Define and evolve per-tenant SLOs and reliability models, using incident learnings to improve systems.
- Improve observability and alerting and lead customer-impacting incident response.
- Participate in weekday 12-hour on-call shifts and a weekend rotation approximately once every six to eight weeks.
- Investigate escalations, tune capacity and configuration, complete incident follow-up, and create permanent fixes or automation.
- Author and review technical designs and pull requests and shape scalable, operable feature designs.
- Mentor engineers, promote reliability practices, drive cross-team projects, and help shape roadmaps and product strategy.
Requirements
- 8+ years of software engineering experience, including significant experience building and owning distributed systems in production.
- Strong production software development skills, preferably in at least one object-oriented language, with the ability to make targeted changes in large open-source codebases.
- Deep understanding of distributed-system performance, scaling, and failure modes.
- Experience operating multi-tenant systems at scale on Kubernetes in AWS, GCP, or Azure.
- Experience with infrastructure-as-code tools such as Terraform, Helm, or Jsonnet.
- Hands-on experience designing and implementing SLOs and participating in production on-call and blameless incident response.
- Staff-level technical leadership, including cross-team project leadership, technical direction, and mentoring.
- Working knowledge of Linux internals, networking, and cloud storage.
- Experience with Mimir, Loki, Tempo, Pyroscope, Prometheus, or other observability and time-series databases is preferred.
- Open-source contributions and customer reliability engineering or customer-facing escalation experience are preferred.
Benefits
- 100% remote role available to candidates in the UK, Sweden, Spain, or Germany.
- Germany base compensation is €113,000–€135,601, with equity, bonus if applicable, and other benefits.
- 30 days of annual leave per year, including three Grafana Shutdown Days, subject to local legislation.
- In-person onboarding, defined career growth pathways, transparent communication, and an open-source, high-trust culture.
Tech Stack
Categories
BackendSite Reliability
About Grafana
Grafana Labs builds open-source observability tools and a managed SaaS, Grafana Cloud, used by engineering and SRE teams to monitor, visualize, and analyze telemetry. Its products include Grafana dashboards plus Loki (logs), Tempo (traces), and Mimir (metrics), offered as cloud subscriptions and enterprise software. Privately held and headquartered in New York, it serves customers such as Anthropic, Bloomberg, NVIDIA, Microsoft, and Salesforce.