Staff Site Reliability Engineer - Splunk

2 days ago

Chicago, IL, USA +4 moreStaff+

H1B Sponsor

Base Salary

$174k - $267k/yr

Responsibilities

Design, build, and maintain scalable observability infrastructure using Terraform.
Optimize Splunk log collection, processing, storage, Workload Management, and HEC performance for reliability and low latency.
Create actionable Splunk dashboards that correlate data across multiple sources.
Automate deployment and scaling of observability agents and collectors.
Participate in on-call rotations, lead post-incident reviews, and drive systemic reliability improvements.
Build internal tools and automate workflows using SPL and Go.
Troubleshoot complex cross-service performance bottlenecks in distributed systems.

At least five years of experience scaling and managing Splunk Cloud at scale, including environments with 1,000+ services, Workload Management, and HEC optimization.
At least five years of experience in an SRE, DevOps, or Systems Engineering role focused on high-availability systems.
Strong coding skills in SPL and Go.
Deep understanding of Linux internals, TCP/IP, DNS, and container orchestration with Kubernetes or EKS.
Expertise creating intuitive, actionable Splunk dashboards across multiple data sources.
Ability to access federal environments or protected federal data and provide documentation establishing U.S. Person status upon hire.
Preferred experience with OpenTelemetry, Vector, Splunk charge-back applications, and observability tools on AWS or GCP.

Annual base salary ranges from $194,000 to $267,000 in the San Francisco Bay Area and from $174,000 to $239,000 in specified other states.
Equity, bonus, health, dental and vision insurance, 401(k), flexible spending account, and paid leave including PTO and parental leave are offered in accordance with applicable plans and policies.
The role is hybrid and requires in-person onboarding at the San Francisco office during the first week of employment.
Okta provides well-being support, social-impact programs, talent development, and community-building initiatives.

5,001-10,000 employees

Okta secures AI. Okta is The World’s Identity Company. Freeing everyone to safely use any technology—anywhere, on any device or app.