Senior Site Reliability Engineer - Linux Systems & Application Observability
tastytrade16 hours ago
Base Salary
$180k - $200k/yr
Responsibilities
- Build self-healing, fault-tolerant infrastructure and internal tooling that automates operational work and reduces toil.
- Analyze observability gaps and improve telemetry, logging, alerting, and instrumentation coverage.
- Own capacity planning, load testing, scalability work, and architectural bottleneck identification across the HashiCorp Nomad service fabric.
- Extend the observability stack with Prometheus, Honeycomb, OpenTelemetry, and Grafana instrumentation.
- Define SLOs, error budgets, and multi-window burn-rate alerting for critical brokerage flows.
- Mentor engineers and establish a culture of site reliability across platform and application teams.
- Participate in production on-call operations and build a blameless post-incident review process.
Requirements
- Hands-on experience designing and shipping fault-tolerant, self-healing distributed systems.
- Deep understanding of distributed systems, Linux systems, cloud-native architectures, or containerization.
- Experience identifying observability and telemetry gaps, including missing instrumentation, alerting, and visibility.
- Experience scaling systems under production load through capacity planning and architectural bottleneck analysis.
- Hands-on experience with OpenTelemetry, Prometheus, and Grafana, including direct service instrumentation.
- Strong Linux internals and networking fundamentals, including TCP/IP, UDP/multicast, packet capture, and flow analysis.
- Production on-call experience and familiarity with blameless post-incident reviews.
- Working knowledge of SLOs and error budgets; HashiCorp Nomad, Consul, or Vault experience is a strong plus.
- Strong programming skills in Python, Ruby, Java, or a similar language.
Benefits
- Base salary range of $180,000-$200,000, with a discretionary performance bonus of 15-20% of base salary.
- Stock purchase options, 401k plan, medical, vision, and dental benefits.
- 20 paid vacation days plus an additional paid vacation day during the employee’s birthday month, and 10 paid sick days.
- Gym membership reimbursement, in-building gym, commuter benefits, and shuttle service to and from Metra.
- Pet insurance, wellness and mental health programs, charitable donation matching, and two paid volunteer days off.
- Daily catered lunch, snacks, and beverages when working in the Chicago office.
- Hybrid work arrangement requiring three days per week in the Chicago office.
About tastytrade
tastytrade is a Chicago-based retail brokerage that builds a platform for self-directed options, futures, and equities trading, along with daily financial education via tastylive. It monetizes through trading commissions, margin interest, and other brokerage fees. Founded by the creators of thinkorswim and acquired by London-based IG Group in 2021, the company serves active individual traders in the U.S. and operates within IG North America alongside brands like tastylive and tastyfx.