Peraton

Senior Monitoring and Observability Engineer

Peraton
Apply
3 days ago
Remote, United StatesSenior
H1B Sponsor

Base Salary

$104k - $166k/yr

Responsibilities

  • Build and operate telemetry pipelines covering collection, enrichment, routing, sampling, storage, and retention across Dynatrace, Datadog, and Splunk.
  • Instrument applications and infrastructure for metrics, logs, and traces using OpenTelemetry-based standards across distributed, containerized, and cloud-native systems.
  • Create dashboards, golden-signal monitoring, alert definitions, correlation capabilities, runbook links, and actionable production alerting.
  • Monitor and remediate collector, agent, pipeline, and observability-platform issues while managing telemetry cost, ingest volume, cardinality, and retention governance.
  • Support on-call rotations, incident bridges, telemetry-driven triage, root-cause analysis, post-incident reviews, and MTTD/MTTA reporting.
  • Integrate alert routing, deduplication, and maintenance-window handling with ServiceNow and paging tools.
  • Automate observability deployments using Ansible, Ansible Tower, AAP, GitLab CI/CD, Jenkins, and Terraform.
  • Maintain versioned, peer-reviewed observability configurations, architecture documentation, runbooks, tagging conventions, and compliance controls.

Requirements

  • U.S. citizenship and the ability to obtain and maintain the required Public Trust clearance are required.
  • Requires a bachelor's degree with 8 years of experience, a master's degree with 6 years, or a high school diploma or equivalent with 12 years.
  • Requires 4 or more years of hands-on experience with enterprise observability, monitoring, and alerting platforms.
  • Hands-on experience with Dynatrace, Datadog, and/or Splunk, including instrumentation, dashboarding, and alert design, is required.
  • Requires knowledge of metrics, logs, and traces and experience with OpenTelemetry-based instrumentation.
  • Experience with AWS and/or AWS GovCloud and containerized or cloud-native workloads is required.
  • Experience with Ansible, Ansible Tower, or AAP for automated agent and configuration deployment is required.
  • Experience with GitLab CI/CD and Jenkins for observability-as-code pipelines is required.
  • Proficiency in Python, Bash, or Go is required.
  • Preferred qualifications include observability or cloud architecture certifications, production-scale OpenTelemetry Collector deployment, Kubernetes and container observability, service-mesh telemetry, eBPF-based collection, AIOps or AI-assisted anomaly detection, and experience with federal or regulated environments such as FISMA, FedRAMP, and NIST 800-53.

Benefits

  • Remote work arrangement.
  • Regular shift schedule of 8 a.m. to 5 p.m. Eastern Standard Time.
  • Employees may be eligible for overtime, shift differential, and a discretionary bonus in addition to base pay.
  • Work supporting a FedRAMP-authorized enterprise platform and national security missions.

Tech Stack

AnsibleAWSBashDatadogGitLab CI/CDGoJenkinsKubernetesPythonSplunkTerraform

Categories

Site Reliability
Peraton

About Peraton

10,000+ employees

At Peraton, we're at the forefront of delivering the next big thing every day. We're the partner of choice to help solve some of the world's most daunting challenges, delivering bold, new solutions to keep people around the world safer and more secure. How do we do it? By thinking differently. We're not mired in the past. We look at all problems with fresh eyes. We look past the obvious to bring the best talent, tech, and ideas together to completely transform how things get done. So bring your unique ideas, your entrepreneurial spirit, and your drive to succeed and get ready to be part of something bigger. Get ready to do the can't be done. ________ Recruitment fraud is a growing trend where fraudsters have been known to attempt to use our name to trick job seekers with fake employment opportunities. This type of scam is typically carried out through fake job postings, fake websites, or email accounts claiming to be from Peraton. The intent of recruitment fraud is to gain access to your personal information, such as your banking information, credit card number, or social security number. Please be aware that our careers site can be found at careers.peraton.com and our corporate site can be found at peraton.com. To learn more about Recruitment fraud and what to expect and not to expect from a Peraton recruiter, please visit: https://careers.peraton.com/recruitment-fraud/

Contact me