Senior DevOps Engineer, Observability and FinOps
CACI International1 day ago
Base Salary
$99k - $207k/yr
Responsibilities
- Deploy, configure, and operate observability platforms including Grafana Alloy, Mimir, Loki, Tempo, Elastic, and Dynatrace on OpenShift and disconnected networks.
- Instrument applications and infrastructure with OpenTelemetry and Prometheus exporters while standardizing labels, tags, and naming.
- Build real-time mission-status, service-health, cost, and utilization dashboards for operators, engineers, leadership, and financial stakeholders.
- Implement cost visibility and allocation across AWS, OpenShift, and on-premises resources using tagging, showback, and chargeback models.
- Analyze and optimize cloud and infrastructure costs through rightsizing, idle-resource cleanup, storage lifecycle policies, Reserved Instance analysis, and Savings Plan coverage analysis.
- Automate infrastructure deployment and configuration with Terraform, Ansible, Helm, Operators, and GitOps tools such as Argo CD.
- Build and maintain GitLab CI, Jenkins, or Tekton pipelines, including image scanning, signing, promotion, and air-gapped registry delivery.
- Package software and dependencies for offline transfer and cross-domain delivery.
- Develop lightweight web applications, APIs, Grafana plugins or panels, and Python or Go data-integration scripts.
- Document runbooks, architecture diagrams, and user guides while training operators and mentoring junior engineers.
Requirements
- TS/SCI clearance with polygraph is required.
- Bachelor's degree in Computer Science, Information Technology, Software Engineering, or a related field is required.
- At least 3 years deploying and operating an enterprise observability stack such as Grafana/Prometheus, Elastic, Dynatrace, or Splunk is required.
- At least 3 years of production Kubernetes experience and familiarity with Red Hat OpenShift are required.
- At least 2 years of AWS experience with EC2, S3, EKS, IAM, CloudWatch, and Cost and Usage Reports are required.
- Experience with metrics, logs, traces, OpenTelemetry or Prometheus exporters, operational dashboards, alert rules, and SLI/SLO concepts is required.
- Experience analyzing cloud spend, applying tagging strategies, and delivering a cost-optimization result is required.
- Experience with Terraform, Ansible, Helm or Operators, Git workflows, and GitLab CI, Jenkins, or equivalent pipelines is required.
- Proficiency in Python or Go, Bash scripting, SQL, and PromQL or an equivalent query language is required.
- RHEL administration and troubleshooting experience is required.
- Experience hardening systems to DISA STIGs and familiarity with RMF and NIST SP 800-53 controls are required.
- Experience working in air-gapped or disconnected networks, including offline package and image management, is required.
- Desired qualifications include experience with Grafana Alloy, Mimir, Loki, Tempo, Elastic, Dynatrace, store-and-forward pipelines, edge collectors, Kafka, cross-domain solutions, OpenCost, Kubecost, CloudHealth, Apptio Cloudability, AWS Cost Explorer, Istio, service meshes, OpenShift GitOps, and OpenShift Pipelines.
Benefits
- Comprehensive healthcare, wellness, financial, retirement, family-support, continuing-education, and time-off benefits are offered.
- Flexible time off and learning and development resources are provided.
- The position is full time, regular employment with up to 10% continental U.S. travel.
- The role requires TS/SCI with polygraph clearance and may be worked in more than one location.
Tech Stack
AnsibleApache KafkaArgo CDAWSBashGitLab CI/CDGoHelmIstioJenkinsKubernetesOpenShiftPrometheusPythonSplunkSQLTektonTerraform
Categories
About CACI International
CACI International is a public government contractor that delivers enterprise IT, cybersecurity, electronic warfare, space, and intelligence solutions to U.S. defense, intelligence, and federal civilian customers. It provides systems engineering, software and data services, and mission support across C4ISR and business systems, primarily through long-term government contracts. Founded in 1962 and headquartered in Reston, Virginia, CACI trades on the NYSE under the ticker CACI.