Office of the Comptroller of the Currency

Lead Associate Principal, Software Engineering: DevOps

Office of the Comptroller of the Currency
Apply
1 day ago
Chicago, IL, USA or Dallas, TX, USAStaff+

Base Salary

$141k - $233k/yr

Responsibilities

  • Lead L1 and L2 engineers through incident triage, investigation, coordination, resolution, closure, and post-incident reporting.
  • Serve as the Tier 3 escalation point for complex incidents across Kubernetes, Kafka, Harness, middleware, storage, networking, Vault, certificates, secrets, and application-development teams.
  • Own the full incident lifecycle, including root-cause analysis, permanent fixes or accepted workarounds, P1/P2 reviews, and documentation.
  • Define, enforce, monitor, and report severity-based SLA targets and compliance trends.
  • Lead alert tuning, noise reduction, MTTR improvement, recurring-incident analysis, problem management, and support-workflow automation.
  • Maintain runbooks, environment configuration documentation, operational procedures, and incident records.
  • Build and maintain dashboards and reports for MTTR, SLA compliance, alert-to-incident ratio, repeat incidents, and deployment success.

Requirements

  • Minimum seven years of hands-on environment operations, production support, or infrastructure operations experience.
  • Experience across at least four areas including deployment pipelines, container platforms, middleware, incident management, monitoring, configuration management, release engineering, platform operations, or scripting and automation.
  • Proven team leadership experience and previous people-management or team-lead experience; formal people management is strongly preferred.
  • Deep production-support knowledge of application deployment pipelines, container orchestration, messaging platforms, middleware, and common production failure modes.
  • Experience defining and enforcing SLA frameworks in a tiered L1/L2/L3 support model.
  • Ability to create and maintain monitoring alerts, operational runbooks, dashboards, and reports.
  • Strong communication, analytical, judgment, consultation, organizational, and incident-triage skills.
  • Familiarity with financial services or other regulated-industry environments is advantageous.
  • Certified Kubernetes Administrator, ITIL, HashiCorp Vault Associate, Harness Certified Continuous Delivery Architect, and AWS, Azure, or GCP certifications are advantageous.

Benefits

  • Hybrid work environment with up to two remote days per week.
  • Tuition reimbursement, student loan repayment assistance, and a technology stipend for remote work.
  • Generous paid time off and parental leave.
  • 401(k) employer match and competitive medical, dental, and vision benefits.
  • Requires shift work and 24x7 on-call availability, including planned and emergency maintenance windows.

Tech Stack

Apache KafkaAWSAzureDatadogGoogle Cloud PlatformGrafanaHarnessJenkinsKubernetesPrometheusSplunk

Categories

Contact me