Principal Site Reliability Engineer (Cloud, Observability & Automation)
Depository Trust & Clearing Corporation (DTCC)3 days ago
Jersey City, NJ, USAStaff+
Responsibilities
- Drive reliability, scalability, performance, and resiliency improvements across critical enterprise applications and services.
- Define and implement SLIs, SLOs, error budgets, operational KPIs, monitoring, alerting, telemetry, and service-health frameworks.
- Design and implement observability solutions using Grafana, Splunk, Dynatrace, OpenTelemetry, and related technologies.
- Partner with development, product, infrastructure, cloud, and operations teams to embed reliability and operational readiness into application design and delivery.
- Perform architecture reviews and improve availability, performance, fault tolerance, recoverability, and production readiness.
- Lead major incident response, root cause analysis, alert optimization, incident reduction, and MTTR improvement initiatives.
- Champion failure testing, disaster recovery preparedness, dependency analysis, and recovery validation.
- Develop automation, self-healing capabilities, and AI-assisted operational solutions using Python, Java, AWS services, Amazon Q, Kiro, or related technologies.
- Identify operational risks, prioritize reliability investments, mentor engineers, and promote Site Reliability Engineering practices across the organization.
Requirements
- Bachelor’s degree in computer science, Engineering, Information Technology, or equivalent experience.
- 8–10+ years of experience in Site Reliability Engineering, Production Engineering, DevOps, Application Support Engineering, Software Engineering, or related disciplines.
- Experience supporting large-scale, highly available production environments.
- Deep understanding of Site Reliability Engineering principles, operational excellence, SLIs, SLOs, error budgets, and reliability metrics.
- Expertise with observability and monitoring platforms including Grafana, Splunk, Dynatrace, ITSI, and OpenTelemetry.
- Experience with distributed systems, microservices architectures, cloud-native applications, enterprise platforms, and AWS.
- Strong programming and automation skills using Python, Java, Go, or similar languages.
- Experience leading major incident management, root cause investigations, and service improvement programs.
- Strong knowledge of Linux/Unix systems, networking fundamentals, performance tuning, and troubleshooting methodologies.
- Preferred experience with Kubernetes, containers, CI/CD pipelines, Infrastructure as Code, modern software delivery practices, and AI-assisted engineering platforms such as Amazon Q, Kiro, or GitHub Copilot.
- Experience in financial services or other highly regulated, mission-critical environments and a record of driving measurable reliability improvements.
- Strong communication, collaboration, stakeholder management, and cross-organizational influence skills.
Benefits
- Competitive compensation including base pay and annual incentive.
- Comprehensive health and life insurance and well-being benefits, based on location.
- Pension and retirement benefits.
- Paid time off, personal/family care, and other leaves of absence.
- Flexible hybrid schedule with 3 days onsite and 2 days remote; onsite days include Tuesdays, Wednesdays, and a third team- or employee-specific day.
About Depository Trust & Clearing Corporation (DTCC)
Depository Trust & Clearing Corporation (DTCC) runs global post-trade market infrastructure, delivering clearing, settlement, securities depository, trade reporting, and data services for broker-dealers, banks, and asset managers. It provides these services through subsidiaries such as DTC, NSCC, FICC, and the Global Trade Repository, with revenue primarily from transaction and service fees. Founded in 1973 and headquartered in Jersey City, NJ, DTCC is industry-owned and privately held, serving markets across multiple regions.