Principal Software Engineer – Guest Experience Site Reliability
Choice Hotels International, Inc.3 days ago
Scottsdale, AZ, USAStaff+
Responsibilities
- Troubleshoot and resolve complex production issues across choicehotels.com, mobile applications, and call center technologies using logs, metrics, traces, and runtime signals.
- Lead cross-functional incident discussions, align stakeholders on root causes and options, and drive critical incidents to resolution.
- Participate in the Guest platforms on-call rotation as a senior escalation point.
- Write secure, stable, maintainable code to fix reliability defects, build automation, and improve application resiliency.
- Improve CI/CD pipelines and release safety in Harness through deployment verification, rollback strategies, and pipeline guardrails.
- Identify systemic risks and failure modes in AWS-hosted services and translate them into scoped engineering improvements.
- Use AI-assisted development, log analysis, and incident tools to improve root cause analysis, productivity, and reliability.
- Evaluate technical trade-offs, present recommendations, mentor engineers, and influence engineering practices across teams.
- Define non-functional requirements for scalability, availability, and security with architects, managers, and web, mobile, and contact center teams.
- Evaluate and introduce tools that improve observability, platform safety, and developer productivity.
Requirements
- Bachelor’s degree in Computer Science or a related technical field, or equivalent practical experience building and operating production systems; a master’s degree or equivalent experience is preferred.
- 10+ years of relevant software development experience, including distributed systems, cloud platforms, API-based architecture, and technical leadership or architecture experience.
- Strong hands-on experience with AWS public cloud services and managed-service reliability and scalability considerations.
- Hands-on experience building and maintaining Harness CI/CD pipelines; Jenkins, GitHub Actions, or similar experience is a plus.
- Strong Java experience, including operating Java services in cloud and containerized environments; Spring Boot is preferred.
- Proficiency with React and modern JavaScript or TypeScript front-end development.
- Experience designing, consuming, and troubleshooting GraphQL APIs, with familiarity with RESTful APIs and OpenAPI specifications.
- Experience diagnosing complex production issues with observability platforms and centralized logging; hands-on Grafana log exploration and dashboard creation is required.
- Experience with AppDynamics, OpenSearch, Amazon CloudWatch, or similar tools is a plus.
- Experience using AI-assisted tools for code assistance, log and trace analysis, or incident analysis.
- Understanding of SRE principles including SLOs, error budgets, incident management, and blameless postmortems.
- Experience with on-call rotations and leading critical incident response for high-traffic consumer-facing systems.
- Working knowledge of relational and non-relational data stores and their resiliency characteristics.
- Strong knowledge of application security best practices and awareness of PCI, OAuth, OWASP, and related compliance requirements.
- Excellent written and verbal communication, technical leadership, problem solving, ownership, and ability to influence without formal authority.
- Kotlin experience and experience supporting Android and/or iOS applications are preferred.
- AWS or equivalent technology certifications are preferred.
Benefits
- Medical, dental, and vision coverage.
- Paid holidays, vacation, personal, family, volunteer, sick, jury duty, bereavement, military, and religious leave.
- Retirement and health savings benefits.
- Employee recognition programs.
- Discounts at Choice hotels worldwide.
- Four days onsite in a hybrid arrangement at the North Scottsdale office.
- The role is an individual contributor position and is not eligible for sponsorship.
Tech Stack
Categories
Site Reliability
About Choice Hotels International, Inc.
Choice Hotels International is a public lodging franchisor with a portfolio of brands including Comfort, Quality Inn, Clarion, Cambria, Sleep Inn, Econo Lodge, and the Ascend Hotel Collection, serving leisure and business travelers. It earns primarily from franchise fees and reservation, loyalty, and technology services provided to independently owned hotels. Founded in 1939 and headquartered in Rockville, Maryland, Choice trades on the NYSE (CHH) and franchises thousands of properties across the U.S. and internationally.