Senior Software Engineer, AI Platform
Procore Technologies3 days ago
Base Salary
$141k - $194k/yr
Responsibilities
- Operate, scale, and maintain production AI workloads across Google Cloud and AWS.
- Manage production model workloads across Vertex AI, Amazon Bedrock, and Anthropic, including provider fallback, regional routing, and GPU-backed Kubernetes model serving.
- Optimize GKE and EKS clusters through resource tuning and dynamic autoscaling.
- Plan capacity and right-size stateful backends, queues, BigQuery storage, and vector databases.
- Lead staging rollouts, lifecycle management, upgrades, and automated rollback strategies for production databases and search infrastructure.
- Establish SLOs, alerting, distributed agent tracing, Datadog monitoring, and incident-response runbooks.
- Build secure CI/CD pipelines, reproducible staging environments, and developer tooling for AI platform users.
- Execute measurable performance and cost optimizations across multi-cloud architectures.
Requirements
- 5+ years of experience building and operating production infrastructure at scale.
- Deep hands-on experience with Google Cloud, including GKE, Vertex AI, IAM, VPC networking, BigQuery, and Cloud Monitoring.
- Production AWS experience with EKS, Lambda, IAM, RDS/Aurora, and SQS/SNS.
- Infrastructure management experience using Terraform across multi-cloud environments.
- Production Kubernetes expertise covering autoscaling, resource tuning, cluster lifecycle management, Helm, and GitOps workflows such as Argo CD.
- Experience running LLMs in production through provider APIs, including quota management, load balancing, and multi-provider routing.
- Experience deploying and operating distributed vector databases, search engines, and stateful data stores on Kubernetes.
- Strong observability experience, including alert policies, SLOs, Datadog dashboards, and incident-response runbooks.
- Track record of measurable performance and cost optimization with the ability to explain engineering trade-offs.
- Bachelor’s degree in Computer Science or a related technical field, or equivalent practical experience.
Benefits
- Hybrid work arrangement requiring two days per week in the Austin, Texas office.
- Annual base pay range of $140,960.00-$193,820.00, with potential eligibility for equity compensation and/or bonus incentive compensation.
Tech Stack
Categories
About Procore Technologies
Procore Technologies builds a cloud platform for construction project management used by general contractors, specialty contractors, and owners to manage bidding, scheduling, documents, financials, and field safety via web and mobile apps. It sells its software by subscription and integrates with common accounting and ERP systems. Founded in 2002 and headquartered in Carpinteria, California, Procore is a public company (NYSE: PCOR) whose software supports projects worldwide.