Scale AI

Senior Infrastructure Software Engineer, Enterprise AI

Scale AI
Apply
1 year ago
San Francisco, CA, USA or New York, NY, USASenior
H1B Sponsor

Base Salary

$188k - $235k/yr

Responsibilities

  • Define architectural patterns for secure, reliable, and scalable multi-cloud infrastructure supporting enterprise agentic workflows.
  • Lead the infrastructure roadmap with emphasis on compliance, privacy, security, change management, and data isolation.
  • Own development and maintenance of the agentic observability platform covering logging, metrics, tracing, and analytics.
  • Build automated developer tooling and promote Infrastructure-as-Code practices across engineering.
  • Solve large-scale multi-tenancy, data-isolation, and high-performance inference challenges with end-to-end ownership across the product lifecycle.

Requirements

  • At least five years of full-time software engineering experience in a senior role.
  • Deep understanding of Infrastructure-as-Code, container orchestration, observability platforms, and modern infrastructure practices.
  • Extensive experience with at least one major cloud provider: AWS, Azure, or GCP.
  • Strong knowledge of enterprise security and compliance, including access management, data isolation, and customer-specific VPC configurations.
  • Proficiency in Python or JavaScript/TypeScript and SQL.
  • Hands-on experience or passion for agents, LLMs, vector databases, and emerging AI technologies is preferred.

Benefits

  • Comprehensive health, dental, and vision coverage.
  • Retirement benefits, learning and development stipend, generous paid time off, and potentially a commuter stipend.
  • Full-time position based in San Francisco, New York, or Seattle; salary location may affect compensation.
  • The company requires a 90-day waiting period before reconsidering candidates for the same role.
Scale AI

About Scale AI

501-1,000 employees

Scale’s mission is to develop reliable AI systems for the world’s most important decisions. We provide the high-quality data and full-stack technologies that power the world’s leading models, and help enterprises and governments build, deploy, and oversee AI applications that deliver real impact. The Scale Generative AI Platform allows customers to build, evaluate, and control advanced AI agents and applications that continuously improve. The Scale Data Engine provides the technology to collect, curate, and annotate high-quality datasets. Through our Scale Labs, we test models with rigorous benchmarks and novel research to ensure breakthroughs translate into systems people can trust. Scale powers the most advanced LLMs and generative models in the world through RLHF, data generation and model evaluation. We work with industry leaders like Meta, Cisco, DLA Piper, Mayo Clinic, Time Inc., the Government of Qatar, and U.S. government agencies including the Army and Air Force.

Contact me