about 2 hours ago
Palo Alto, CA, USAMid Level / Senior
Base Salary
$145k - $200k/yr
Responsibilities
- Build high-performance model serving infrastructure that integrates with security models and hardware constraints.
- Design intelligent request handling including authentication, rate limiting, and audit logging.
- Build and maintain packaging and deployment pipelines for fast and secure model rollouts.
- Develop observability for production AI systems to enable service monitoring and incident resolution.
- Debug complex issues and performance problems throughout the stack.
- Design and run testing and benchmarking infrastructure for model deployments.
- Work with product teams and customers to understand requirements and deliver needed models.
- Integrate hosted model infrastructure with Palantir's deployment and configuration systems.
Requirements
- 4+ years of professional software engineering experience in production systems.
- Engineering background in Computer Science, Mathematics, Software Engineering, or similar field.
- Strong coding skills in languages such as Java, C++, Python, or Rust.
- Experience with containers, Kubernetes, and deploying backend services in production.
- Strong written and verbal communication skills.
Benefits
- Medical, dental, and vision insurance for employees and eligible dependents.
- Basic life, AD&D, and disability insurance coverage.
- Commuter benefits and relocation assistance.
- Flexible paid time off policy and 10 paid holidays per year.
- Supportive leave of absence program and paid leave for new parents.
- Fertility and family building benefits, including adoption and surrogacy support.
- 401k plan enrollment for employees.