5 months ago
Palo Alto, CA, USAMid Level
H1B sponsor
Base Salary
$145k - $200k/yr
Responsibilities
- Build high-performance model-serving infrastructure integrating security models, hardware constraints, and inference engines
- Design request handling for authentication, rate limiting, concurrency control, and audit logging in multi-tenant model access
- Build and maintain packaging and deployment pipelines for secure model rollouts across on-premises and air-gapped environments
- Develop observability for production AI systems to support monitoring and incident triage
- Debug complex issues and performance problems across inference engines, container runtimes, GPU drivers, and the broader stack
- Design and run testing and benchmarking infrastructure across varying GPU hardware
- Work with product teams and customers to understand requirements, resolve production issues, and deliver model capabilities
- Integrate hosted model infrastructure with Palantir deployment, configuration, and identity systems
Requirements
- At least 4 years of professional software engineering experience building and operating production systems
- Engineering background in Computer Science, Mathematics, Software Engineering, Physics, or a similar field
- Strong coding skills in languages such as Java, C++, Python, Rust, or similar languages
- Familiarity with the Python machine learning ecosystem is valuable
- Experience with containers, Kubernetes, and deploying backend services in production environments
- Strong written and verbal communication skills, ability to iterate quickly with teammates, and commitment to high-quality work
- Active US Security clearance or eligibility and willingness to obtain one is beneficial but not required
Benefits
- Medical, dental, vision, and voluntary life insurance
- Basic life, AD&D, and disability insurance
- Commuter benefits
- Relocation assistance
- Take-what-you-need paid time off
- Two weeks of paid time off built into the end of each year, subject to team and business needs
- Ten paid holidays
- Supportive leave of absence program, including military service and medical event leave
- Paid parental leave and subsidized backup care for parents
- Fertility and family-building benefits, including adoption, surrogacy, and preservation support
- New-child expense stipend
- 401(k) plan
- Employees are encouraged to work from Palantir offices; many teams offer hybrid options of one or two work-from-home days per week, with limited exceptional remote roles
Categories
About Palantir
Palantir builds data-integration and AI-driven analytics platforms used by governments and large enterprises to run operations and make decisions. Its core products, including Gotham and Foundry (with Apollo for deployment), are sold via software subscriptions and implementation services. Founded in 2003 and headquartered in Miami, it is NYSE-listed and deployed across defense, intelligence, healthcare, and industrial sectors.