3 months ago
New York, NY, USAMid Level
Base Salary
$145k - $200k/yr
Responsibilities
- Build high-performance model-serving infrastructure integrating security models, hardware constraints, and inference engines
- Design request handling for authentication, rate limiting, concurrency control, and audit logging in multi-tenant model access
- Build and maintain secure packaging and deployment pipelines for on-premises and air-gapped environments
- Develop observability for production AI systems and support incident triage and resolution
- Debug performance and reliability issues across application code, inference engines, container runtimes, and GPU drivers
- Design and operate testing and benchmarking infrastructure across different GPU hardware
- Work with product teams and customers to understand requirements, resolve production issues, and deliver model capabilities
- Integrate hosted model infrastructure with deployment, configuration, and identity systems
Requirements
- At least 4 years of professional software engineering experience building and operating production systems
- Engineering background in Computer Science, Mathematics, Software Engineering, Physics, or a similar field
- Strong programming proficiency in languages such as Java, C++, Python, Rust, or similar languages
- Experience with containers, Kubernetes, and deploying backend services in production environments
- Familiarity with the Python ML ecosystem is valuable
- Strong written and verbal communication skills and ability to iterate quickly with teammates
- An active US Security clearance or eligibility and willingness to obtain one is beneficial but not required
Benefits
- Medical, dental, vision, voluntary life, basic life, AD&D, and disability insurance options
- Commuter benefits and relocation assistance
- Take-what-you-need paid time off, plus two weeks of paid time off at year-end subject to team and business needs
- Ten paid holidays
- Supportive leave of absence program, including military service and medical-event leave
- Paid parental leave and subsidized backup care
- Fertility and family-building benefits, including adoption, surrogacy, and preservation support
- New-child expense stipend
- 401(k) plan
- Employees are encouraged to work from Palantir offices; many teams offer hybrid work one or two days per week, with limited exceptional remote roles
Categories
About Palantir
AI-powered automation for every decision. At Palantir, our software powers AI-driven decisions in critical government and commercial enterprises in the West, from the factory floors to the front lines. Our platforms feature advanced tools for data protection, governance, responsible use of AI, and civilian protection capabilities for defense applications. Dominate your most complex problems with Palantir.