3 months ago
Washington, DC, USAMid Level
Base Salary
$145k - $200k/yr
Responsibilities
- Build high-performance model-serving infrastructure integrating security models, hardware constraints, and inference engines.
- Design request handling for authentication, rate limiting, concurrency control, and audit logging in multi-tenant model access.
- Build and maintain secure packaging and deployment pipelines for on-premises and air-gapped environments.
- Develop observability for production AI systems to support monitoring, incident triage, and resolution.
- Debug performance and reliability issues across inference engines, container runtimes, GPU drivers, and the broader stack.
- Design and run testing and benchmarking infrastructure across different GPU hardware before production deployment.
- Work with product teams and customers to understand requirements, resolve production issues, and deliver needed models and capabilities.
- Integrate hosted model infrastructure with deployment, configuration, and identity systems.
Requirements
- At least 4 years of professional software engineering experience building and operating production systems.
- Engineering background in Computer Science, Mathematics, Software Engineering, Physics, or a similar field.
- Strong coding skills in languages such as Java, C++, Python, Rust, or similar; familiarity with the Python ML ecosystem is valuable.
- Experience with containers, Kubernetes, and deploying backend services in production environments.
- Strong written and verbal communication skills and the ability to iterate quickly with teammates while maintaining a high quality bar.
- An active US Security clearance or eligibility and willingness to obtain one is beneficial but not required.
Benefits
- Medical, dental, vision, voluntary life, basic life, AD&D, and disability insurance options.
- Commuter benefits and relocation assistance.
- Take-what-you-need paid time off, two weeks of year-end paid time off subject to team and business needs, and 10 paid holidays.
- Supportive leave programs, including military and medical leave, paid parental leave, and subsidized backup care.
- Fertility and family-building benefits and a new-child expense stipend.
- 401(k) plan.
- Work is encouraged from company offices; many teams offer hybrid work one or two days per week, with exceptional remote arrangements for some roles.
Categories
About Palantir
AI-powered automation for every decision. At Palantir, our software powers AI-driven decisions in critical government and commercial enterprises in the West, from the factory floors to the front lines. Our platforms feature advanced tools for data protection, governance, responsible use of AI, and civilian protection capabilities for defense applications. Dominate your most complex problems with Palantir.