about 2 hours ago
Washington, DC, USAMid Level / Senior
Base Salary
$145k - $200k/yr
Responsibilities
- Build high-performance model serving infrastructure that integrates with security models and hardware constraints.
- Design intelligent request handling for multi-tenant model access, including authentication and rate limiting.
- Maintain packaging and deployment pipelines for fast and secure model rollouts.
- Develop observability for production AI systems to enable service monitoring and incident resolution.
- Debug complex issues throughout the stack, including inference engines and GPU drivers.
- Design and run testing infrastructure to validate model deployments across varying GPU hardware.
- Collaborate with product teams to understand requirements and deliver necessary models and capabilities.
- Integrate hosted model infrastructure with Palantir's deployment and identity systems.
Requirements
- 4+ years of professional software engineering experience in production systems.
- Engineering background in Computer Science, Mathematics, Software Engineering, or similar field.
- Strong coding skills in languages such as Java, C++, Python, or Rust.
- Experience with containers, Kubernetes, and deploying backend services in production.
- Strong written and verbal communication skills for effective collaboration.
Benefits
- Medical, dental, and vision insurance for employees and eligible dependents.
- Basic life, AD&D, and disability insurance coverage.
- Commuter benefits and relocation assistance.
- Flexible paid time off policy and 10 paid holidays per year.
- Supportive leave of absence program for military service and medical events.
- Paid leave for new parents and subsidized back-up care.
- Fertility and family building benefits, including adoption and surrogacy support.
- 401k plan enrollment for employees.