about 2 hours ago
New York, NY, USAMid Level / Senior
Base Salary
$145k - $200k/yr
Responsibilities
- Build high-performance model serving infrastructure that meets security and hardware constraints.
- Design intelligent request handling systems for multi-tenant model access.
- Develop and maintain packaging and deployment pipelines for secure model rollouts.
- Create observability tools for monitoring production AI systems.
- Debug complex issues across the stack, including inference engines and GPU drivers.
- Design testing and benchmarking infrastructure for model validation.
- Collaborate with product teams to understand requirements and resolve production issues.
- Integrate hosted model infrastructure with Palantir's systems.
Requirements
- 4+ years of professional software engineering experience in production systems.
- Degree in Computer Science, Mathematics, Software Engineering, Physics, or a related field.
- Strong coding skills in languages such as Java, C++, Python, or Rust.
- Experience with containers, Kubernetes, and deploying backend services.
- Excellent written and verbal communication skills.
Benefits
- Medical, dental, and vision insurance for employees and eligible dependents.
- Basic life, AD&D, and disability insurance coverage.
- Commuter benefits and relocation assistance.
- Flexible paid time off policy and 10 paid holidays per year.
- Supportive leave of absence program for military service and medical events.
- Paid parental leave and subsidized back-up care for parents.
- Fertility and family building benefits.
- 401k plan enrollment.