(US) Principal ML System Engineer
PointClickCare4 hours ago
Base Salary
$195k - $217k/yr
Responsibilities
- Design, build, and maintain core infrastructure for generative AI products, including model gateways, prompt/versioning stores, vector databases, and LLM evaluation tools.
- Implement secure access controls and authentication mechanisms across AI platform components.
- Develop and manage observability, monitoring, and logging solutions for generative AI workloads and infrastructure.
- Collaborate with product and engineering teams to integrate generative AI infrastructure with agent frameworks and downstream applications.
- Optimize production infrastructure for scalability, high availability, and cost efficiency.
Requirements
- Extensive experience building and maintaining AI platform infrastructure, Kubernetes, and container security.
- Expertise in observability and monitoring frameworks focused on real-time performance, including OpenTelemetry or NLPFlow.
- Experience with AI infrastructure components such as vector databases, prompt/versioning stores, and AI IDEs.
- Familiarity with vLLM, SGLang, or a similar framework for hosting LLM inference workloads is preferred.
- Experience with CI/CD pipelines and automation for AI model deployment and platform operations is preferred.
- Strong knowledge of authentication and authorization frameworks integrated into AI platforms is preferred.
Benefits
- Remote work arrangement is indicated by the #LI-remote tag.
Tech Stack
About PointClickCare
PointClickCare is a leading health tech company with one simple mission: to help providers deliver exceptional care. With the largest long‐term and post‐acute care dataset, we power AI-driven healthcare that fuels intelligent transitions, insightful interventions, and financial sustainability. Enhanced by our marketplace of 400+ integrated partners and trusted by over 30,000 provider organizations and every major U.S. health plan, we’re redefining healthcare, so it doesn’t just survive — it thrives.