(US) Principal ML System Engineer
PointClickCare28 days ago
Base Salary
$195k - $217k/yr
Responsibilities
- Design, build, and maintain infrastructure for GenAI products, including model gateways, prompt/versioning stores, vector databases, and LLM evaluation tools.
- Implement secure access controls and authentication mechanisms across AI platform components.
- Develop and manage observability, monitoring, and logging solutions for GenAI workloads and infrastructure.
- Integrate GenAI infrastructure with agent frameworks and downstream applications in collaboration with product and engineering teams.
- Optimize production infrastructure for scalability, high availability, and cost efficiency.
Requirements
- Extensive experience building and maintaining AI platform infrastructure, Kubernetes, and container security.
- Expertise in observability and monitoring frameworks focused on real-time performance, including OpenTelemetry and NLPFlow experience.
- Experience with AI infrastructure components such as vector databases, prompt/versioning stores, and AI IDEs.
- Familiarity with vLLM, SGLang, or a similar framework for hosting LLM inference workloads is preferred.
- Experience with CI/CD pipelines and automation for AI model deployment and platform operations is preferred.
- Strong knowledge of authentication and authorization frameworks integrated into AI platforms is preferred.
Benefits
- Remote position, as indicated by #LI-remote.
Tech Stack
Categories
About PointClickCare
PointClickCare builds a cloud-based EHR and care coordination platform for long-term and post-acute care providers, hospitals, and health plans. Its subscription SaaS covers clinical documentation, eMAR and point-of-care workflows, interoperability, and revenue cycle, and supports a marketplace of integrated partners. Founded in 2000 and headquartered in Toronto, it is privately held and serves over 27,000 providers across North America.