Staff AI Engineer
Pragmatike3 hours ago
Boston, MA, USA +5 moreStaff+
Base Salary
$200k - $350k/yr
Responsibilities
- Lead architecture for production AI systems.
- Design model serving, inference, evaluation, and optimization pipelines.
- Improve model latency, throughput, quality, and cost.
- Lead technical AI initiatives across multiple teams.
- Establish engineering standards for AI development and deployment.
- Mentor AI engineers.
- Partner with Product and Engineering leadership on AI strategy.
- Evaluate emerging models and infrastructure technologies.
Requirements
- 7+ years of engineering or machine learning experience.
- Deep Python and machine learning engineering expertise.
- Strong production large language model experience.
- Strong distributed systems and system design skills.
- Experience optimizing inference systems.
- Strong technical leadership and communication skills.
- Preferred experience with vLLM, TGI, Triton, CUDA, PyTorch, Kubernetes, GPU infrastructure, retrieval-augmented generation, fine-tuning, AI agents, and high-scale AI production environments.
- Fluent English is required.
Benefits
- Full benefit package
- United States remote work arrangement
- Full-time employment
- Start date ASAP
Tech Stack
Categories
About Pragmatike
Trusted by remote-first companies worldwide. Completing tech projects for startups and scaleups.