Senior Engineer: Inference Data Plane
DigitalOceanabout 3 hours ago
San Francisco, CA, USA
Senior
H1B Sponsor
Base Salary
$139k - $174k/yr
Responsibilities
- Drive the design and development of distributed services for AI workloads.
- Create and assess system design proposals for a multi-tenant inference cloud ecosystem.
- Lead the operational strategy for critical services, defining SLOs and maintaining platform health.
- Collaborate with Product Management and Engineering teams to align technical roadmaps with business priorities.
- Work on architecture initiatives to optimize fleet performance and enhance market leadership.
Requirements
- Deep experience with distributed and cloud services, including messaging systems and infrastructure as code.
- Advanced knowledge of cloud networking, containerization, and cloud storage.
- Proven experience building AI/ML products, particularly in Gen AI platforms and inference workflows.
- Significant experience running high-availability services across multiple regions.
- Experience with open-source software and a bias for technical ownership.
- Expert proficiency in GoLang or Python and familiarity with gRPC.
Benefits
- Career development resources including reimbursement for conferences and access to LinkedIn Learning courses.
- Competitive benefits supporting employee well-being, including flexible time off and an Employee Assistance Program.
- Potential for bonuses and equity compensation based on performance.
Tech Stack
GogRPCKubernetesPython
Categories
AI & MLBackendDevOps