Senior Engineer: Inference Data Plane
DigitalOceanabout 3 hours ago
Boston, MA, USA
Senior
H1B Sponsor
Base Salary
$139k - $174k/yr
Responsibilities
- Drive the design and development of distributed services for AI Infrastructure.
- Create and assess system design proposals for a multi-tenant inference cloud ecosystem.
- Lead the operational strategy for critical services, defining SLOs and maintaining platform health.
- Collaborate with Product Management and Engineering teams to align technical roadmaps with business priorities.
- Work on architecture initiatives to optimize fleet and enhance DigitalOcean's market position.
Requirements
- Deep experience with distributed and cloud services, including messaging systems and infrastructure as code.
- Advanced knowledge of cloud networking, containerization, and cloud storage.
- Proven experience building AI/ML products, particularly in Gen AI platforms and inference workflows.
- Significant experience running high-availability services across multiple regions.
- Experience with open-source software and a bias for technical ownership.
- Expert proficiency in GoLang or Python and familiarity with gRPC.
Benefits
- Access to resources for career development, including reimbursement for conferences and training.
- Flexible time off policy and Employee Assistance Program.
- Competitive salary with potential bonuses and equity compensation.
- Access to LinkedIn Learning's extensive course library.
Tech Stack
GogRPCKubernetesPython
Categories
AI & MLBackendDevOps