Senior Engineer: Inference Data Plane
DigitalOceanabout 3 hours ago
Denver, CO, USA
Senior
H1B Sponsor
Base Salary
$139k - $174k/yr
Responsibilities
- Drive the design and development of distributed services for AI workloads.
- Create and assess system design proposals for a multi-tenant inference cloud ecosystem.
- Lead the operational strategy for critical services, defining SLOs and maintaining platform health.
- Collaborate with Product Management and Engineering teams to align technical roadmaps with business priorities.
- Work on architecture initiatives to optimize fleet performance and enhance market leadership in AI infrastructure.
Requirements
- Deep experience with distributed and cloud services, including messaging systems and databases.
- Advanced knowledge of cloud networking, containerization, and cloud storage.
- Proven experience building AI/ML products, particularly in Gen AI platforms and inference workflows.
- Significant experience running high-availability services across multiple regions.
- Experience with open-source software and a bias for technical ownership.
- Expert proficiency in GoLang or Python and familiarity with gRPC.
Benefits
- Competitive benefits including an Employee Assistance Program and flexible time off policy.
- Career development resources, including reimbursement for conferences and access to LinkedIn Learning courses.
- Equity compensation options and potential bonuses based on performance.
Tech Stack
GogRPCKubernetesPython
Categories
AI & MLBackendDevOps