Staff Engineer, Inference Optimizations

about 3 hours ago

Denver, CO, USASenior / Staff+

H1B Sponsor

Base Salary

$191k - $239k/yr

Responsibilities

Lead the technical strategy for benchmarking and performance optimizations at the inference engine and GPU kernel layers.
Engineer solutions for complex performance issues, including attention layer optimizations and memory management.
Implement cutting-edge optimization techniques to maintain DigitalOcean's leadership in the Gen AI landscape.
Act as a subject matter expert on modern GPU families and their software stacks.
Develop and deploy state-of-the-art quantization techniques to enhance throughput.
Provide technical mentorship through code and design reviews.
Collaborate with Product Management to translate hardware limits into product features.
Contribute to the GPU infrastructure and model performance optimization communities.

5+ years of experience in high-performance computing or AI infrastructure.
Deep familiarity with the Gen AI landscape, including major model families.
Hands-on experience with attention-layer optimizations and parallelization strategies.
Comprehensive understanding of NVIDIA and AMD GPU architectures and software ecosystems.
Extensive experience with open-source software projects.
Excellent system design skills related to low-level GPU programming.
Experience acting as a technical lead and driving cross-functional alignment.
Deep understanding of GPU architectures and low-level programming.

Access to resources for career development, including conference reimbursements and LinkedIn Learning courses.
Competitive benefits supporting employee well-being, including an Employee Assistance Program and flexible time off.
Potential for bonuses and equity compensation based on performance.