CUDA Kernel Engineer (Remote US)
Pragmatike5 months ago
Cambridge, MA, USA +5 moreSenior
Responsibilities
- Design, implement, and optimize custom CUDA kernels for NVIDIA GPUs to maximize occupancy, memory throughput, and warp efficiency.
- Profile GPU workloads using Nsight Compute, Nsight Systems, nvprof, and CUDA-MEMCHECK.
- Identify and eliminate warp divergence, uncoalesced memory access, register pressure, and PCIe transfer bottlenecks.
- Improve global, shared, L2, and texture memory pipelines and ensure proper memory coalescing.
- Collaborate with AI systems, model acceleration, and backend distributed systems teams.
- Contribute to GPU architecture decisions, kernel libraries, and internal performance-engineering practices.
Requirements
- Hands-on experience building NVIDIA CUDA kernels from scratch rather than only calling existing libraries.
- Strong kernel optimization skills, including tiling strategies, occupancy tuning, shared-memory design, and warp scheduling.
- Deep understanding of CUDA threads, warps, blocks, grids, GPU memory hierarchy, memory coalescing, and warp divergence.
- Experience diagnosing PCIe bottlenecks and optimizing host-device transfers using pinned memory, streams, batching, and overlap.
- Familiarity with C++, CUDA runtime APIs, and GPU debugging and profiling tools.
- English proficiency is required.
- Bonus: experience with NCCL, NVLink, MIG, ML frameworks, HPC workloads, TensorRT, CUDA Graphs, CUTLASS, compiler-level optimization, or PTX/SASS analysis.
- Startup experience or comfort working in fast-moving, ambiguous environments is a bonus.
Benefits
- Remote position in the US
- Competitive salary and equity options
- Sign-on bonus
- Health, dental, and vision benefits
- 401(k)
About Pragmatike
Pragmatike is a Paris-based IT services and recruiting firm connecting remote-first companies with software engineers and tech specialists worldwide. Founded in 2022, it places contractors or full-time hires and staffs teams to complete projects for startups and scaleups. The private partnership offers access to a large network of 50,000+ specialists across 60+ countries.