Senior Software Engineer I - AI Inference Data Plane

about 3 hours ago

Bengaluru, IndiaSenior / Staff+

H1B Sponsor

Responsibilities

Act as a technical leader on the team, driving the design and delivery of data plane components.
Architect and refine system design proposals for a multi-tenant AI inference cloud ecosystem.
Implement and optimize distributed inference hosting techniques.
Collaborate with Product Managers and other teams to align technical roadmaps with customer needs.
Coach and mentor junior engineers to foster technical excellence.
Maintain and operate high-scale services using observability tools.

Strong experience with microservices, messaging systems, and databases.
Hands-on experience hosting large language or multimodal models.
Familiarity with distributed inference serving frameworks.
Understanding of GPU-level optimization and interconnect technologies.
Knowledge of common LLM architectures and optimization techniques.
Expert-level proficiency in GoLang or Python and familiarity with gRPC.
Proven experience shipping customer-facing software products in a high-scale environment.
Experience integrating and building with open-source software.

Access to resources for career development, including reimbursement for conferences and training.
Competitive benefits supporting employee well-being, including flexible time off.
Potential for bonuses and equity compensation based on performance.