3 days ago
Bengaluru, IndiaSenior / Staff+
Responsibilities
- Design and implement distributed infrastructure for AI inference, including model serving, request routing, workload scheduling, and resource management.
- Build reliable, high-performance software involving concurrency, networking, scalability, data consistency, and failure recovery.
- Own software capabilities from design evaluation and implementation through testing, deployment, debugging, and improvement.
- Profile, benchmark, and diagnose systems to improve latency, throughput, resource efficiency, and reliability.
- Use and extend AI-assisted development tools and agentic workflows with appropriate testing, verification, and code review.
- Collaborate on architecture, interfaces, technical decisions, code reviews, and engineering practices across Arm.
Requirements
- At least 5 years of software engineering experience building complex software systems, with demonstrated technical depth, ownership, and impact.
- Strong programming skills in C++, Go, Rust, Python, or comparable languages, along with foundations in algorithms, data structures, and software design.
- Strong understanding of distributed systems, concurrency, networking, service interfaces, state management, and fault tolerance.
- Experience developing and debugging software on Linux, cloud infrastructure, or container-based environments, with an understanding of performance and reliability.
- Hands-on experience evaluating, debugging, and validating AI-generated code using AI-assisted development tools.
- Strong problem-solving ability, technical judgment, and independence in ambiguous engineering problems.
- Senior candidates should demonstrate strong execution and ownership of complex components; Staff candidates should also lead significant technical designs, make architectural tradeoffs, and influence decisions across teams.
- Preferred experience includes AI inference infrastructure, LLM serving, distributed compute, ML platforms, Kubernetes, distributed scheduling, resource orchestration, performance profiling, benchmarking, distributed tracing, developer tools, automated testing infrastructure, CI/CD systems, or agentic development workflows.
Benefits
- Opportunity to build Arm’s next-generation AI inference infrastructure from the ground up and influence significant platform capabilities.
- Opportunities to deepen expertise in distributed systems and AI-native development while collaborating with engineers across Arm.
- Hybrid working, with team-specific patterns and details provided during the application process; flexibility may be limited by local legal, regulatory, or tax considerations.
Categories
About Arm
Arm’s foundational technology is defining the future of computing. A future built by the greatest technology ecosystem in the world. A future built on Arm. Arm is everywhere technology matters. Technology matters everywhere. Together, we’ll power every technology revolution moving forward, including cloud computing, automotive and autonomous systems, IoT, the metaverse, and beyond. Changing the world. Again. On Arm.