6 days ago
Galway, IrelandStaff+
Responsibilities
- Develop and optimize C++, C, and Python software integrations connecting machine-learning platforms and execution environments with Arm hardware acceleration.
- Design and implement integrations between ML frameworks, runtimes, and hardware-acceleration technologies.
- Analyze and improve the performance of ML and LLM workloads, including integrations with open-source LLM software such as llama.cpp.
- Lead significant technical work from design through delivery and support technical decisions.
- Mentor junior engineers and collaborate with teams across Arm and external technology companies.
Requirements
- Strong C++, C, Python, and software-design skills.
- Experience delivering significant software features across multiple teams.
- Knowledge of LLM inference, including tokenization, attention, KV caches, batching, and quantisation.
- Effective technical leadership, communication, analytical, and problem-solving skills.
- Familiarity with Git, GitLab, continuous integration, and automated testing.
- Preferred experience with llama.cpp or other open-source ML or LLM runtimes, profiling and optimizing ML workloads, compiler or ML graph technologies, Vulkan, GPU compute, or other hardware-acceleration APIs.
- Preferred experience using AI-assisted software-development tools effectively.
Benefits
- Arm provides role-relevant training and a collaborative, high-performance working environment.
- Hybrid working patterns are determined by the team, with role-specific details provided during the application process.
- No relocation package is available for this role.
Categories
About Arm
Arm’s foundational technology is defining the future of computing. A future built by the greatest technology ecosystem in the world. A future built on Arm. Arm is everywhere technology matters. Technology matters everywhere. Together, we’ll power every technology revolution moving forward, including cloud computing, automotive and autonomous systems, IoT, the metaverse, and beyond. Changing the world. Again. On Arm.