6 days ago
Galway, IrelandSenior
Responsibilities
- Develop and optimize C++, C, and Python integrations between ML frameworks, runtimes, and Arm hardware acceleration technologies.
- Integrate open-source LLM software such as llama.cpp and improve the performance of ML and LLM workloads.
- Lead significant technical work from design through delivery across multiple teams.
- Mentor junior engineers and support technical decisions.
- Collaborate with Arm teams and external technology companies to deliver ML framework integrations.
Requirements
- Strong C++, C, Python, and software-design skills.
- Experience delivering significant software features across multiple teams.
- Familiarity with Git, GitLab, continuous integration, and automated testing.
- Knowledge of LLM inference, including tokenization, attention, KV caches, batching, and quantization.
- Effective technical leadership, communication, analytical, and problem-solving skills.
- Preferred experience with llama.cpp or other open-source ML or LLM runtimes, profiling and optimizing ML workloads, compiler or ML graph technologies, Vulkan, GPU compute, or other hardware-acceleration APIs.
- Experience using AI-assisted software-development tools effectively is preferred.
Benefits
- Training and a friendly, high-performance working environment.
- Hybrid working patterns determined by the team, with role-specific details provided during the application process.
- No relocation package is available for this role.
- Accommodations are available during the recruitment process.
Categories
About Arm
Arm’s foundational technology is defining the future of computing. A future built by the greatest technology ecosystem in the world. A future built on Arm. Arm is everywhere technology matters. Technology matters everywhere. Together, we’ll power every technology revolution moving forward, including cloud computing, automotive and autonomous systems, IoT, the metaverse, and beyond. Changing the world. Again. On Arm.