Arm

AI Software Engineer (AI software solution)

Arm
Apply
2 days ago
Shanghai, ChinaSenior

Responsibilities

  • Enable partner and open-source AI models and applications on Arm-based platforms through framework, runtime, and SDK integration.
  • Optimize model execution using quantization, graph optimization, operator fusion, tiling, and memory optimization techniques.
  • Profile and debug workloads across applications, frameworks, runtimes, and hardware interfaces to identify performance and compatibility issues.
  • Build reproducible workflows for cross-platform validation and benchmarking, including accuracy, latency, throughput, memory usage, and power-efficiency assessment.
  • Collaborate with partners and internal teams to resolve adoption challenges and share findings through demonstrations, technical guides, and engineering reports.

Requirements

  • Strong software engineering experience in AI deployment, inference frameworks, runtimes, or performance optimization.
  • Practical understanding of neural networks, including transformer-based models or CNNs, and experience optimizing models for resource-constrained devices.
  • Hands-on experience with PyTorch, ONNX Runtime, LiteRT, ExecuTorch, or vendor-specific SDKs.
  • Strong Python and C/C++ skills, with experience developing and debugging software on Linux or Android.
  • Experience profiling AI workloads, identifying bottlenecks, and validating optimization results against accuracy and performance baselines.
  • Strong analytical, communication, and documentation skills, with the ability to collaborate across partner applications and external engineering teams.
  • Preferred qualifications include Arm architecture or Arm AI software experience; optimization for CPUs, NPUs, or other accelerators; knowledge of hardware and system performance; model compression, pruning, LoRA/PEFT, or low-level kernel and inference-backend optimization; familiarity with automotive, robotics, embedded systems, virtual platforms, or pre-silicon environments; and contributions to open-source frameworks or developer ecosystems.
  • A bachelor’s or master’s degree in Computer Science, Computer Engineering, Electrical Engineering, Machine Learning, or a related field, or equivalent practical experience.

Benefits

  • Hybrid working is supported, with teams determining their working patterns and role-specific details shared during the application process.
  • Recruitment adjustments and accommodations are available for applicants who need them.
  • Arm is an equal opportunity employer committed to a respectful and inclusive workplace.
Arm

About Arm

5,001-10,000 employees

Arm’s foundational technology is defining the future of computing. A future built by the greatest technology ecosystem in the world. A future built on Arm. Arm is everywhere technology matters. Technology matters everywhere. Together, we’ll power every technology revolution moving forward, including cloud computing, automotive and autonomous systems, IoT, the metaverse, and beyond. Changing the world. Again. On Arm.

Contact me