One year on from IPO and 100 billion Arm-based devices will soon be AI-ready
It is working closely with leading cloud providers and frameworks to create an environment that makes it easy for software developers to bring accelerated AI and ML workloads to life on Arm-based hardware – doing the hard work so developers don’t have to.
Take a bow Arm Kleidi, which brings together the latest developer enablement technologies and critical resources to drive technical collaboration and innovation across the ML stack. Kleidi – Greek for key – is accelerating development and unlocking major AI performance uplifts on Arm CPUs.
Arm’s close collaboration with the PyTorch community shows how the technology is significantly reducing the effort needed for developers to take advantage of efficient AI. In the cloud, Kleidi builds on Arm’s existing work enhancing PyTorch with the Arm Compute Libraries (ACL) and establishes a blueprint for optimising AI on Arm everywhere.
Alex Spinelli, VP of Developer Technology, Arm, says: “We want developers to look to Arm as the platform of choice for running their critical ML workloads without having to do unnecessary engineering work themselves. As a key step towards that vision, we’ve partnered directly with PyTorch and Tensorflow to integrate Arm Kleidi Libraries, consisting of essential Arm kernels integrated directly into these leading frameworks.
“Critically, this means that application developers automatically benefit from dramatic performance improvements as soon as new framework versions are released, but without taking any extra steps to build on Arm today.”
Generative AI has spurred a wave of AI innovation with new versions of language models being released at an unprecedented rate. Arm is working closely with all key parts of the ML stack, including cloud service providers like AWS and Google, and the rapidly growing ML ISV community, such as Databricks, to ensure developers can stay ahead. It is adding more updates that will soon be rolled out.
Arm CEO Rene Haas said the company was also proud to have launched Arm Compute Subsystems (CSS) for multiple markets – tuned to help deliver bleeding edge AI-based experiences while making it easier and faster for partners to build their own silicon solutions. Armv9 now represents 25 per cent of the company’s royalty revenues with the CPU product lines continuing to expand.
The Arm compute platform is already enabling advanced computing in 300 billion chips worldwide with Google, Amazon and Microsoft to the fore and Haas expects that more than 100 billion Arm-based devices will be AI-ready by 2025.