View all newsletters
Receive our newsletter - data, insights and analysis delivered to you

AMD to buy AI chip start-up in bid to catch Nvidia

AMD already employs more than 1,500 engineers within its AI Group and plans to expand this with acquisitions and new hires.

By Ryan Morrison

AMD plans to buy AI chip start-up Nod.ai as part of its bid to more effectively compete with Nvidia by boosting its software capabilities. The chipmaker has previously said it intends to invest heavily in software alongside its most advanced chips to improve performance and functionality. Nod.ai builds open-source compiler-based systems that can auto-schedule compute and communications resources over CPUs, GPUs and accelerators.

AMD employs more than 1,500 engineers in its AI Group, mainly focused on software and plans to expand this through acquisitions (Photo: JHVEPhoto / Shutterstock)
AMD employs more than 1,500 engineers in its AI Group, mainly focused on software and plans to expand this through acquisitions. (Photo by JHVEPhoto/Shutterstock)

The chipmaker says Nod.ai will bring an experienced team into the AMD fold that has already developed industry-leading technology designed to run on AMD data centre chips. AMD says it will continue to provide the software as part of an open ecosystem that lowers the barriers to entry through developer tools, libraries and models.

The move comes as competition in the AI chip space is set to increase, with OpenAI actively investigating whether to build its own chips for training next-generation models and SoftBank’s Arm pursuing a data centre strategy fresh from its IPO. Nvidia continues to dominate in the space with demand for its GPUs in training AI models causing a shortage.

AI companies need thousands of chips to run their systems, with the AI supercomputer built by Microsoft for OpenAI powered by 10,000 of Nvidia’s A100 GPUs, which come at a cost of $10,000 a time. The H100, its recently released successor, is even more expensive, at some $30,000 per chip, and with Nvidia only expecting to ship 550,000 this year, supply problems are likely to be an ongoing issue for buyers. OpenAI CEO Sam Altman has openly complained that a lack of GPU availability is hindering his company’s progress.

Can AMD differentiate through software?

Software is emerging as a key differentiator for AMD compared with Nvidia. It has previously claimed that through automation and software, it can achieve 80% of Nvidia’s performance on similar-age chips when training large language models. “The acquisition of Nod.ai is expected to significantly enhance our ability to provide AI customers with open software that allows them to easily deploy highly performant AI models tuned for AMD hardware,” said Vamsi Boppana, senior VP of the AI Group at AMD.

Nod.ai produces software already in use by cloud hyperscalers. It includes the SHARK package, which reduces the need for manual optimisation and cuts the time required to deploy a highly performant AI model across a portfolio of data centre, edge and client platforms. Under the AMD AI Group, the Nod.ai team will more closely integrate its software into the AMD architecture, and enhance existing AI software products.

“At Nod.ai, we are a team of engineers focused on problem-solving – quickly – and moving at pace in an industry of constant change to develop solutions for the next set of problems,” said Anush Elangovan, co-founder and CEO, of Nod.ai. “Our journey as a company has cemented our role as the primary maintainer and major contributor to some of the world’s most important AI repositories, including SHARK, Torch-MLIR, and OpenXLA/IREE code generation technology. By joining forces with AMD, we will bring this expertise to a broader range of customers on a global scale.”

AMD has not revealed the value of the deal to acquire Nod.ai but the California-based company raised $36.5m so far and the employees will fall within the 1,500-strong AMD AI group, which was formed earlier this year to house its acquisitions. AMD says it will add an additional 300 hires to the group this year and more next year as it continues to focus on using software to drive growth.

Content from our partners
How distributors can leverage digital tools for successful customer experience
How Midsona accelerated efficiency and reduced costs with a modern ERP system
Streamlining your business with hybrid cloud

Boppana added: “The addition of the talented Nod.ai team accelerates our ability to advance open-source compiler technology and enable portable, high-performance AI solutions across the AMD product portfolio. Nod.ai’s technologies are already widely deployed in the cloud, at the edge and across a broad range of endpoint devices today.”

Read more: Will OpenAI really build its own chips?

Topics in this article : ,
Websites in our network
Select and enter your corporate email address Tech Monitor's research, insight and analysis examines the frontiers of digital transformation to help tech leaders navigate the future. Our Changelog newsletter delivers our best work to your inbox every week.
  • CIO
  • CTO
  • CISO
  • CSO
  • CFO
  • CDO
  • CEO
  • Architect Founder
  • MD
  • Director
  • Manager
  • Other
Visit our privacy policy for more information about our services, how New Statesman Media Group may use, process and share your personal data, including information on your rights in respect of your personal data and how you can unsubscribe from future marketing communications. Our services are intended for corporate subscribers and you warrant that the email address submitted is your corporate email address.
THANK YOU