Microsoft introduces exclusive custom AI chip duo

VietNamNetVietNamNet16/11/2023


The Windows giant says it has no plans to commercialize the chips. Instead, the new AI chips will be used internally for its software products, as well as part of its Azure cloud computing service.

Solutions to rising costs

Microsoft and other tech giants like Alphabet (Google) are grappling with the high cost of providing AI services, which can be more than 10 times that of traditional services like search engines.

4xpsxcpxsfjsrbhian76huwwza.jpg
Self-producing chips is a trend for technology companies to cut expensive AI costs.

Microsoft executives say they plan to address the rising cost of AI by using a common platform model to deeply integrate AI into the entire software ecosystem. And the Maia chip is designed to do just that.

The Maia chip is designed to run large language models (LLMs), the foundation for the Azure OpenAI service, a collaboration between Microsoft and ChatGPT's owner.

“We think this gives us a way to be able to deliver better solutions to our customers at a faster pace, at a lower cost, and with higher quality,” said Scott Guthrie, executive vice president of Microsoft’s cloud and AI division.

Microsoft also said that next year it will offer Azure customers cloud services running on the latest leading chips from Nvidia and Advanced Micro Devices (AMD). The corporation is currently testing GPT-4 on AMD chips.

Increasing competition in the cloud sector

The second chip, codenamed Cobalt, was launched by Microsoft to save internal costs and compete with Amazon's AWS cloud service, which uses its own self-designed "Graviton" chip.

Cobalt is an Arm-based central processing unit (CPU) currently being tested to power the Teams enterprise messaging software.

AWS says its Graviton chip currently has about 50,000 customers, and the company will host a developer conference later this month.

"AWS will continue to innovate to deliver future generations of custom-designed chips that deliver even better price-performance, for any workload customers require," AWS said in a statement after Microsoft announced the AI ​​chip duo.

Rani Borkar, corporate vice president of Azure hardware and infrastructure, said both new chips are manufactured on TSMC's 5nm process.

In it, Maia is paired with standard Ethernet cables, rather than using the more expensive custom Nvidia networking technology that Microsoft has used in the supercomputers it built for OpenAI.

(According to Reuters)

MediaTek Launches Mobile AI Chip That Can Write Poetry, Create Images Without the Internet

MediaTek Launches Mobile AI Chip That Can Write Poetry, Create Images Without the Internet

Mobile chip designer MediaTek has just launched the Dimensity 9300 5G chipset with an integrated AI processor (also known as an APU), compatible with generative AI tasks such as generating images from text prompts without an Internet connection.

Nvidia faces immediate export ban on certain AI chips

Nvidia faces immediate export ban on certain AI chips

The US government is demanding that Nvidia immediately stop exporting certain chips without a license from the Commerce Department.

AI chip ‘unicorn’ joins hands with Samsung, challenging Nvidia

AI chip 'unicorn' joins hands with Samsung, challenging Nvidia

Tenstorrent, a Canadian-based billion-dollar AI chip startup, has just reached an agreement to use Samsung's 4-nanometer (nm) microprocessor manufacturing technology.



Source

Comment (0)

No data
No data

Same tag

Same category

Spreading national cultural values ​​through musical works
Lotus color of Hue
Hoa Minzy reveals messages with Xuan Hinh, tells behind-the-scenes story of 'Bac Bling' causing global fever
Phu Quoc - tropical paradise

Same author

Heritage

Figure

Business

No videos available

News

Ministry - Branch

Local

Product