In what ways is ChatGPT inferior to Baidu's chatbot?

According to a report by misinformation watchdog NewsGuard, ChatGPT provides more inaccurate information in Chinese than in English. While the models themselves are multilingual, the languages are distinct overlapping regions of the dataset, and the models lack mechanisms to compare the degree of difference between phrases or predictions across those regions.

According to TechCrunch , when users ask ChatGPT to respond in English, it primarily retrieves all the English data it has, and the same applies to Chinese.

In March, Baidu introduced "Ernie Bot," a chatbot based on the Chinese search giant's Ernie artificial intelligence (AI) model. Amidst the ongoing and intense technology race between the US and China, Baidu's investment in and development of AI has attracted even more attention.

According to Reuters, Baidu cited test results conducted by China Science Daily using the AGIEval and C-Eval datasets, two standards used to evaluate the performance of AI models.

China's AI development race currently has three major players: Tencent, Alibaba, and Baidu.

Ernie, with a score of 3.5, demonstrated outstanding ability in a Chinese language test based on entrance and proficiency exams, such as those for university entrance exams or bar certification exams.

In another Chinese language test with 13,000 multiple-choice questions covering 50 different topics, Ernie 3.5 continued to demonstrate superiority over its two OpenAI competitors. However, when performing a third test developed by a group of American universities, which included questions on science and social studies, Ernie 3.5 was completely outmatched by ChatGPT and GPT 4.

Baidu's Chief Technology Officer, Haifeng Wang, stated that just three months after the beta release of Ernie Bot, Baidu's large language model (LLM), built on Ernie 3.0 and Ernie 3.5, has achieved improvements in efficiency, functionality, and performance. These improvements are evident in writing, querying, reasoning, and code generation, as well as in training and inference performance, the CTO said.

Baidu also stated that the new model will support plugins from Baidu and third parties. The company said that the “Baidu Search” plugin has been integrated and equips Ernie Bot with the ability to generate accurate and real-time information. Plugins are additional applications that allow AI to function in specific situations, such as summarizing long texts and generating more accurate answers.

According to a June test conducted by Xinhua News Agency, Baidu's Ernie Bot ranked top among "China's ChatGPTs." Baidu has been pushing for the integration of Ernie Bot into other products, such as its cloud services, and announced a $139 million venture capital fund to invest in Chinese AI generative startups, according to SCMP .

Baidu CEO and co-founder Robin Li said that it is foreseeable that large language models will increasingly penetrate more fields, becoming a key factor driving the digital economy .

Source link