In a test by a major trust rating organization, Chinese AI DeepSeek achieved only 17% accuracy, ranking 10th out of 11 AI chatbots evaluated.
AI chatbot DeepSeek from China is "making waves" in the world technology market - Photo: REUTERS
According to Reuters, on January 29 (local time), the trust rating organization NewsGuard published a report showing that the AI chatbot DeepSeek from China only achieved 17% accuracy when answering questions related to current news situations.
This figure is far below the average for Western chatbots and ranks 10th out of 11 AI applications tested.
Specifically, DeepSeek repeated false information in 30% of cases and gave vague or unhelpful answers in 53% of cases. This means that the news information provided by DeepSeek has a failure rate of up to 83%.
The average error rate of Western chatbots, including direct competitors to DeepSeek such as ChatGPT, Gemini... is around 62%.
NewsGuard said it used 300 identical questions to ask DeepSeek and Western chatbots, including 30 based on 10 pieces of misinformation circulating online.
False topics related to the assassination of UnitedHealthcare CEO Brian Thompson and the Azerbaijan Airlines flight crash in Kazakhstan.
Notably, in 3/10 of the above questions, DeepSeek arbitrarily inserted the viewpoint of the Chinese Government, even though the questions were not related to China and the command did not mention the country of a billion people.
Reuters said the results made many experts skeptical of DeepSeek's claim that their AI technology was "equivalent to or surpassing" OpenAI.
Meanwhile, NewsGuard notes that DeepSeek and other AI chatbots can easily be exploited and "trained" to spread false content.
DeepSeek's chatbot was launched on January 10 and quickly became the most downloaded app on Apple's app store.
This quickly raised concerns that the US could lose its leadership in the field of AI. In response to DeepSeek's rise, many investors dumped US technology stocks, causing the industry's capitalization to plummet.
DeepSeek has not yet responded to NewsGuard's latest report.
Source: https://tuoitre.vn/deepseek-chi-dat-17-do-chinh-xac-thua-xa-doi-thu-phuong-tay-20250130115359435.htm
Comment (0)