Introducing PhoGPT - a dedicated Vietnamese version of ChatGPT
Báo Thanh niên•06/12/2023
For the AI community in general, and the natural language processing (NLP) community in particular, there is a desire to have a Vietnamese language processing model with high accuracy and performance. Therefore, PhoGPT - a ChatGPT version specialized for Vietnamese was born.
With a 7.5 billion parameter big data language model, built on the Transformer decoding platform, PhoGPT uses the most advanced techniques available (such as Flash Attention mechanism, AliBi context length extrapolation). These techniques not only help the model understand the context more deeply but also increase PhoGPT's ability to dialogue and interact naturally.
PhoGPT is considered the ChatGPT tool of Vietnamese people. TL
Besides the advantage of being a specialized language model for Vietnamese, the big difference between PhoGPT and ChatGPT is that PhoGPT is an open-source project, instead of being a proprietary software like ChatGPT of OpenAI.
Making PhoGPT source code public and available to users helps create an environment and user community that can develop custom and unique applications, especially those that require high security without depending on sources from proprietary software.
It is known that PhoGPT researched and developed by VinAI is expected to lay the first foundations for the development of high-performance Vietnamese language models, serving as a basis for developing practical and effective applications, in line with the AI development strategy to 2030 of the Vietnamese Government.
It is expected that in the near future, VinAI will have a plan to research and develop applications for individual users and specialized support solution packages for businesses in Vietnamese in fields such as healthcare, education, etc.
Comment (0)