Fear of fraud with ChatGPT's realistic photo creation ability

ChatGPT "draws like a photo"

On March 26, the AI ​​(artificial intelligence) user community around the world as well as in Vietnam was abuzz when OpenAI officially released Images in ChatGPT focusing on image creation capabilities for users of the company's intelligent model. Previously, ChatGPT also had the ability to create images but was limited and had to go through another famous text-to-image model, DALL-E.

The tool's ability to turn text into drawings and "combine images like Photoshop" quickly attracted attention. Many said the output image quality was "amazing" and most rated it as "superior" compared to popular AI models on the market.

ChatGPT creates realistic coffee cups with just a simple command

According to Gabriel Goh, a research team leader at OpenAI, the significant improvement in ChatGPT's image generation capabilities using the GPT-4o model is "Binding" - a term for the degree to which the AI ​​image generator maintains the connection between attributes and objects. Mr. Goh asserted that GPT-4o can accurately associate attributes for 15 - 20 different objects without confusion, significantly improving the accuracy and reliability of the generated content.

Not only outstanding in its image creation ability, Images in ChatGPT also solves the "fatal" weakness of other image-generating AI tools, which is displaying writing and text inside the image. In fact, many images containing text are displayed accurately, making the image even more difficult to distinguish between fake and real.

The downside of this tool is that it takes a long time to generate images, but it is considered reasonable because the delay is created because good quality images, accurate details, and matching the user's description always require patience. The research team said the delay issue will be improved in the future.

Many concerns about the ability to combine photos

In addition to the fun in the initial experience that ChatGPT and OpenAI bring to users, the issue of information security, privacy as well as the risk of exploitation is once again brought to the forefront. "In the near future, the images you see online may not necessarily be real," a Facebook user in Vietnam expressed concern when he could ask ChatGPT to create completely unreal images that look as real as photos, for example, a photo of actor and former wrestler Dwayne Johnson (The Rock) advertising a chewing gum brand, or a photo of a calico cat sitting on the stove that looks exactly like a photo.

With detailed commands provided, users can create surprising results without needing in-depth knowledge of using traditional photo editing tools.

Many people have even tried the new tool's "stripping" ability. TN (Hanoi) said that she used a model photo taken from the internet to ask ChatGPT to change clothes as requested and almost all of the commands were met with high accuracy. "However, there were still some rejections, mainly due to violations of the system's policy on creating copyrighted images or having overly sexy content," TN shared.

In Thanh Nien 's tests, ChatGPT refused to create images related to famous or copyrighted characters in the real world or in movies and stories. "I cannot create the image as requested because the reference image you sent clearly shows the character Doctor Strange - a copyrighted character of Marvel and this violates the current content policy," the system replied when asked to create an image of Doctor Strange sitting... drinking iced tea in Vietnam.

Jackie Shannon, head of multimodal products at ChatGPT, confirmed that Images in ChatGPT has strong protection against Deepfake, pornographic, or fraudulent content. Notably, the generated images will integrate C2PA standard metadata to mark them as AI products, but need separate tools to check.

However, there are still many people who successfully "bend the law" and use images of famous people for entertainment purposes. For example, the image of CEO Tim Cook holding a Samsung phone instead of an iPhone, or the image of actor Robert Downey Jr. chewing on a vegetable candy, or the picture of Cristiano Ronaldo playing for a ball with Lionel Messi in a small alley in Vietnam in front of many people...

Source: https://thanhnien.vn/lo-ngai-gia-mao-voi-kha-nang-tao-anh-nhu-that-cua-chatgpt-185250327005110274.htm