Naver, Kakao strive to combat deepfake porn spreading online
The rise of explicit and nonconsensual deepfake pornography illegally being shared online is prompting Korean platform operators to boost their surveillance while delaying generative AI services.
Naver, the country's No. 1 search engine, said Wednesday it is running Clova GreenEye 2.0 on its platforms to identify harmful and sexually explicit images using the image analysis solution based on its AI model's vision technology.
While the solution is not specifically made to scan for deepfake and AI-generated content, it monitors for all obscene content uploaded to the portal and its blog and community spaces, and automatically deletes content identified as inappropriate, Naver said.
The AI behind Clova GreenEye classifies images and content in four stages -- obscene, adult, pornographic and normal -- according to the internet content rating provided by the Korea Communication Standards Commission. It compares images against millions of others it has been trained with to decide to either delete or keep an image.
After introducing the program first in 2017 for use on its own platform, the company upgraded the model to sell as a solution to other companies in 2022.
The tech giant, which leads the country's generative AI field with Hyper Clova X, is cautious about introducing image generation. Recently, the company announced an update to Hyper Clova X that enables the generative AI chatbot to recognize images and respond to user inquiries.
Naver has been developing AI image generation technology that can compete with ChatGPT's Dall-E. But it is still pondering the launch of a similar service for its chatbot.
Naver also announced the development of Clova Speech X, the voice synthesis program that can re-create voices based on voice data inputs. The company reiterated that it has only developed the technology and is not planning on launching a service based on it soon.
"When it comes to image and voice generation by AI, user safety is a bigger issue than the technology itself," a Naver official said.
"We will only consider launching services with those technologies after we come up with proper solutions to address the risks of misuse, and when we know those features are profitable businesswise."
In an effort to prevent users from falling to phishing attacks, Kakao has introduced a "fake signal" in its antiabuse system to automatically detect suspicious accounts on the KakaoTalk messenger app by analyzing account information and user history with AI and machine learning technologies.
Kakao, however, noted there are limitations to its monitoring efforts, since conversations between individuals and in open chatrooms are completely protected from the company's surveillance.
"We cannot scan all the chats to find out if individuals are sending inappropriate content to others and prevent them from sending the content in advance. That would be infringing on privacy," a Kakao official said.
"But we are aware of the seriousness of obscene content including deepfake images and working with authorities when such crimes are reported."
Kakao has been keeping a low profile in the AI sector since it absorbed the AI research team of Kakao Brain in June. In July, Kakao Brain shut down its generative AI service that created images upon the user's request.
While the closing of the AI image generation service was part of a strategy for business management, Kakao underscored it also prevented users from creating explicit content.
"We do not have plans to launch such services soon. But we do have the technology, and if we were to roll out such a service in the future, we will make sure to have filtering solutions and an antiabuse system to protect users from explicit content," the Kakao official added.
(责任编辑:产品中心)
-
How much will PCB's Champions Cup mentors be paid?
ListentoarticleThe Pakistan Cricket Board (PCB) has appointed five distinguished mentors for the upc ...[详细] -
Milan draws first blood in CL derby with Napoli
MILAN:AC Milan have the slenderest of advantages in their all-Italian Champions League quarter-final ...[详细] -
雅安日报讯在《试论思想解放与雅安开放》一文的指导下,市发改委对市情进行了再思考再认识,在认真调研的基础上,结合自身实际,进一步明确了今后发改工作的目标定位,细化了发改工作思路。通过专题学习讨论,组织业 ...[详细]
-
Fitzpatrick wins playoff with Spieth
MIAMI:England’s Matt Fitzpatrick beat defending champion Jordan Spieth in a thrilling sudden-d ...[详细] -
Webb scientists haven't found a rocky world with air. But now they have a plan.
Perhaps surprisingly, the majority of stars in the galaxy are not sunclones but smaller orbs of gas ...[详细] -
Medvedev says balance key as he adapts game for clay
LONDON:Daniil Medvedev will head into the Monte Carlo Masters hoping to strike the right balance as ...[详细] -
iPad 2017 review: Good becomes perfect at $329
Apple announced a new iPad a few weeks ago. Did you even notice? I wouldn't blame you if you missed ...[详细] -
雅安日报讯昨21)日是一年一度的“全国企业家活动日”,市企业家协会举行2011年雅安市“企业家活动日”庆典暨2010年度企业表彰大会。60余名企业家代表欢聚一堂,畅谈企业未来,共商投资环境,共话跨越发 ...[详细]
-
How do you make safe, cheap nuclear reactors? Bury them a mile deep
Startup Deep Fission has come up with a new way to deal with the economic and safety problems of nuc ...[详细] -
Instagram copies another TikTok feature with 'Remix'
Instagram's new Remix feature looks a lot like the one that made TikTok so popular. The platform lau ...[详细]
- Expanded police surveillance will get us “broken windows” on steroids.
- British billionaire to tackle Tesla for title of world's biggest battery
- Chrissy Teigen teamed up with Arthur to throw shade at John Legend's Easter outfit
- Experts call NK's satellite announcement attention
- Apple's iPhone 17 will come with a huge RAM upgrade, report claims
- 'GripTok' and the myth of the 'gorilla grip' coochie
- Instagram copies another TikTok feature with 'Remix'