South Korean authorities are intensifying their efforts to tackle the growing prevalence of deepfake videos, especially those containing explicit material aimed at women and teenagers.
The Seoul Metropolitan Police have launched an investigation into Telegram following public and political outcry over the platform’s alleged negligence in allowing deepfake pornography to circulate.
The number of deepfake sex crimes has surged from 156 cases in 2021 to 297 cases this year, prompting the government to take stringent actions to address the issue.
Probing Telegram
The probe on Telegram was initiated after the discovery of eight automated programs producing deepfake pornography on the platform. Over 88 complaints relating to deepfake-related sex crimes were lodged with the police within a short period.
Despite requests, Telegram has refused to provide essential information, hindering the police from holding the perpetrators accountable. In response, South Korea is collaborating with French authorities to address online crimes, following the arrest of Telegram’s CEO, Pavel Durov.
Enhanced Victim Support
The South Korean government is implementing measures to aid victims and bolster regulatory supervision. This includes setting up a 24-hour hotline for deepfake content victims, and expanding the team monitoring digital sex crimes from 70 personnel.
The Korean National Police Agency is embarking on a seven-month initiative to bolster efforts against online sex crimes, creating a consultative group for better coordination with social media platforms in removing harmful content.
Authorities urge Telegram and other social media networks to cooperate in swiftly removing sexually explicit deepfake content to uphold individual dignity and personal rights. While Telegram claims to have employed AI tools and user reports to take down harmful content, its response to digital sex crimes has drawn criticism.
The prevalence of deepfake pornography in South Korea, predominantly affecting young women, students, and military personnel, has raised significant concerns, with over 6,400 requests made this year to remove explicit deepfake material.
Featured image from ABC News, chart from TradingView