How to break the trick of using AI face-changing to defraud people?

With the continuous advancement of technology

AI application scenarios are becoming more and more diverse

"One-click face change" to take photos with your favorite idols

Uncle turns into a lolita sister in seconds through AI technology

"AI Stefanie Sun" became popular as soon as it debuted

…

AI was once very far away from us

Now it is rapidly entering the lives of the general public

It should be noted that

Scammers are also targeting AI technology

Use it to play "True and False Monkey King"

The person you are video chatting with may not be me

recently

Baotou police released a typical case of using AI to commit telecommunications fraud

A friend suddenly called me via video

Mr. Guo from Fuzhou was still deceived after confirming his appearance and voice

4.3 million yuan was defrauded in 10 minutes

It turned out that the scammer used intelligent AI face-changing and voice-onomatopoeia technology

Pretending to be a friend, he cheated

Fortunately

After receiving the alarm, the police and banks in Fuzhou and Baotou quickly activated the payment stop mechanism

Successfully stopped payment of 3.3684 million yuan

After the case was disclosed

The topic #AI fraud is breaking out across the country# became a hot search

Aroused widespread attention from netizens

Common AI fraud tactics

How to prevent AI scams

So is there no way to deal with AI face-changing scams?

In the AI ​​era, what you see and hear is not necessarily true, which greatly increases the deception. Using AI technology, coupled with routines and scripts, such fraudulent means, friends must hold on.

Fraud is always so cunning, but prevention is always so adventurous.

Supervision must be put in place first to prevent AI from “wild growth”

What needs to be clarified is that although AI face-changing is a new thing, there is no "regulatory gap" or "no law to rely on".

In response to AI fraud incidents with increasingly updated technical means, on November 25, 2022, the Cyberspace Administration of China, the Ministry of Industry and Information Technology, and the Ministry of Public Security jointly issued the "Regulations on the Management of Deep Synthesis of Internet Information Services" (hereinafter referred to as the Regulations), which will come into effect on January 10, 2023. The Regulations require that providers of deep synthesis services should add logos that do not affect the use of information content generated or edited using their services. Services that generate or significantly change the functions of information content, such as intelligent dialogue, synthetic voices, face generation, and immersive simulation scenes, should be prominently marked to avoid public confusion or misunderstanding. It is required that no organization or individual shall use technical means to delete, tamper with, or conceal relevant logos.

On April 11 this year, the Cyberspace Administration of China drafted the "Regulations on the Management of Generative Artificial Intelligence Services" (draft for comments), proposing that AI content must be true and accurate. It also clearly mentioned that it is prohibited to illegally obtain, disclose, and use personal information, privacy, and business secrets.

【Kind tips】

The use of AI "face-changing" and similar software is extremely risky and is accompanied by legal risks and infringement disputes. Even if "AI face-changing technology" is only used for fun or to make spoof photos, it may involve infringement of portrait rights and reputation rights. If serious consequences are caused, it may also constitute the crime of insult or defamation. I hope that everyone will use this technology in accordance with the law. Once you encounter a crime similar to the one in this case using "AI face-changing technology", you should immediately fix the evidence and report it to the judicial authorities in a timely manner.

Planning: Cheng Liwei

Text: Lian Yuxin

Graphics: Yuan Yu (except comics)

Reference materials: WeChat account of the Cyber ​​Security Bureau of the Ministry of Public Security, Xinhua News Agency, People's Daily, Guangming Daily, Southeast Net, etc.