After being scammed into thinking her daughter was kidnapped, an Arizona woman testified in the US Senate about the dangers side of artificial intelligence technology when in the hands of criminals.
Jennifer DeStefano told the Senate judiciary committee about the fear she felt when she received an ominous phone call on a Friday last April.
Thinking the unknown number was a doctorâs office, she answered the phone just before 5pm on the final ring. On the other end of the line was her 15-year-old daughter â or at least what sounded exactly like her daughterâs voice.
âOn the other end was our daughter Briana sobbing and crying saying âMomâ.â
Briana was on a ski trip when the incident took place so DeStefano assumed she injured herself and was calling let her know.
DeStefano heard the voice of her daughter and recreated the interaction for her audience: ââMom, I messed upâ with more crying and sobbing. Not thinking twice, I asked her again, âOK, what happened?ââ
She continued: âSuddenly a manâs voice barked at her to âlay down and put your head backâ.â
Panic immediately set in and DeStefano said she then demanded to know what was happening.
âNothing could have prepared me for her response,â Defano said.
Defano said she heard her daughter say: ââMom these bad men have me. Help me! Help me!â She begged and pleaded as the phone was taken from her.â
âListen here, I have your daughter. You tell anyone, you call the cops, I am going to pump her stomach so full of drugs,â a man on the line then said to DeStefano.
The man then told DeStefano he âwould have his wayâ with her daughter and drop her off in Mexico, and that sheâd never see her again.
At the time of the phone call, DeStefano was at her other daughter Aubreyâs dance rehearsal. She put the phone on mute and screamed for help, which captured the attention of nearby parents who called 911 for her.
DeStefano negotiated with the fake kidnappers until police arrived. At first, they set the ransom at $1m and then lowered it to $50,000 when DeStefano told them such a high price was impossible.
She asked for a routing number and wiring instructions but the man refused that method because it could be âtracedâ and demanded cash instead.
DeStefano said she was told that she would be picked up in a white van with bag over her head so that she wouldnât know where she was going.
She said he told her: âIf I didnât have all the money, then we were both going to be dead.â
But another parent with her informed her police were aware of AI scams like these. DeStefano then made contact with her actual daughter and husband, who confirmed repeatedly that they were fine.
âAt that point, I hung up and collapsed to the floor in tears of relief,â DeStefano said.
When DeStefano tried to file a police report after the ordeal, she was dismissed and told this was a âprank callâ.
A survey by McAfee, a computer security software company, found that 70% of people said they werenât confident they could tell the difference between a cloned voice and the real thing. McAfee also said it takes only three seconds of audio to replicate a personâs voice.
DeStefano urged lawmakers to act in order prevent scams like these from hurting other people.
She said: âIf left uncontrolled, unregulated, and we are left unprotected without consequence, it will rewrite our understanding and perception what is and what is not truth. It will erode our sense of âfamiliarâ as it corrodes our confidence in what is real and what is not.â
Horrible.
But regulation will not solve this, because criminals obviously donât give a fuck about the law. So they would end up being the only ones using AI.
Thatâs the same story as outlawing E2EE chat for the sake of making it possible for law enforcement to read them again. That also doesnât work against real criminals who simply ignore the law and use E2EE nonetheless.
We can punish its use for these purposes though. Driving cars is legal, but using them for street racing is not.
For that matter, there could be a law that getting caught using E2EE for criminal activity also carries extra charges.
In both cases the police might have to do some actual policing though.