Scammers use AI to create scarily convincing phishing calls

Jump to First Reply
Posted:
in iPhone

A security expert has recounted how close he came to being fooled by a new AI-based scam call that aimed to get his Gmail account details.

A smartphone screen displays the Gmail logo, a colorful M, with the word Gmail below it.
Scammers tried to gain control of a security expert's Gmail account



There were already scam ChatGPT apps on the App Store, but now artificial intelligence has been deployed by scammers in what expert Sam Mitrovic describes as "super realistic."

"People are busy and this scam sounded and looked legitimate enough that I would give them an A for their effort," wrote Mitrovic in a blog post. "Many people are likely to fall for it."

"Despite many red flags upon closer inspection, this call seemed legitimate enough to trick many people," he continued. "My guess is that their conversion rate from calls answered would be relatively high."

For Mitrovic, it began with a notification to approve a Gmail account recovery attempt. Mitrovic ignored both that and a missed call apparently from Google Sydney.

A week later, the same notification appeared and 40 minutes later, he got a call that he did answer. The seven-day gap was significant, because the caller told him that there had been suspicious activity on his account for a week.

While this polite, professional, American male voice asks if Mitrovic could have been accessing his account from overseas, the security expert is Googling the phone number the call is coming from. It's a legitimate Google number, although Mitrovic notes that numbers can be spoofed.

In this case, however, the Google number was for calls specifically regarding Google Assistant, not the Gmail account he was being asked about. So Mitrovic asks the caller to send him an email.

"He politely says he will do so and to give him a moment," continues Mitrovic. "In the background, I can hear someone typing... After a few moments, the email arrives and at first glance the email looks legit."

It isn't, though. As Mitrovic is noticing that the address is not from a Google domain, the caller said "Hello."

"I ignored it... then about 10 seconds later, [the voice] said 'Hello' again," says Mitrovic, and that's when the security expert hung up. "At this point [I realised it was] an AI voice as the pronunciation and spacing were too perfect."

"The scams are getting increasingly sophisticated, more convincing and are deployed at ever larger scale," cautions Mitrovic.

To avoid being taken in, he notes that there were several clues, starting with how he received account recovery notifications that it hadn't initiated. He also notes that Google does not phone Gmail users unless you have a Google Business Profile too.

The spoofing of a phone number and an email address is scary enough, but that the entire call was an AI voice is sobering. Ironically, it may mean that scammers employ fewer people in future, but it also means that hundreds or thousands of such calls could be being made simultaneously

Other than the AI aspect, though, phone spoofing and phishing calls are not new. Previously scammers have pretended to be from Apple Support, for instance.



Read on AppleInsider

baconstang

Comments

  • Reply 1 of 17
    rob53rob53 Posts: 3,351member
    Simple, don't answer your phone if you don't know the number. Let it go to voicemail giving you time to figure out if it's real. It wouldn't hurt if the cellular provider was able to capture suspicious phone calls sending them to the DOJ.
    williamlondonbaconstangwatto_cobra
     3Likes 0Dislikes 0Informatives
  • Reply 2 of 17
    DAalsethdaalseth Posts: 3,261member
    The Hellscape
    • AI generated art
    • AI generated text
    • AI generated movies
    • I wonder what is next

    • AI generated this
    • AI generated that
    • It all benefits no one
    • Except the rich who are getting fat

    • AI generated propaganda 
    • AI generated news
    • AI generated “facts”
    • All designed to confuse

    • The day will soon be coming
    • When nothing that you see
    • Or hear or taste or smell
    • Can be trusted unequivocally

    • Even a loved ones whispers
    • The touch of their hand in the dark
    • Will be open to be questioned
    • If it’s real or the liars art

    • And when nothing can be trusted
    • When nothing can be believed
    • Then each of us will be truly alone
    • For the fear of being deceived
    edited October 2024
    apple4thewingatorguytenthousandthingsbaconstangwatto_cobra
     5Likes 0Dislikes 0Informatives
  • Reply 3 of 17
    DAalseth said:
    The Hellscape
    • AI generated art
    • AI generated text
    • AI generated movies
    • I wonder what is next

    • AI generated this
    • AI generated that
    • It all benefits no one
    • Except the rich who are getting fat

    • AI generated propaganda 
    • AI generated news
    • AI generated “facts”
    • All designed to confuse

    • The day will soon be coming
    • When nothing that you see
    • Or hear or taste or smell
    • Can be trusted unequivocally

    • Even a loved ones whispers
    • The touch of their hand in the dark
    • Will be open to be questioned
    • If it’s real or the liars art

    • And when nothing can be trusted
    • When nothing can be believed
    • Then each of us will be truly alone
    • For the fear of being deceived
    -“Generated by AI” jkjk but if it was 🤯
    watto_cobra
     1Like 0Dislikes 0Informatives
  • Reply 4 of 17
    DAalsethdaalseth Posts: 3,261member
    DAalseth said:
    The Hellscape
    • AI generated art
    • AI generated text
    • AI generated movies
    • I wonder what is next

    • AI generated this
    • AI generated that
    • It all benefits no one
    • Except the rich who are getting fat

    • AI generated propaganda 
    • AI generated news
    • AI generated “facts”
    • All designed to confuse

    • The day will soon be coming
    • When nothing that you see
    • Or hear or taste or smell
    • Can be trusted unequivocally

    • Even a loved ones whispers
    • The touch of their hand in the dark
    • Will be open to be questioned
    • If it’s real or the liars art

    • And when nothing can be trusted
    • When nothing can be believed
    • Then each of us will be truly alone
    • For the fear of being deceived
    -“Generated by AI” jkjk but if it was ߤ怜t;/div>
    LOL, but no I wrote that myself. I admit it, I am a poet.
    edited October 2024
    apple4thewinmuthuk_vanalingamgatorguybaconstangwatto_cobra
     5Likes 0Dislikes 0Informatives
  • Reply 5 of 17
    gatorguygatorguy Posts: 24,729member
    rob53 said:
    Simple, don't answer your phone if you don't know the number. Let it go to voicemail giving you time to figure out if it's real. It wouldn't hurt if the cellular provider was able to capture suspicious phone calls sending them to the DOJ.
    If you hadn't noticed, the article says the writer confirmed the number was a Google one, but at the same time noting that numbers can be spoofed. 
     0Likes 0Dislikes 0Informatives
  • Reply 6 of 17
    DAalseth said:
    DAalseth said:
    The Hellscape
    • AI generated art
    • AI generated text
    • AI generated movies
    • I wonder what is next

    • AI generated this
    • AI generated that
    • It all benefits no one
    • Except the rich who are getting fat

    • AI generated propaganda 
    • AI generated news
    • AI generated “facts”
    • All designed to confuse

    • The day will soon be coming
    • When nothing that you see
    • Or hear or taste or smell
    • Can be trusted unequivocally

    • Even a loved ones whispers
    • The touch of their hand in the dark
    • Will be open to be questioned
    • If it’s real or the liars art

    • And when nothing can be trusted
    • When nothing can be believed
    • Then each of us will be truly alone
    • For the fear of being deceived
    -“Generated by AI” jkjk but if it was ߤ怜t;/div>
    LOL, but no I wrote that myself. I admit it, I am a poet.
    I give my stamp of approval 🫡
    watto_cobra
     1Like 0Dislikes 0Informatives
  • Reply 7 of 17
    Xedxed Posts: 3,109member
    rob53 said:
    Simple, don't answer your phone if you don't know the number. Let it go to voicemail giving you time to figure out if it's real. It wouldn't hurt if the cellular provider was able to capture suspicious phone calls sending them to the DOJ.
    As GG noted from the article, numbers can be spoofed, but there are times when you also may need to take a call from an unknown number. I've recently had to do this to deal with an ongoing tech support issue. The numbers, voices, and person's would all be unknown to me. If I had a situation where the info about me needing tech support was known to scammers through another avenue I could've easily been talked into giving up personal info.

    But even If it's a number and voice you recognize, that's not going to be enough. Perhaps we need to setup challenge questions to verify the communication with friends and family.
    williamlondonwatto_cobra
     2Likes 0Dislikes 0Informatives
  • Reply 8 of 17
    mike1mike1 Posts: 3,474member
    The difference is that you were expecting phone calls in regards to your tech support issue. They didn't come out of the blue.
    baconstangwatto_cobra
     2Likes 0Dislikes 0Informatives
  • Reply 9 of 17
    Xedxed Posts: 3,109member
    mike1 said:
    The difference is that you were expecting phone calls in regards to your tech support issue. They didn't come out of the blue.
    Have you never had a phishing email before? These scammers don't need to know that I have, say, a Hulu account or expecting a package from UPS. They simply need to send out the same message to enough people and statistically there will be be someone that has such an account, and a smaller subset within those with accounts will be having an issue and possibly be expecting correspondence, but that smaller subset won't be zero.

    But all of that is just the "throw shit at the wall and see what sticks" method. If you are targeted because other info has been gleaned, like if I posted on a website that I need assistance with something or was simply complaining about it in detail on a forum, and then that username was connected to other accounts which lead to personal info I could be targeted. I doubt your Mike1 username is as anonymous as you think it is. Even just a bug in the forum system that could lead your IP address to a location could be used to find enough information about you to target you.

    But I digress since most attacks aren't yet that sophisticated, but they don't need to be with the phishing method being being such a passive way to attack people with little effort, but advancements in AI will continue to make these methods harder to detect.
    edited October 2024
    watto_cobra
     1Like 0Dislikes 0Informatives
  • Reply 10 of 17
    I hope Jim Browning (https://m.youtube.com/@JimBrowning) does a video on this. I’ve found his work very informative and helpful. He almost got scammed himself a few years ago: https://youtu.be/YIWV5fSaUB8?feature=shared

    sobering stuff!
    watto_cobra
     1Like 0Dislikes 0Informatives
  • Reply 11 of 17
    rob53rob53 Posts: 3,351member
    gatorguy said:
    rob53 said:
    Simple, don't answer your phone if you don't know the number. Let it go to voicemail giving you time to figure out if it's real. It wouldn't hurt if the cellular provider was able to capture suspicious phone calls sending them to the DOJ.
    If you hadn't noticed, the article says the writer confirmed the number was a Google one, but at the same time noting that numbers can be spoofed. 
    My iPhone doesn’t identify the phone number as being from Google so I still wouldn’t answer it. I don’t actively deal with Google so I wouldn’t call that number back, I might call the main Google customer support number or simply ignore the call. 
    baconstangwatto_cobra
     2Likes 0Dislikes 0Informatives
  • Reply 12 of 17
    gatorguygatorguy Posts: 24,729member
    rob53 said:
    gatorguy said:
    rob53 said:
    Simple, don't answer your phone if you don't know the number. Let it go to voicemail giving you time to figure out if it's real. It wouldn't hurt if the cellular provider was able to capture suspicious phone calls sending them to the DOJ.
    If you hadn't noticed, the article says the writer confirmed the number was a Google one, but at the same time noting that numbers can be spoofed. 
    My iPhone doesn’t identify the phone number as being from Google so I still wouldn’t answer it. I don’t actively deal with Google so I wouldn’t call that number back, I might call the main Google customer support number or simply ignore the call. 
    What if they identified as Apple? The same scam would work for a subset of victims wouldn't it, and be a call you might answer? Or would you ignore a call presumably from Apple too after receiving an earlier email presumably from them? That's what convinced Sam Mitrovic it was probably legit. 


    edited October 2024
     0Likes 0Dislikes 0Informatives
  • Reply 13 of 17
    M68000m68000 Posts: 933member
    The “spoofing” of phone numbers has got to stop.  The telecom industry and phone makers need to tackle and fix that once and for all. 
    baconstangwatto_cobra
     2Likes 0Dislikes 0Informatives
  • Reply 14 of 17
    Simple. Don’t give anyone your number. That way any calls, are phishing calls. If a service you need, needs a number to validate, get a burner number (e.g. VoIP, e-SIM) and enable only when needed. Slightly inconvenient, but surprisingly workable.
    edited October 2024
    watto_cobra
     1Like 0Dislikes 0Informatives
  • Reply 15 of 17
    mattinozmattinoz Posts: 2,605member
    I thought this was already a thing but then again an AI would not get frustrated enough for swearing and racism.
    watto_cobra
     1Like 0Dislikes 0Informatives
  • Reply 16 of 17
    DAalseth said:
    The Hellscape
    • AI generated art
    • AI generated text
    • AI generated movies
    • I wonder what is next

    • AI generated this
    • AI generated that
    • It all benefits no one
    • Except the rich who are getting fat

    • AI generated propaganda 
    • AI generated news
    • AI generated “facts”
    • All designed to confuse

    • The day will soon be coming
    • When nothing that you see
    • Or hear or taste or smell
    • Can be trusted unequivocally

    • Even a loved ones whispers
    • The touch of their hand in the dark
    • Will be open to be questioned
    • If it’s real or the liars art

    • And when nothing can be trusted
    • When nothing can be believed
    • Then each of us will be truly alone
    • For the fear of being deceived
    And the very same folks that believe that will thank their frakkin’ stars when the AI image analyzer and other AI health tools spot their cancer soon enough to treat with an AI developed treatment that will be put us within reach of eradicating the disease.

    Just about all the things mentioned in that poem’s existential dread has existed for as long as humanity has. The only things that have changed are speed and quantity. 

    There are multiple stories that will unfold with the advent of better AI models and algorithms. Some dark, some light, much grey. Just like every other major shift in technology.

    So, before running off to burn your local heretics, maybe take a breather and consider the history of humanity and technology. It’s been neither Utopia nor Hell. Just a mixed bag that most of us would find difficult to live outside of, within a range. 

    So cut it out with the alarmist crap propaganda (the awful poem).

    Insider’s article raises some interesting points. Let’s all please be knowledgeable — not afraid. 
    edited October 2024
     0Likes 0Dislikes 0Informatives
  • Reply 17 of 17
    DAalseth said:
    The Hellscape
    • AI generated art
    • AI generated text
    • AI generated movies
    • I wonder what is next

    • AI generated this
    • AI generated that
    • It all benefits no one
    • Except the rich who are getting fat

    • AI generated propaganda 
    • AI generated news
    • AI generated “facts”
    • All designed to confuse

    • The day will soon be coming
    • When nothing that you see
    • Or hear or taste or smell
    • Can be trusted unequivocally

    • Even a loved ones whispers
    • The touch of their hand in the dark
    • Will be open to be questioned
    • If it’s real or the liars art

    • And when nothing can be trusted
    • When nothing can be believed
    • Then each of us will be truly alone
    • For the fear of being deceived
    And the very same folks that believe that will thank their frakkin’ stars when the AI image analyzer and other AI health tools spot their cancer soon enough to treat with an AI developed treatment that will be put us within reach of eradicating the disease.

    Just about all the things mentioned in that poem’s existential dread has existed for as long as humanity has. The only things that have changed are speed and quantity. 

    There are multiple stories that will unfold with the advent of better AI models and algorithms. Some dark, some light, much grey. Just like every other major shift in technology.

    So, before running off to burn your local heretics, maybe take a breather and consider the history of humanity and technology. It’s been neither Utopia nor Hell. Just a mixed bag that most of us would find difficult to live outside of, within a range. 

    So cut it out with the alarmist crap propaganda (the awful poem).

    Insider’s article raises some interesting points. Let’s all please be knowledgeable — not afraid. 
    Like with anything it is about who is in control and their purpose for it. After-all, you can have truth in your hand but you can use it to inform others or twist it and make them believe a lie.
     0Likes 0Dislikes 0Informatives
Sign In or Register to comment.