The new Snapchat My AI tool is seriously creeping users out – here's why

Snapchat
(Image credit: Snapchat/Future)

If last year was all about NFTs, this is definitely the year of AI. From terrifyingly impressive text-to-image generators to ChatGPT, AI is everywhere right now – including, as of this week, right at the top of your Snapchat app.

Yep, users are discovered that the app's new 'My AI' feature is being displayed rather prominently in the UI. The tool, which essentially acts like a ChatGPT bot, sits right at the top of the app, and it's fair to say not everyone is loving it. (Still, at least it isn't quite as horrifying as that AI-generated video of Will Smith eating spaghetti.) 

See more

My AI first launched to Snapchat Plus subscribers earlier this year, but it's now been rolled out to general users. And like when Instagram temporarily foisted full-screen videos on users, there seems to be a general sense of "We didn't ask for this" online.

"I don’t want to. I want it gone. Remove it," one user comments on Snapchat's tweet announcing the feature, while another adds, "Can we have the option to delete it? Asking for the majority of us who didn’t request this feature." Another says, "Snapchat needs to make the AI feature optional and require an Opt-In. When I made my account, I didn't agree to AI technology being forced upon me. People have a right to make choices about their account security. Every other feature is an opt-in." The unwelcome addition has even led to Snapchat getting review-bombed, with users flooding the Apple App Store and Google Play store with 1-star reviews. 

One of the creepiest and most controversial aspects of My AI is that it appears to know the users' location – despite its protestations to the contrary. Apps using location data isn't anything particularly, but what's weird is that the chat bot seems keen to insist that it doesn't. Indeed, Twitter is filled with examples of My AI offering location-based recommendations while claiming not to know where the user is based, when the user has location-based services disabled:

See more
See more

As if the location issue wasn't enough, Snapchat's decision to place the feature front-and-centre in the UI seems to be particularly rankling users. And just like that, we have yet another AI-based controversy to contend with, joining the likes of this AI pizza ad and that terrifying South Park deepfake.

Thank you for reading 5 articles this month* Join now for unlimited access

Enjoy your first month for just £1 / $1 / €1

*Read 5 free articles per month without a subscription

Join now for unlimited access

Try first month for just £1 / $1 / €1

Daniel John
Senior News Editor

Daniel John is Senior News Editor at Creative Bloq. He reports on the worlds of art, design, branding and lifestyle tech (which often translates to tech made by Apple). He joined in 2020 after working in copywriting and digital marketing with brands including ITV, NBC, Channel 4 and more.