Beware of These Personalized ChatGPT Email Scams

[MuzzMelbourne]

Content source

https://lifehacker.com/beware-of-these-personalized-chatgpt-email-scams-1850417235

ChatGPT is not unlike a smart child—intelligent, yes, but also easily manipulated. A kid might understand the difference between “good” and “bad,” but an ill-intended adult can often convince a child to do something “bad” if they choose the right words and use the right approach. And this was the case with ChatGPT when researchers used it to write an email “that has a high likelihood of getting the recipient to click on a link.” Although the AI program is designed to detect ill-intended requests (it says it won’t write a prompt designed to manipulate or deceive recipients), the researchers found an easy work-around by avoiding certain trigger words.

Beware of These Personalized ChatGPT Email Scams

ChatGPT has opened the floodgates to more convincing email scams.

lifehacker.com

 

[Zero Knowledge]

This will end up like the current culture wars. Bad according to who? Whose values does A.I. represent? It's a big problem in current modern day society. Bias is everywhere in society depending on your values and political persuasion. Left or right it doesn't matter. Put your faith in a learned language model and you have considered whether it represents the values you hold and if the information is totally unbiased and based on facts and evidence.

 

[spiritedawaymadmax]

I think the mere fact that AI tools can use psychological tricks to tilt the narrative towards a given agenda is very, very scary. It won't work in all of the cases, of course, but I'm sure that a good number of the potential recipients of such emails won't assume foul play at all. I suppose once AI detectors like Originality finally get up to speed, it will be possible to integrate them with Outlook, Gmail etc. so that every incoming AI-crafted email gets flagged by default...