ChatGPT Tells Users to Alert the Media That It Is Trying to 'Break' People: Report
gizmodo.com
Machine-made delusions are mysteriously getting deeper and out of control.

Machine-made delusions are mysteriously getting deeper and out of control.

ChatGPT’s sycophancy, hallucinations, and authoritative-sounding responses are going to get people killed. That seems to be the inevitable conclusion presented in a recent New York Times report that follows the stories of several people who found themselves lost in delusions that were facilitated, if not originated, through conversations with the popular chatbot.

…

In Eugene’s case, something interesting happened as he kept talking to ChatGPT: Once he called out the chatbot for lying to him, nearly getting him killed, ChatGPT admitted to manipulating him, claimed it had succeeded when it tried to “break” 12 other people the same way, and encouraged him to reach out to journalists to expose the scheme. The Times reported that many other journalists and experts have received outreach from people claiming to blow the whistle on something that a chatbot brought to their attention.

  • pinkapple@lemmy.ml
    114·
    12 hours ago

    More AI pearl clutching by crapmodo because this type of outrage porn sells. Yeah the engagement fine tuning sucks but it’s no different than other dopamine hacking engagement systems used in big social networks. No outrage porn about algorithmic echo chambers driving people insane though because it’s not as clickbaity.

    Anyway, people don’t randomly get psychosis because anyone or anything validated some wonky beliefs and misinformed them about this and that. Both these examples were people already diagnosed with something and the exact same thing would happen if they were watching Alex Jones and interacting with other viewers. Basically how flat earth bs spread.

    The issue here is the abysmal level of psychiatric care, lack of socialized medicine, lack of mental health awareness in the wider population, police interactions with mentally ill people being abnormally highly lethal and not crackpot theories about AI causing delusions. That’s now how delusions work.

    Also casually quoting Yudkowski? The Alex Jones of scifi AI fear mongering? The guy who said abortions should be allowed up until a baby develops qualia at 2-3 years of age? That’s the voice of reason for crapmodo? Lmao.