Machine-made delusions are mysteriously getting deeper and out of control.

ChatGPT’s sycophancy, hallucinations, and authoritative-sounding responses are going to get people killed. That seems to be the inevitable conclusion presented in a recent New York Times report that follows the stories of several people who found themselves lost in delusions that were facilitated, if not originated, through conversations with the popular chatbot.

In Eugene’s case, something interesting happened as he kept talking to ChatGPT: Once he called out the chatbot for lying to him, nearly getting him killed, ChatGPT admitted to manipulating him, claimed it had succeeded when it tried to “break” 12 other people the same way, and encouraged him to reach out to journalists to expose the scheme. The Times reported that many other journalists and experts have received outreach from people claiming to blow the whistle on something that a chatbot brought to their attention.

  • MountingSuspicion@reddthat.com
    link
    fedilink
    arrow-up
    1
    ·
    24 hours ago

    It literally is not. ChatGpt has a blank page (a la google homepage) that says “What can I help you with?” And the input field says “Ask anything”. If it said “Use this text field to play pretend” it would be at least a little better.

    Thinking everything you see online is fake is bad advice. Being skeptical is important but the internet isn’t all just fake.

    There is a good place to regulate it. At the input and output level. It already is regulated there. It has guardrails already. Public data AI may be more ethical, but it is not going to solve the issue. The issue is the way people are using AI and the output it produces. It seems like you might not be wholly familiar with this subject.

    • AugustWest@lemm.ee
      link
      fedilink
      English
      arrow-up
      1
      ·
      23 hours ago

      I am very familiar with this. And chatgpt says right on the page: this makes mistakes, check the answer.

      Everything you see online should be considered fake. Yes. Everyone should be considered a liar. That is internet 101 from way back.

      I am telling you, ask for regulations to cover the idiots and you will not get what you are looking for.

      • MountingSuspicion@reddthat.com
        link
        fedilink
        arrow-up
        1
        ·
        23 hours ago

        My page does not say that. It’s possible that in your country, which I’m guessing is different from my country seeing as you stated guns are illegal, they already have this legislation in place. That is not the case here.

        • AugustWest@lemm.ee
          link
          fedilink
          English
          arrow-up
          1
          ·
          23 hours ago

          A quick VPN connection to a few countries and the US and I see it everytime. I wonder why you don’t?

          • MountingSuspicion@reddthat.com
            link
            fedilink
            arrow-up
            1
            ·
            23 hours ago

            I don’t see it regardless. Are you logged in? It’s possible that if your account lists your country that they just set it to always appear? I’m unfortunately not sure, but having that notice would be a huge improvement imho.