• Lyrl@lemmy.dbzer0.com
    link
    fedilink
    arrow-up
    4
    ·
    4 hours ago

    I hope the AI-chat companies really get a handle on this. They are making helpful sounding noises, but it’s hard to know how much they are prioritizing it.

    OpenAI has acknowledged that its existing guardrails work well in shorter conversations, but that they may become unreliable in lengthy interactions… The company also announced on Tuesday that it will try to improve the way ChatGPT responds to users exhibiting signs of “acute distress” by routing conversations showing such moments to its reasoning models, which the company says follow and apply safety guidelines more consistently.

    • fullsquare@awful.systems
      link
      fedilink
      arrow-up
      7
      ·
      4 hours ago

      lol nope they can’t do that because “guardrails” aren’t anywhere near reliable, and they won’t because it would cut into their profits userbase numbers, based on which they raise vc money. delusional chatbot user is just a recurrent subscriber