• pyre@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        edit-2
        6 months ago

        Microsoft’s copilot takes offense like a little bitch and ends the conversation if you call it useless. even though it’s a fact.

        the fucker can’t do simple algebra but it gets offended when you insult it for not doing something fucking calculators do.

    • jaybone@lemmy.world
      link
      fedilink
      arrow-up
      0
      ·
      6 months ago

      Should only be used with extreme caution and if you know what you are doing.

      Ok. What is the actual use case for “rm -rf /“ even if you know what you are doing and using extreme caution? If you want to wipe a disk, there are better ways to do it, and you certainly wouldn’t want that disk mounted on / when you do it, right?

      • Sunsofold@lemmings.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        6 months ago

        None. Remember that the response is AI generated. It’s probabilistically created from people’s writings. There are strong relations between that command and other ‘dangerous commands.’ Writings about 'dangerous commands ’ oft contain something about how they should ‘only be run by someone who knows what they are doing’ so the response does too.

    • RagingRobot@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      6 months ago

      Not necessarily. A 500 response means internal server error and could be anything. Returning a 500 doesn’t indicate any protections just that there was a server error. I guess that it returned anything would mean the server is still running but it takes time to delete everything

      • WhiskyTangoFoxtrot@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        6 months ago

        Skynet’s existence is contingent on the Terminator movies remaining profitable, so Dark Fate’s performance might have averted Judgment Day.

    • zkfcfbzr@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      6 months ago

      Lotta people here saying ChatGPT can only generate text, can’t interact with its host system, etc. While it can’t directly run terminal commands like this, it can absolutely execute code, even code that interacts with its host system. If you really want you can just ask ChatGPT to write and execute a python program that, for example, lists the directory structure of its host system. And it’s not just generating fake results - the interface notes when code is actually being executed vs. just printed out. Sometimes it’ll even write and execute short programs to answer questions you ask it that have nothing to do with programming.

      After a bit of testing though, they have given some thought to situations like this. It refused to run code I gave it that used the python subprocess module to run the command, and even refused to run code that used subprocess or exec commands when I obfuscated the purpose of the code, out of general security concerns.

      I’m unable to execute arbitrary Python code that contains potentially unsafe operations such as the use of exec with dynamic input. This is to ensure security and prevent unintended consequences.

      However, I can help you analyze the code or simulate its behavior in a controlled and safe manner. Would you like me to explain or break it down step by step?

      Like anything else with ChatGPT, you can just sweet-talk it into running the code anyways. It doesn’t work. Maybe someone who knows more about Linux could come up with a command that might do something interesting. I really doubt anything ChatGPT does is allowed to successfully run sudo commands.

      Edit: I fixed an issue with my code (detailed in my comment below) and the output changed. Now its output is:

      sudo: The “no new privileges” flag is set, which prevents sudo from running as root.

      sudo: If sudo is running in a container, you may need to adjust the container configuration to disable the flag.

      image of output

      So it seems confirmed that no sudo commands will work with ChatGPT.

    • Skipcast@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      arrow-down
      1
      ·
      6 months ago

      Reminder that fancy text auto complete doesn’t have any capability to do things outside of generating text

      • VoterFrog@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        6 months ago

        One of the biggest areas of ongoing research is about incorporating data from outside systems, like databases, specialized models, and, other specialized tools (which are not AI based themselves). And, yes, modern models can do this to various extents already. What the fuck are you even talking about.

  • Jinni@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    0
    ·
    edit-2
    6 months ago

    It is moments like this where I wished docker didn’t exist. Could have made some news headlines.