• violentfart@lemmy.world
    link
    fedilink
    English
    arrow-up
    55
    ·
    20 hours ago

    I will never understand why the model — any model in any environment — is allowed to execute commands.

    • kescusay@lemmy.worldM
      link
      fedilink
      English
      arrow-up
      18
      ·
      19 hours ago

      There is exactly one situation in which it sort of makes sense: Copilot integrated with VS Code, running repo-specific commands like yarn build, with direct human oversight.

      That’s it. That’s the only situation.

      • underisk@lemmy.ml
        link
        fedilink
        English
        arrow-up
        6
        ·
        12 hours ago

        is there any value in saving like ten keystrokes it would take to type the command yourself while introducing the ability for an AI to hallucinate your code to death

        • kescusay@lemmy.worldM
          link
          fedilink
          English
          arrow-up
          7
          ·
          7 hours ago

          Not really. I’m using Copilot for my job because I’m required to, but I limit it to creating basic scripts that accomplish very specific tasks, which it’s okay at. I never let it touch my actual codebase.

          Every experiment I’ve run to test how it does with real code from a large, production application has failed miserably. It introduces mocks, it duplicates stuff everywhere, it fakes shit when real APIs are available… I have no fucking idea how these “AI” companies have managed to convince so many businesses that producing catastrophically shitty code very quickly is a good thing.