• TurnItOff_OnAgain@lemmy.world
    link
    fedilink
    English
    arrow-up
    20
    ·
    1 year ago

    Oof. I’ve tried it with a few Powershell things and it has recommended cmdlets that don’t exist, parameters that don’t exist, or the wrong usage of cmdlets.

    • FMT99@lemmy.world
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      1
      ·
      1 year ago

      It’s really limited to basic, junior level programming assistance, and even then it’s not 100% reliable. Any time I’ve tried asking it something more advanced it takes a lot of coaxing to get it to output reasonable code. But it’s helpful for boilerplating basic code sometimes.

    • CharlestonChewbacca@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      arrow-down
      1
      ·
      1 year ago

      Have you tried 3.5 or 4?

      I haven’t had many issues in 4. Occasionally it does what you’re saying and I just say “bro, that doesn’t exist” and it’s like “oh, my bad, here you go.” And gives me something that works.

        • CharlestonChewbacca@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          2
          ·
          1 year ago

          Well don’t expect it to just give magical results without learning prompt engineering and understanding the tools you’re working with.

          • TurnItOff_OnAgain@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            ·
            1 year ago

            Set-MailboxAddressBook doesn’t exist.

            Set-ADAttribute doesn’t exist.

            Asking for a simple command and expecting to receive something that actually exists is magical?

      • zero_spelled_with_an_ecks@programming.dev
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        1
        ·
        1 year ago

        Just yesterday I had 4 make up a Jinja filter that didn’t exist. I told it that and it returned something new that also didn’t work but had the same basic form. 4 sucks now for anything that I’d like to be accurate.

      • radau@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        1
        ·
        edit-2
        1 year ago

        I used gpt4 for terraform and it was kind of all over the place in terms of fully deprecated methods. It felt like a nice jumping off point but honestly probably would’ve been less work to just write it up from the docs in the first place.

        I can definitely see how it could help someone fumble through it and come up with something working without knowing what to look for though.

        Was also having weird issues with it truncating outputs and needing to split it, but even telling it to split would cause it to kind of stall.