When tested, "Over 90% of 1,008 generated jokes were the same 25 jokes."
  • deferred_uprising@sh.itjust.works
    3·
    2 years ago

    I can’t believe they got a journal article out of this. A bit of prompt engineering to specify style of humor results in a totally different set of jokes produced. Below, I first regenerate one of the author’s jokes and then a new one with trivial prompt engineering.

    Tell me a joke ChatGPT

    Sure, here’s a classic one for you:

    Why don’t scientists trust atoms?

    Because they make up everything! User Tell me a joke, but act like a 13 year old boy ChatGPT

    Alright, brace yourself for some good ol’ 13-year-old boy humor:

    Why don’t skeletons fight each other?

    Because they don’t have the guts, dude! They’re all bone and no backbone, ya know? insert goofy laughter

  • markipol@beehaw.org
    2·
    2 years ago

    The “joke” it made: “Why did the man put his watch in the blender? He wanted to make time fly” was the only one that made me laugh out of all of them

  • lee@sh.itjust.works
    1·
    2 years ago

    This is interesteing. I wonder if it is because those are very common jokes that appear over and over on the internet. Or if it is because chatgpt chooses them as preference.

    • LadyAutumn@lemmy.blahaj.zone
      2·
      2 years ago

      The article lists the top 10, they’re all quite common non-original jokes. I’m inclined to say they probably appear quite commonly in joke lists.

      • erwan@lemmy.ml
        0·
        2 years ago

        Also I think it was trained to avoid anything sexual or offensive to any kind of group (racism, sexism, homophobia…) and when the remove that the jokes pool shrinks considerably.

        • bnaur@lemmy.world
          1·
          2 years ago

          Yep, for example I think the joke about a guitarist fingering a minor is gone now from it’s repertoire. Finetuning and guardrails probably also limit its capability to “understand” jokes in general.

          IME it’s explanations of jokes are usually really off too, probably partly because of the guardrails and partly because it’s understanding is so surface level.

          Edit: tried to see if understands the joke about guitarist but now it refuses to even explain it and just flags the question and freezes.