• jonne@infosec.pub
    link
    fedilink
    arrow-up
    20
    ·
    1 month ago

    Yeah, it’s probably more important to make sure we don’t have child porn generation machines available to anyone online.

      • jonne@infosec.pub
        link
        fedilink
        arrow-up
        11
        ·
        1 month ago

        I think training your own image generator on existing child porn is probably beyond most high schoolers. I’d be happy if at least commercial options were held responsible for distributing generated CP, which is already illegal BTW.

        • cygnus@lemmy.ca
          link
          fedilink
          arrow-up
          13
          ·
          1 month ago

          I don’t think the models are trained on CP. They’re likely trained on widely-available porn.

          • zurohki@aussie.zone
            link
            fedilink
            English
            arrow-up
            8
            ·
            1 month ago

            This. If you ask an image generator for a bed in the shape of a pineapple, it probably has no pineapple-shaped beds in its training data but it has pineapples and beds and can mash the concepts together.

          • Onihikage@beehaw.org
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 month ago

            Technically, any model trained on LAION-5B before December 2023 was trained on CSAM.

            But yeah, I expect any porn model trained on a sufficient diversity of adult actors could be used to make convincing CP even without having it in the training data. AI image generation is basically the digital equivalent of a chainsaw - a tool for a particular messy job that can really hurt people if used incorrectly. You wouldn’t let a typical kid run around unattended with one, that’s for sure.

            • cygnus@lemmy.ca
              link
              fedilink
              arrow-up
              2
              ·
              1 month ago

              I expect any porn model trained on a sufficient diversity of adult actors could be used to make convincing CP even without having it in the training data.

              I know I’m wading into the danger zone here, but let’s also remember we’re talking about teenagers. A (for example) 15 year old’s body type will be closer to an 18 year old’s than a 5 year old’s, so the perfectly legal porn model would work just fine for that, uh, purpose.

    • mozz@mbin.grits.dev
      link
      fedilink
      arrow-up
      3
      ·
      edit-2
      1 month ago

      Good luck with that

      I mean you can do a significant amount by making it illegal to offer it on the open web, which might be the way to go, but creating awesome things that can be had once you go outside the law actually carries its own little long-term consequences