OpenAI now tries to hide that ChatGPT was trained on copyrighted books, including J.K. Rowling’s Harry Potter series::A new research paper laid out ways in which AI developers should try and avoid showing LLMs have been trained on copyrighted material.

  • Blapoo@lemmy.ml
    link
    fedilink
    English
    arrow-up
    102
    arrow-down
    11
    ·
    1 year ago

    We have to distinguish between LLMs

    • Trained on copyrighted material and
    • Outputting copyrighted material

    They are not one and the same

    • Even_Adder@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      37
      arrow-down
      9
      ·
      1 year ago

      Yeah, this headline is trying to make it seem like training on copyrighted material is or should be wrong.

      • scv@discuss.online
        link
        fedilink
        English
        arrow-up
        28
        arrow-down
        3
        ·
        1 year ago

        Legally the output of the training could be considered a derived work. We treat brains differently here, that’s all.

        I think the current intellectual property system makes no sense and AI is revealing that fact.

      • TropicalDingdong@lemmy.world
        link
        fedilink
        English
        arrow-up
        14
        arrow-down
        11
        ·
        1 year ago

        I think this brings up broader questions about the currently quite extreme interpretation of copyright. Personally I don’t think its wrong to sample from or create derivative works from something that is accessible. If its not behind lock and key, its free to use. If you have a problem with that, then put it behind lock and key. No one is forcing you to share your art with the world.

        • Bogasse@lemmy.world
          link
          fedilink
          English
          arrow-up
          9
          arrow-down
          2
          ·
          1 year ago

          Most books are actually locked behind paywalls and not free to use? Or maybe I don’t understand what you meant?

        • Railcar8095@lemm.ee
          link
          fedilink
          English
          arrow-up
          5
          arrow-down
          1
          ·
          1 year ago

          Following that, if a sailor is the sea were to put a copy of a protected book on the internet and ChatGPT was trained on it, how that argument would go? The copyright owner didn’t place it there, so it’s not “their decision”. And savvy people can make sure it’s accessible if they want to.

          My belief is, if they can use all non locked data for free, then the model should be shared for free too and it’s outputs shouldn’t be subject to copyright. Just for context

      • Jumper775@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        Legally they will decide it is wrong, so it doesn’t matter. Power is in money and those with the copyrights have the money.

    • TwilightVulpine@lemmy.world
      link
      fedilink
      English
      arrow-up
      8
      arrow-down
      2
      ·
      1 year ago

      Should we distinguish it though? Why shouldn’t (and didn’t) artists have a say if their art is used to train LLMs? Just like publicly displayed art doesn’t provide a permission to copy it and use it in other unspecified purposes, it would be reasonable that the same would apply to AI training.

      • Terrasque@infosec.pub
        link
        fedilink
        English
        arrow-up
        11
        arrow-down
        1
        ·
        1 year ago

        Just like publicly displayed art doesn’t provide a permission to copy it and use it in other unspecified purposes

        But it kinda does. If I see a van Gogh painting, I can be inspired to make a painting in the same style.

        When “ai” “learns” from an image, it doesn’t copy the image or even parts of the image directly. It learns the patterns involved instead, over many pictures. Then it uses those patterns to make new images.

      • wmassingham@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        arrow-down
        2
        ·
        1 year ago

        Good news, they already do! Artists can license their work under a permissive license like the Creative Commons CC0 license. If not specified, rights are reserved to the creator.

        • TwilightVulpine@lemmy.world
          link
          fedilink
          English
          arrow-up
          5
          ·
          1 year ago

          I know, but one of the biggest conflicts between artists and AI developers is that they didn’t seek a license to use them for training. They just did it. So even if the end result is not an exact reproduction, it still relied on unauthorized use.

        • BURN@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          1 year ago

          Unfortunately AI training sets don’t tend to respect those licenses. Since it’s near impossible to prove they used it without permission they’re SoL

      • Blapoo@lemmy.ml
        link
        fedilink
        English
        arrow-up
        2
        ·
        1 year ago

        Ah, but that’s the thing. Training isn’t copying. It’s pattern recognition. If you train a model “The dog says woof” and then ask a model “What does the dog say”, it’s not guaranteed to say “woof”.

        Similarly, just because a model was trained on Harry Potter, all that means is it has a good corpus of how the sentences in that book go.

        Thus the distinction. Can I train on a comment section discussing the book?

    • Tetsuo@jlai.lu
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      2
      ·
      1 year ago

      Output from an AI has just been recently considered as not copyrightable.

      I think it stemmed from the actors strikes recently.

      It was stated that only work originating from a human can be copyrighted.

      • Anders429@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        1 year ago

        Output from an AI has just been recently considered as not copyrightable.

        Where can I read more about this? I’ve seen it mentioned a few times, but never with any links.

        • Even_Adder@lemmy.dbzer0.com
          link
          fedilink
          English
          arrow-up
          4
          arrow-down
          1
          ·
          1 year ago

          They clearly only read the headline If they’re talking about the ruling that came out this week, that whole thing was about trying to give an AI authorship of a work generated solely by a machine and having the copyright go to the owner of the machine through the work-for-hire doctrine. So an AI itself can’t be authors or hold a copyright, but humans using them can still be copyright holders of any qualifying works.