this post was submitted on 09 Jan 2024
529 points (98.2% liked)

Technology

59312 readers
5006 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

‘Impossible’ to create AI tools like ChatGPT without copyrighted material, OpenAI says::Pressure grows on artificial intelligence firms over the content used to train their products

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 15 points 10 months ago* (last edited 10 months ago) (3 children)

I really don't understand this whole "learning" thing that everybody claims these models are doing.

A Markov chain algorithm with different inputs of text and the output of the next predicted word isn't colloquially called "learning", yet it's fundamentally the same process, just less sophisticated.

They take input, apply a statistical model to it, generate output derived from the input. Humans have creativity, lateral thinking and the ability to understand context and meaning. Most importantly, with art and creative writing, they're trying to express something.

"AI" has none of these things, just a probability for which token goes next considering which tokens are there already.

[–] [email protected] 5 points 10 months ago* (last edited 10 months ago)

I don't think "learning" is a word reserved only for high-minded creativeness. Just rote memorization and repetition is sometimes called learning. And there are many intermediate states between them.

[–] [email protected] 3 points 10 months ago (1 children)

Humans have creativity, lateral thinking and the ability to understand context and meaning

What evidence do you have that those aren't just sophisticated, recursive versions of the same statistical process?

[–] [email protected] 3 points 10 months ago* (last edited 10 months ago) (1 children)

I think the best counter to this is to consider the zero learning state. A language model or art model without any training data at all will output static, basically. Random noise.

A group of humans socially isolated from the rest of the world will independently create art and music. It has happened an uncountable number of times. It seems to be a fairly automatic emergent property of human societies.

With that being the case, we can safely say that however creativity works, it's not merely compositing things we've seen or heard before.

[–] [email protected] 2 points 10 months ago

I disagree with this analysis. Socially isolated humans aren't isolated, they still have nature to imitate. There's no such thing as a human with no training data. We gather training data our whole life, possibly from the womb. Even in an isolated group, we still have others of the group to imitate, who in turn have ancestors, and again animals and natural phenomena. I would argue that all creativity is precisely compositing things we've seen or heard before.

[–] [email protected] 2 points 10 months ago (1 children)

Out of curiosity, how far do you extend this logic?

Let's say I'm an artist who does fractal art, and I do a line of images where I take jpegs of copywrite protected art and use the data as a seed to my fractal generation function.

Have I have then, in that instance, taken a copywritten work and simply applied some static algorithm to it and passed it off as my own work, or have I done something truly transformative?

The final image I'm displaying as my own art has no meaningful visual cues to the original image, as it's just lines and colors generated using the image as a seed, but I've also not applied any "human artistry" to it, as I've just run it through an algorithm.

Should I have to pay the original copywrite holder?
If so, what makes that fundamentally different from me looking at the copywritten image and drawing something that it inspired me to draw?
If not, what makes that fundamentally different from AI images?

[–] [email protected] 3 points 10 months ago* (last edited 9 months ago) (1 children)
[–] [email protected] 1 points 10 months ago (1 children)

I feel like you latched on to one sentence in my post and didn't engage with the rest of it at all.

That sentence, in your defense, was my most poorly articulated, but I feel like you responded devoid of any context.

Am I to take it, from your response, that you think that a fractal image that uses a copywritten image as a seed to it's random number generator would be copyright infringement?

If so, how much do I, as the creator, have to "transform" that base binary string to make it "fair use" in your mind? Are random but flips sufficient?
If so, how is me doing that different than having the machine do that as a tool? If not, how is that different than me editing the bits using a graphical tool?

[–] [email protected] 3 points 10 months ago* (last edited 9 months ago) (1 children)
[–] [email protected] 0 points 10 months ago (1 children)

Fair on all counts. I guess my counter then would be, what is AI art other than running a bunch of pieces of other art through a computer system, then adding some "stuff you did" (to use your phrase) via a prompt, and then submitting the output as your own art.

That's nearly identical to my fractal example, which I think you're saying would actually be fair use?

[–] [email protected] 2 points 10 months ago* (last edited 9 months ago) (1 children)
[–] [email protected] 1 points 10 months ago

Here is an alternative Piped link(s):

a relatively short (to me) video

Piped is a privacy-respecting open-source alternative frontend to YouTube.

I'm open-source; check me out at GitHub.