this post was submitted on 23 Dec 2023
185 points (86.0% liked)
Technology
59374 readers
3040 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Emergence is the whole being greater than the sum of its parts. That's the original meaning of emergent properties, which is laid out in the first paragraph of the article. It's the scholarly usage as well, and what the claims of observed emergence are using as the base of their claim.
The article very explicitly demonstrated that only about 10% of any of the measures for LLMs displayed any emergence and that illusory emergence was the result of overly rigid metrics. Swapping to edit distance as an approximately close metric causes the sharp spikes to disappear for obvious reasons: no longer having a sharp yes/no allows for linear progression to reappear. It was always there, merely masked by flawed statistics.
If you can't be bothered to read here's a very easy to understand video by one of the authors: https://www.youtube.com/watch?v=ypKwNrmuuPM
Good. Now do you understand how you have misrepresented the paper?