this post was submitted on 14 May 2024
318 points (97.6% liked)
Technology
59374 readers
3125 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
They don't really have a choice. Classic website search will be useless in the near future because of the rapid rise of LLM-generated pages. Already for some searches 1 out of 3 results is generated crap.
Their only hope it's that somehow they'll be able to weed out LLM pages with LLM. Which is something that scientists say it's impossible because LLMs cannot learn from LLM results so they won't be able to reliably tell which content is good.
The fact they're even trying this shows they're desperate, so they will try.
If they can't direct me to the right web site because they can't tell what's LLM junk, then how will they summarize an answer for me based on those same web sites they know about? It doesn't seem like LLM summaries are a way to avoid that issue at all.
Well, it's not exactly impossible because of that, it's just unlikely they'll use a discriminator for the task because great part of generated content is effectively indistinguishable from human-written content - either because the model was prompted to avoid "LLM speak", or because the text was heavily edited. Thus they'd risk a high false positive rate.
Do you have a source for those scientists you're referring to?
I know that LLMs can be trained on data output by other LLMs, but you're basically diluting your results unless you do a lot of work to clean up the data.
I wouldn't say it's "impossible" to determine if content was generated by an LLM, but I agree that it will not be reliable.
So far I'm mostly unaffected by this. That's probably because I usually internet mostly for niche hobbies and occasionally practical things and shopping. Like apartment hunting, since the industry is too spread out for anybody to get in bed with Google enough to get a big boost up the AI idiocy. Except maybe apartments.com, but that's where I've always ended up anyway even back before Google's enshitification.