this post was submitted on 05 Dec 2024
528 points (94.4% liked)
Technology
60052 readers
2851 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
And some of those citations and quotes will be completely false and randomly generated, but they will sound very believable, so you don't know truth from random fiction until you check every single one of them. At which point you should ask yourself why did you add unneccessary step of burning small portion of the rainforest to ask random word generator for stuff, when you could not do that and look for sources directly, saving that much time and energy
As a side note, I feel like this take is intellectually lazy. A knife cannot be used or handled like a spoon because it's not a spoon. That doesn't mean the knife is bad, in fact knives are very good, but they do require more attention and care. LLMs are great at cutting through noise to get you closer to what is contextually relevant, but it's not a search engine so, like with a knife, you have to be keenly aware of the sharp end when you use it.
Even that is not true. It doesn't have aforementioned criteria for truth, you can't make it have one.
LLMs are great at generating noise that humans have hard time distinguishing from a text. Nothing else. There are indeed applications for it, but due to human nature, people think that since the text looks like something coherent, information contained will also be reliable, which is very, very dangerous.
I understand your skepticism, but I think you're overstating the limitations of LLMs. While it's true that they can generate convincing-sounding text that may not always be accurate, this doesn't mean they're only good at producing noise. In fact, many studies have shown that LLMs can be highly effective at retrieving relevant information and generating text that is contextually relevant, even if not always 100% accurate.
The key point I was making earlier is that LLMs require a different set of skills and critical thinking to use effectively, just like a knife requires more care and attention than a spoon. This doesn't mean they're inherently 'dangerous' or only capable of producing noise. Rather, it means that users need to be aware of their strengths and limitations, and use them in conjunction with other tools and critical evaluation techniques to get the most out of them.
It's also worth noting that search engines are not immune to returning inaccurate or misleading information either. The difference is that we've learned to use search engines critically, evaluating sources and cross-checking information to verify accuracy. We need to develop similar critical thinking skills when using LLMs, rather than simply dismissing them as 'noise generators'.
See these: