this post was submitted on 28 Aug 2023
532 points (94.9% liked)
Memes
45660 readers
1230 users here now
Rules:
- Be civil and nice.
- Try not to excessively repost, as a rule of thumb, wait at least 2 months to do it if you have to.
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Who says it ends here? We've made tremendous progress in a short time. 10 years ago it was absolutely unthinkable that we'd be at a stage right now where we can generate these amazing images from text on consumer hardware and that AI can write text in a way that could totally fool humans. Even as someone working in the field I was fairly sceptical 5-6 years ago that we'd get here this fast
Where some underrepresented domains have made massive strides, this GPT thing has done relatively little for data science.
The important thing is that "what AI/ML can and cannot do" is not changing that much. It's successful application is what's changed. The idea of making AI libraries more accessible is huge, and leads to stuff like this. But under the hood, OpenAI doesn't do much different than other AI tools. It's just easier to use yourself. You can do more faster as computers get faster, but that seems to be limited with the endgame of Moore's Law anyway.
OpenAI runs on supercomputers now. It'll continue to run on supercomputers in the future. Instead of getting better, it has started to get worse at many things. Experts have always had a fairly good grasp of where it'll end. There are things AI was always expected to do better than humans at. And things it never will.
I mean, I expected AI image generation and better text quality. But I also expected the limits it currently has. And I've only done a little directly in the field.
But the fact that it can do so much is an awesome (and maybe scary) result in and of itself. These LLMs can write working code examples, write convincing stories, give advice, solve simple problems quite reliably, etc all from just learning to predict the next word. I feel like people are moving the goalpost way too quickly, focussing so much on the mistakes it makes instead of the impressive feats that have been achieved. Having AI doing all this was simply unthinkable a few years ago. And yes, OpenAI is currently using a lot of hardware, and ChatGPT might indeed have gotten worse. But none of that changes what has been achieved and how impressive it is.
Maybe it's because of all these overhyping clickbait articles that make reality seem disappointing. As someone in the field who's always been cynical about what would be possible, I just can't be anything else then impressed with the rate of progress. I was wrong with my predictions 5 years ago, and who knows where we'll go next.