This is a most excellent place for technology news and articles.
Was watching bbc news interview some American guy about this and wow they were really pushing that it's no big deal and deepseek is way behind and a bit of a joke. Made claims they weren't under cyber attack they just couldn't handle having traffic etc.
Kinda making me root for China honestly.
My understanding is that DeepSeek still used Nvidia just older models and way more efficiently, which was remarkable. I hope to tinker with the opensource stuff at least with a little Twitch chat bot for my streams I was already planning to do with OpenAI. Will be even more remarkable if I can run this locally.
However this is embarassing to the western companies working on AI and especially with the $500B announcement of Stargate as it proves we don't need as high end of an infrastructure to achieve the same results.
500b of trust me Bros... To shake down US taxpayer for subsidies
Read between the lines folks
It still rely on nvidia hardware why would it trigger a sell-off? Also why all media are picking up this news? I smell something fishy here...
Here's someone doing 200 tokens/s (for context, OpenAI doesn't usually get above 100) on... A Raspberry Pi.
Yes, the "$75-$120 micro computer the size of a credit card" Raspberry Pi.
If all these AI models can be run directly on users devices, or on extremely low end hardware, who needs large quantities of top of the line GPUs?
Thank the fucking sky fairies actually, because even if AI continues to mostly suck it'd be nice if it didn't swallow up every potable lake in the process. When this shit is efficient that makes it only mildly annoying instead of a complete shitstorm of failure.
The way I understood it, it's much more efficient so it should require less hardware.
Nvidia will sell that hardware, an obscene amount of it, and line will go up. But it will go up slower than nvidia expected because anything other than infinite and always accelerating growth means you're not good at business.
It requires only 5% of the same hardware that OpenAI needs to do the same thing. So that can mean less quantity of top end cards and it can also run on less powerful cards (not top of the line).
Should their models become standard or used more commonly, then nvidis sales will drop.
Hm even with DeepSeek being more efficient, wouldn't that just mean the rich corps throw the same amount of hardware at it to achieve a better result?
In the end I'm not convinced this would even reduce hardware demand. It's funny that this of all things deflates part of the bubble.
Hm even with DeepSeek being more efficient, wouldn’t that just mean the rich corps throw the same amount of hardware at it to achieve a better result?
Only up to the point where the AI models yield value (which is already heavily speculative). If nothing else, DeepSeek makes Altman's plan for $1T in new data-centers look like overkill.
The revelation that you can get 100x gains by optimizing your code rather than throwing endless compute at your model means the value of graphics cards goes down relative to the value of PhD-tier developers. Why burn through a hundred warehouses full of cards to do what a university mathematics department can deliver in half the time?
Great, a stock sale.
Bizarre story. China building better LLMs and LLMs being cheaper to train does not mean that nVidia will sell less GPUs when people like Elon Musk and Donald Trump can't shut up about how important "AI" is.
I'm all for the collapse of the AI bubble, though. It's cool and all that all the bankers know IT terms now, but the massive influx of money towards LLMs and the datacenters that run them has not been healthy to the industry or the broader economy.
nvidia falling doesn't make much sense to me, GPUs are still needed to run the model. Unless Nvidia is involved in its own AI model or something?
Nice. Fuck you Nvidia.
