this post was submitted on 02 Oct 2024
335 points (91.6% liked)
Technology
59374 readers
7261 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Honestly, I can say I don't really get it either. I would only use the open source models anyway, but it just seems rather silly from what I can tell.
I feel like the last few months have been an inflection point, at least for me. Qwen 2.5, and the new Command-R, really make a 24GB GPU feel "dumb, but smart," useful enough so I pretty much always keep Qwen 32B loaded on the desktop for its sheer utility.
It's still in the realm of enthusiast hardware (aka a used 3090), but hopefully that's about to be shaken up with bitnet and some stuff from AMD/Intel.
Altman is literally a vampire though, and thankfully I think he's going to burn OpenAI to the ground.
What do you think about the possibility of decentralized AI through blockchain so that you could pay some tokens or something like that to rent the GPUs to run your AI for as long as you wish to instead of having to buy all the hardware and assemble it yourself?
I cannot tell if you are being serious or just having fun with buzzwords
I stopped at block chain
Oh, I'm being completely serious. I've been interested in crypto since about 2013.
There is no need to use Blockchain for this. Computing pools like this have been used for ages
crypto fizzled years ago without a major use case. source: check google trend history.
bitcoin wouldn't be useful for tracking the rental of cpu/gpu assets.
Yeah, no Bitcoin would be the wrong chain for that. But there are other chains that would work better for such a use case.
how do you suppose?
Bitcoin is really too slow and too expensive for automated tasks like that. There are other chains such as Solana, etc that are much faster and much cheaper that would work better for that kind of use case.
The solution to all the world's computing issues is not "blockchain."