coja

joined 2 years ago
sorted by: new top controversial old
What would be the cheapest and most cost-effeciant way of self hosting LLMs in c/[email protected]
[–] [email protected] 3 points 5 months ago* (last edited 5 months ago)

Not sure about the setup, but I believe 7600XT would be the best buy, it has 16GB VRAM and it's supported now

1002
Deploy the crack (lemmy.ml)
 
620
Find yourself (lemmy.ml)
 
39
Father material (lemmy.ml)
 
28
So cool, dude! (lemmy.ml)
 
26
Pointers (lemmy.ml)
 
44
Transprivacy (lemmy.ml)
 
23
JSchizophrenia (lemmy.ml)
 
17
Early disappointment (lemmy.ml)
 
Defenetly not Garbage in c/[email protected]
[–] [email protected] 0 points 1 year ago (1 children)

Those were my thoughts when I saw Gates bought waste managment stocks and saw the video of AI successfully sorting the items for recycling.

14
Defenetly not Garbage (lemmy.ml)
 
11
Sourcery (lemmy.ml)
 
14
Because we won't (lemmy.ml)
 
32
Arcane overflow (lemmy.ml)
 
view more: next ›