this post was submitted on 01 Oct 2024
366 points (91.2% liked)

Programmer Humor

19557 readers
1207 users here now

Welcome to Programmer Humor!

This is a place where you can post jokes, memes, humor, etc. related to programming!

For sharing awful code theres also Programming Horror.

Rules

founded 1 year ago
MODERATORS
[email protected]
[email protected]
[email protected]
[email protected]
366
Work of pure human soul (and pure human sweat, and pure human tears) (lemmy.world)
submitted 1 month ago by [email protected] to c/[email protected]
54 comments fedilink hide all child comments
 
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 13 points 1 month ago (5 children)

If you have a supported GPU you could try Ollama (with openwebui), works like a charm.

[–] [email protected] 6 points 1 month ago (4 children)

you don't even need a supported gpu, I run ollama on my rx 6700 xt

[–] [email protected] 3 points 1 month ago (1 children)

You don't even need a GPU, i can run Ollama Open-WebUI on my CPU with an 8B model fast af

[–] [email protected] 2 points 1 month ago (1 children)

I tried it with my cpu (with llama 3.0 7B), but unfortunately it ran really slow (I got a ryzen 5700x)

[–] [email protected] 2 points 1 month ago

I ran it on my dual core celeron and.. just kidding try the mini llama 1B. I'm in the same boat with Ryzen 5000 something cpu

load more comments (2 replies)
load more comments (2 replies)