this post was submitted on 14 Feb 2024
1299 points (98.4% liked)
Programmer Humor
19817 readers
55 users here now
Welcome to Programmer Humor!
This is a place where you can post jokes, memes, humor, etc. related to programming!
For sharing awful code theres also Programming Horror.
Rules
- Keep content in english
- No advertisements
- Posts must be related to programming or programmer topics
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
EDIT: It seems the app sherpa has what you need. Just use one of the models found here, preferably 7b-chat Q4_K_S
Some people are energised by that kind of thing. However if you don't want to reveal things to humans, you can use (if you are more technical) llama.cpp
Thanks for the links. So I don't need to worry about downloading the model from meta eh?
Edit: oh you mean download this one instead?
I tried and the app crashes after submitting a prompt but this is a good starting point. I'll take a look into it further later.