this post was submitted on 03 Apr 2024
75 points (87.1% liked)

Ask Lemmy

26831 readers
1678 users here now

A Fediverse community for open-ended, thought provoking questions

Please don't post about US Politics. If you need to do this, try [email protected]


Rules: (interactive)


1) Be nice and; have funDoxxing, trolling, sealioning, racism, and toxicity are not welcomed in AskLemmy. Remember what your mother said: if you can't say something nice, don't say anything at all. In addition, the site-wide Lemmy.world terms of service also apply here. Please familiarize yourself with them


2) All posts must end with a '?'This is sort of like Jeopardy. Please phrase all post titles in the form of a proper question ending with ?


3) No spamPlease do not flood the community with nonsense. Actual suspected spammers will be banned on site. No astroturfing.


4) NSFW is okay, within reasonJust remember to tag posts with either a content warning or a [NSFW] tag. Overtly sexual posts are not allowed, please direct them to either [email protected] or [email protected]. NSFW comments should be restricted to posts tagged [NSFW].


5) This is not a support community.
It is not a place for 'how do I?', type questions. If you have any questions regarding the site itself or would like to report a community, please direct them to Lemmy.world Support or email [email protected]. For other questions check our partnered communities list, or use the search function.


Reminder: The terms of service apply here too.

Partnered Communities:

Tech Support

No Stupid Questions

You Should Know

Reddit

Jokes

Ask Ouija


Logo design credit goes to: tubbadu


founded 1 year ago
MODERATORS
 

I recently set up a LLM to run locally on my desktop. Now that the novelty of setting it up and playing with different settings has worn off, I'm struggling to come up with actual uses for it. What do you use it for when not doing work stuff?

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 2 points 7 months ago (1 children)

How do you use it for that purpose? Cannot imagine how that works

[–] [email protected] 3 points 7 months ago (2 children)

I use a frontend called Silly Tavern to create a group with several "Personas" that I write a character definition for, in which I also outline the ruleset of the rpg framework I'm using. I then either run an LLM locally, or plug in an API Key for a cloud-based provider.

I then present them with the plot as Game Master and have them react, while doing their throws myself. Works surprisingly well, and is less dry than just going through the adventure you've written step by step.

[–] [email protected] 1 points 7 months ago (1 children)

I'm still trying to get Silly Tavern to run. I want to try what you are doing

[–] [email protected] 1 points 7 months ago

What problems are you having? For me it was pretty straightforward. Just had to clone the git repo, run the start.sh script, and visit localhost:8000 in a browser.

[–] [email protected] 1 points 7 months ago (1 children)

Okay if you ever post this process where i can watch it ide watch it.

Im officially old now i think.

This sucks

[–] [email protected] 1 points 7 months ago (1 children)

Honestly, I know the feeling, and I'm not really all that old. I'm kinda busy at the moment, but I'll try to remember pinging you if I make a proper post.

[–] [email protected] 1 points 7 months ago

Oh damn, i was just despairing a bit. I didnt really think you would do it. So no pressure to do it friend!