Selfhosted

40183 readers

1087 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago

MODERATORS

[email protected]

187

I just won an auction for 25 computers. What should I setup on them? (reddthat.com)

submitted 6 months ago* (last edited 6 months ago) by [email protected] to c/[email protected]

93 comments fedilink hide all child comments

I placed a low bid on an auction for 25 Elitedesk 800 G1s on a government auction and unexpectedly won (ultimately paying less than $20 per computer)

In the long run I plan on selling 15 or so of them to friends and family for cheap, and I'll probably have 4 with Proxmox, 3 for a lab cluster and 1 for the always-on home server and keep a few for spares and random desktops around the house where I could use one.

But while I have all 25 of them what crazy clustering software/configurations should I run? Any fun benchmarks I should know about that I could run for the lolz?

Edit to add:

Specs based on the auction listing and looking computer models:

4th gen i5s (probably i5-4560s or similar)
8GB of DDR3 RAM
256GB SSDs
Windows 10 Pro (no mention of licenses, so that remains to be seen)
Looks like 3 PCIe Slots (2 1x and 2 16x physically, presumably half-height)

Possible projects I plan on doing:

Proxmox cluster
Baremetal Kubernetes cluster
Harvester HCI cluster (which has the benefit of also being a Rancher cluster)
Automated Windows Image creation, deployment and testing
Pentesting lab
Multi-site enterprise network setup and maintenance
Linpack benchmark then compare to previous TOP500 lists

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 18 points 6 months ago* (last edited 6 months ago) (14 children)

Run 70b llama3 on one and have a 100% local, gpt4 level home assistant . Hook it up with coqui.Ai xttsv2 for mind baffling natural language speech (100% local too ) that can imitate anyone's voice. Now, you got yourself Jarvis from Ironman.

Edit : thought they were some kind of beast machines with 192gb ram and stuff. They're just regular middle-low tier pcs.

[–] [email protected] 2 points 6 months ago (3 children)

These are 10 year old mid range machines. Llama 7b won't even run well

[–] [email protected] 2 points 6 months ago* (last edited 6 months ago) (1 children)

The key is quantized models. A full model wouldn't fit but a 4bit 8b llama3 would fit.

[–] [email protected] 2 points 6 months ago (1 children)

It would fit but it would be very slow

[–] [email protected] 1 points 6 months ago* (last edited 6 months ago)

No. Quantization make it go faster. Not blazing fast, but decent.

load more comments (1 replies)

load more comments (11 replies)