grilledcheesecowboy

joined 1 year ago
sorted by: new top controversial old
Self hosted LLM in c/[email protected]
[–] [email protected] 4 points 6 months ago* (last edited 6 months ago)

I've had pretty good luck running llamafile on my laptop. The speeds aren't super fast, and I can only use the models that are Mistral 7B and smaller, but the results are good enough for casual use and general R and Python code.

Edit: my laptop doesn't have a dedicated GPU, and I don't think llamafile has support for Intel GPUs yet. CPU inference is still pretty quick.

Best email provider against spam? in c/[email protected]
[–] [email protected] 17 points 6 months ago (1 children)

The paid proton accounts let you use several custom domains, although I'm not sure if you can combine custom domains with email aliases. For random sites the email alias with the stand @proton.me would probably suit your needs.

After about 3 years of use I've been very happy with proton's spam filtering.

Best email provider against spam? in c/[email protected]
Private chat app using wifi only. No SIM available in c/[email protected]
[–] [email protected] 17 points 7 months ago

My friends and I all use Simplex and have been very happy. There's an annoying feature where messages in group chats are sometimes delivered out of order, but it's easy enough to live with.

DOJ quietly removed Russian malware from routers in US homes and businesses in c/[email protected]
[–] [email protected] 5 points 7 months ago

That's already been hacked by the NSA

Report: Bing Gained Less Than 1% Market Share Since Adding Bing Chat in c/[email protected]
[–] [email protected] 6 points 8 months ago (3 children)

This reads like a poor attempt a guerrilla marketing.

11
Help with hosting internal and external services with DMZ and docker swarm (kbin.social)
 

I currently host several services on my docker swarm, all of which are exposed to the internet but protected by Authelia and routed through Traefik.

I'd like to improve security and split my network into several vlans, one of which would be a DMZ for services exposed to the internet (Foundry VTT, Matrix, Searx, maybe some others), and another vlan for services that are only accessible while on a vpn (*arrs, Jellyfin, Nextcloud, etc.).

I'm not sure what is the safest and easiest way to do this. Some ideas I have:

  1. Setup a specfic server for my external services and connect it to a DMZ tagged vlan port.
  2. Run all of my services in the same docker swarm on the internal VLAN, and only have my Traefik service running in the DMZ (I don't know if this is possible with physical vlan ports)
  3. Run all of my services in the DMZ, but with an IP whitelist to control access for services I only want accesible from the VPN
  4. Something else I haven't thought of?

Thanks, and I appreciate the help.