Selfhosted
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
view the rest of the comments
Just a little heads up about multiple USB drives. They kinda suck sharing on the hub and raids tend to destroy them because of the way they "share" bandwidth on the hub.
To avoid this problem one solution is a USBc to SATA enclosure. The idea being the enclosure having a SATA controller and a few SATA ports you can plug in a few drives. You would be avoiding the multi USB port "sharing" issue. The enclosure would have all the usb hub bandwidth and the hub wouldn't be switching around between ports.
I learned this little bit of info messing with zfs and a few different types of flash media. In the end the most stable connection less prone to error was a single USB connection. However, it didn't matter if it was a single drive or a multi drive enclosure.
Today I wouldn't recommend doing this at all. However if you are going to. Have a look at how USB port sharing on a usb hub works and how that can wreck a raid system over time.
Edit Spelling
Funnily enough I was looking at these usb Sata cases yesterday, but I was expecting them to be cheaper then they are (I'm a Yorkshireman and we're notorious for not liking spending money).
As to your point (which I will look into) are you talking about an actual external Hub here or the USB in my machine? I ask because I have 5 usb 3.0 ports on the machine and do not actually use an external hub, but when you use the word "hub" you could also be referring to the USB controller on the machine.
Also I haven't dabbled with RAID yet but I had considered it, so this may sway me to invest some money before considering it properly.
Well specifically I'm referring to the internal hub on your system and how it shares port bandwidth. It doesn't really matter for things like a mouse or keyboard. However, when you are talking like permanent flash disks it's worth investigating how the bandwidth is shared between ports. Specifically the switching back and forth between the storage devices. Some filesystems handle this better than others.
I was was also referring to a way I found that stabilizes the connection. That being a USB to SATA controller via like one port. That way that port tends to take advantage of all the bandwidth without switching around.
Also keep in mind USB flash media is notorious for wear compared to something like nvme/msata disks.
It's possible to combat writes on flash media by utilizing things like ram disks in Linux. Basically migrating write heavy locations like temp and logs to the ram disk. Though you need to consider that restarting wipes those locations because they are living in ram now. Some operating systems do this automatically like opnsense with a check mark.
Well I'll keep it in mind for if I get any issues but it seems to be running ok ATM with USB ports passed through to OMV and then CIFS back to Proxmox so I can save backups.
As it is, at most 2 drives will be in use at a time with the third as a backup drive doing rsync at night (still to set up).
I'm not using flash storage. These are proper spinning Hard Drives with a usb 3 cable (and a power cable) to the host.