this post was submitted on 19 Apr 2024
29 points (93.9% liked)

Selfhosted

39980 readers
657 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago
MODERATORS
 

I've got 3 HDDs connected to my Proxmox machine via usb3. They worked fine until this week. I have them mounted and passed through to OMV.

One failed on Sunday. It was fine one minute, I rebooted and Proxmox wouldn't boot...

Couldn't work out why it wouldn't boot and reflashed Proxmox, losing all my machines (I have since learned the importance of backups since I had none).

I've spent 4 days rewriting it all. Rebooted last night and it happened again, but this time I noticed that it was struggling to find one of my drives and edited them out of Fstab and got it booting again.

I've since added 2/3 drives back in by adding "nofail" to my Fstab entries but my main storage drive is now showing as 100gb instead of 1tb and won't pass through to OMV.

I've come to the conclusion that they were mounted by label and "forgot" their label, hence wouldn't boot, they're now mounted by UUID.

So has anyone got any tips on the best way to mount these things without killing my whole setup?

Also if anyone knows why my storage is showing as 100gb in Proxmox and won't pass through to OMV now I would be eternally grateful. Kinda want to get the files off that drive...

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 6 points 6 months ago* (last edited 6 months ago) (1 children)

Just a little heads up about multiple USB drives. They kinda suck sharing on the hub and raids tend to destroy them because of the way they "share" bandwidth on the hub.

To avoid this problem one solution is a USBc to SATA enclosure. The idea being the enclosure having a SATA controller and a few SATA ports you can plug in a few drives. You would be avoiding the multi USB port "sharing" issue. The enclosure would have all the usb hub bandwidth and the hub wouldn't be switching around between ports.

I learned this little bit of info messing with zfs and a few different types of flash media. In the end the most stable connection less prone to error was a single USB connection. However, it didn't matter if it was a single drive or a multi drive enclosure.

Today I wouldn't recommend doing this at all. However if you are going to. Have a look at how USB port sharing on a usb hub works and how that can wreck a raid system over time.

Edit Spelling

[–] [email protected] 2 points 6 months ago (2 children)

Funnily enough I was looking at these usb Sata cases yesterday, but I was expecting them to be cheaper then they are (I'm a Yorkshireman and we're notorious for not liking spending money).

As to your point (which I will look into) are you talking about an actual external Hub here or the USB in my machine? I ask because I have 5 usb 3.0 ports on the machine and do not actually use an external hub, but when you use the word "hub" you could also be referring to the USB controller on the machine.

Also I haven't dabbled with RAID yet but I had considered it, so this may sway me to invest some money before considering it properly.

[–] [email protected] 2 points 6 months ago

I don't think those USB cases are priced realistically at all. For what they're asking I may as well just buy hardware to build a NAS box.

[–] [email protected] 1 points 6 months ago (1 children)

Well specifically I'm referring to the internal hub on your system and how it shares port bandwidth. It doesn't really matter for things like a mouse or keyboard. However, when you are talking like permanent flash disks it's worth investigating how the bandwidth is shared between ports. Specifically the switching back and forth between the storage devices. Some filesystems handle this better than others.

I was was also referring to a way I found that stabilizes the connection. That being a USB to SATA controller via like one port. That way that port tends to take advantage of all the bandwidth without switching around.

Also keep in mind USB flash media is notorious for wear compared to something like nvme/msata disks.

It's possible to combat writes on flash media by utilizing things like ram disks in Linux. Basically migrating write heavy locations like temp and logs to the ram disk. Though you need to consider that restarting wipes those locations because they are living in ram now. Some operating systems do this automatically like opnsense with a check mark.

[–] [email protected] 1 points 6 months ago

Well I'll keep it in mind for if I get any issues but it seems to be running ok ATM with USB ports passed through to OMV and then CIFS back to Proxmox so I can save backups.

As it is, at most 2 drives will be in use at a time with the third as a backup drive doing rsync at night (still to set up).

I'm not using flash storage. These are proper spinning Hard Drives with a usb 3 cable (and a power cable) to the host.