vluz

joined 1 year ago
[–] [email protected] 2 points 7 months ago (1 children)

Just figured out there are 10 places called Lisbon dotted around the US, according to the search.

[–] [email protected] 3 points 10 months ago (4 children)

I got cancelled too and chose Hetzner instead. Will not do business with a company that can't get their filters working decently.

[–] [email protected] 3 points 1 year ago (1 children)

Oh my Gwyn, this comment section is just amazing.

[–] [email protected] 11 points 1 year ago

HateLLM will be a smash. /s

[–] [email protected] 1 points 1 year ago

That's wonderful to know! Thank you again.
I'll follow your instructions, this implementation is exactly what I was looking for.

[–] [email protected] 1 points 1 year ago (2 children)

Absolutely stellar write up. Thank you!

I have a couple of questions.
Imagine I have a powerful consumer gpu card to trow at this solution, 4090ti for the sake of example.
- How many containers can share one physical card, taking into account total vram memory will not be exceeded?
- How does one virtual gpu look like in the container? Can I run standard stuff like PyTorch, Tensorflow, and CUDA stuff in general?