this post was submitted on 19 Apr 2024
473 points (97.6% liked)
Technology
59374 readers
7033 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
have you tried the rocm docker containers that amd makes for your needs? it pretty much makes installing rocm on the base OS unneeded for me. https://hub.docker.com/u/rocm https://github.com/ROCm/ROCm-docker
AFAIK, cards older than GFX1030 require manual setup, including building parts of ROCM with modified flags, since v5.1
There is one extra step. I have an 6700xt, and with the docker containers, you just have to pass the environment variable
HSA_OVERRIDE_GFX_VERSION=10.3.0
to allow that card to work. For cards other than 6000 series, you would need to look up the version to pass for your generation.Here's an example compose file that I use for ollama that runs ai models on my 6700xt.