this post was submitted on 10 Jan 2025
7 points (100.0% liked)

Steam Hardware

20042 readers
587 users here now

A place to discuss and support all Steam Hardware, including Steam Deck, Steam Machine, Steam Frame, and SteamOS in general.

As Lemmy doesn't have flairs yet, you can use these prefixes to indicate what type of post you have made, eg:
[Flair] My post title

The following is a list of suggested flairs:
[Deck] - Steam Deck related.
[Machine] - Steam Machine related.
[Frame] - Steam Frame related.
[Discussion] - General discussion.
[Help] - A request for help or support.
[News] - News about the deck.
[PSA] - Sharing important information.
[Game] - News / info about a game on the deck.
[Update] - An update to a previous post.
[Meta] - Discussion about this community.

If your post is only relevant to one hardware device (Deck/Machine/Frame/etc) please specify which one as part of the title or by using a device flair.

These are not enforced, but they are encouraged.

Rules:

Link to our Matrix Space

founded 4 years ago
MODERATORS
 

I've been trying to install rocm on the deck following this guide

(https://old.reddit.com/r/SteamDeckTricks/comments/102xxww/guide_how_to_install_rocm_for_gpu_julia/)

with the only exception that i used a generic ubuntu container on podman instead of using distrobox; I reach to the point where i need to use amdgpu-install to run rocm, but when i do it tries to install 30gb of files; which unfortunately it's not feasible on my metered connection and storage (╥﹏╥). From what i saw from this issue on github there should be a way to select only the needed binaries for the specific chipset;

The question is, what should i do to install only the stuff necessary for the deck?

Sorry for the long post.

top 7 comments
sorted by: hot top controversial new old
[–] bjoern_tantau@swg-empire.de 2 points 11 months ago

I had it running for image generation. As far as I recall it was slow and buggy so I didn't do more with it.

[–] SGforce@lemmy.ca 1 points 11 months ago

Try Vulkan in Koboldcpp https://github.com/LostRuins/koboldcpp/releases/tag/v1.81.1

I haven't heard of anyone trying it on deck but I don't see why it wouldn't work.

[–] Fubarberry@sopuli.xyz 1 points 11 months ago* (last edited 11 months ago) (1 children)

I probably can't help, I have ROCM acceleration working on my desktop linux PC for image gen and LLMs, but I don't think I had to install the massive rocm files for it to work.

What specifically are you trying to run using ROCM? If I remember right most of the stuff I tried just needed pytorch, which I would install in a python venv with pip3 install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/rocm6.3 That's still pretty heft though, my current venv is 16GB in size, but may include some duplicate/old files from repeated upgrades without cleaning.

[–] brokenlcd@feddit.it 2 points 11 months ago (1 children)

I'm mostly trying to run text-generation-webui for fun; what did you install to run image generation if you never installed the rocm binaries? Hopefully i should be able to replicate it in a container

[–] Fubarberry@sopuli.xyz 2 points 11 months ago (1 children)

Pytorch includes the necessary ROCm files for image gen as far as I know. My computer does have an /opt/ROCm folder but it's only a few megabytes in size.

Unfortunately I don't see any mention of pytorch in your linked program, and it does mention a proper ROCm install as a requirement there.

[–] brokenlcd@feddit.it 1 points 11 months ago (1 children)

If that's the case i'm going to try to run it without installing rocm, since i saw a pytorch rocm package being downloaded by pip. I'm gonna need to reinstall though.

[–] Fubarberry@sopuli.xyz 1 points 11 months ago

There are different pytorch install commands for cuda/ROCm. Usually the key to getting ROCm to work with AI GitHub projects is to edit a config file/launch option and replace the pytorch command with a ROCm one