Programming

19355 readers

66 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Follow the programming.dev instance rules
Keep content related to programming in some way
If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities [email protected]

founded 2 years ago

MODERATORS

[email protected]

Can anybody explain why CUDA and Rocm are necessary and why OpenCL isn't the solution? (programming.dev)

submitted 4 days ago by [email protected] to c/[email protected]

18 comments fedilink hide all child comments

I've read multiple times that CUDA dominates, mostly because NVIDIA dominates. Rocm is the AMD equivalent, but OpenCL also exists. From my understanding, these are technologies used to program graphics cards - always thought that shaders were used for that.

There is a huge gap in my knowledge and understanding about this, so I'd appreciate somebody laying this out for me. I could ask an LLM and be misguided, but I'd rather not 🤣

Anti Commercial-AI license

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 2 points 4 days ago

You really piqued my interest. I use docker/podman.

W/ an AMD graphics card, eglinfo on the host shows the card is AMD Radeon and driver is matching that.

In the container, without --gpus=all, it shows the card is unknown and the driver is "swrast" (so just CPU fallback).

To make --gpus=all work, it gives the error

docker: Error response from daemon: could not select device driver "" with capabilities: [[gpu]

I was doing a bad job searching before. I found that AMD can share the GPU, it just works a little differently in terms of how to launch the container. https://rocm.docs.amd.com/projects/install-on-linux/en/latest/install/amdgpu-install.html#amdgpu-install-dkms

But sadly my AMD GPU is too old/junk to have current driver support.

Anyways, appreciate the reply! Now I can mod my code to run on cheaper cloud instances.

(Note I'm an OpenGL/3D app developer, but probably OpenCL works about the same architecturally)