This is, specifically, the workflow for changing graphics cards manufacturers on windows, e.g. nVidia to AMD. If you're just going from one AMD card to another, or vice versa, generally you can just toss it in and reboot a few times, yes.

GPU manufacturers are fucking awful about actually uninstalling their bloatware shit on windows, and it often (potentially intentionally) interferes with other manufacturer's drivers (and sometimes their own, though that's less common these days.)