I run proxmox bare metal (debian-based hypervisor) and virtualize debian which has all my docker containers.
with virtualization you can take a snapshot and backup everything that way. super simple to roll back if you mess something up. the added bonus is you could probably take a snapshot of your VPS and migrate it to a local vm.
Ubuntu is something I played with about a decade ago and I never felt like I was "missing" something for debian, especially on servers.