Drivers aren't the issue. Keeping them up to date is.
Most of these drivers are written for specific kernel versions (and are part of the BSP), but Qualcomm only keeps them updated for a given cycle. Which is usually 2-3 years (albeit Google's recent push has resulted in longer support cycles).
Any Ryzen 7800/8800/8900 series APU miniPC will bring you close to PS5 performance. Frequently sold around $300-400, with 16-32GB RAM.