Nah... to update the driver I just re run the file and it usually just works (Even in Wayland, on Debian unstable).
The only time it broke was when I upgraded to kernel 6.12 and I had to manually install the open source modules because the ones that came with the proprietary ones had an issue that they later fixed, so it's totally fine now.
The only issue I have with the drivers is that when I wake up the PC from sleep I have to restart Plasma (only on Wayland tho)
And if that doesn't work, just remove the nvidia drivers that do not match the installed version. It may give you a warning that the package is in use but it shouldn't be an issue if you (OP) keep the version that matches your driver
<=