Yes, definitely. A huge benefit of a Windows VPS is that you can start your work from one PC and resume it on another platform.
Remote Desktop is globally supported on different platforms like Windows, macOS, Linux, iOS, Android, and more, so you can use your Windows VPS as a cloud desktop, a desktop-accessible 24/7 with a quick and always-available internet connection.