Why not just use something like Synergy so you can control both machines from the mouse+kb at your desktop? Just enable the software when you need to and you can move the mouse off the edge of the screen and onto the other machine as if it were a second monitor. That’s what I do with laptop + desktop setups. Get a small cheap Ethernet switch so you can plug both machines in.
Looks like someone fucked up package dependencies somewhere.
I’m surprised they don’t have some basic automated testing running in a VM after new package releases but I suppose they don’t need it if they can farm that duty out to their free userbase.