You're close, but not quite there. The ground plane of the machine was almost certainly grounded either way. But this switch likely introduces a connection to a separate ground, resulting in a ground loop. When you disconnect that loop it's not surprising at all that you would get a bit of a voltage spike in the ground plane, hence the crash.

(I was a power electronics engineer a few years ago, before getting into the web.)