I wonder what would happen if I hooked the front speakers to my expensive amp just temporarily to see if it removes the speaker whine

If the cheap amp is the source of the ground loop, just swapping speaker wires won't make the noise go away... the cheap amp has to be disconnected from the RCA signal cables to remove the ground loop.

___________
Tony Fabris