if any unshielded probe or wire is touched to the ground pin

two possibilities
1) your "ground" is not ground (what happens if "ground" is connected to a good GROUND - same as scope)
2) a PCB layout not suitable for the application.

I see no other reason for radiation from a ground pin.

Erik