It is true that the CS signal is not high frequency, but if any signal is driven by a logic gate, then there can be at most, a 1V difference in the GND levels of the two devices.

Since your units are separated (and most likely powered by different power supplies that are plugged into different outlets), the possibility of offsets and common-mode noise is high. Most 485 devices allow at least 5V between the GNDs.

The differential nature of the signaling greatly reduces induced noise as well.