That explains it. What's needed is a reliable IP address that can be reached from all hosts.
To change the default isolation address to something elst that the default gateway, you'll need to configure some vSphere HA Advanced Options
e.g. das.usedefaultisolationaddress = false, das.isolationaddress0 = <a reliable IP address>
André