Been wanting to do this for a long time.

Also add methods from `InetSocketAddress` (e.g. `getSocketAddress()`, `getPort()` etc) to `PhysicalAddress`.

The major criteria for this to happen is that this change doesn't introduce any backwards incompatibilities.