Fix CancelledKeyException

Also changed the config callbacks to expose addresses as InetSocketAddress,
instead of the useless SocketAddress base type.