Let destroy() handle the socket close if the poller has stopped in case the socket is already in the poller for a different event.