Make sure auth state gets invalidated for connection based schemes when the underlying connection is closed