Set the searcherHolder to null on close. See: http://www.nabble.com/AlreadyClosedException-in-JUnit-tests--tf4893565.html