HDFS-3505. DirectoryScanner does not join all threads in shutdown. Contributed by Colin Patrick McCabe