Hadoop 2.6.3 Release Notes

• YARN-4434. Minor bug reported by Takashi Ohnishi and fixed by Weiwei Yang (documentation , nodemanager)
  NodeManager Disk Checker parameter documentation is not correct
  

• YARN-4424. Blocker bug reported by Yesha Vora and fixed by Jian He
  Fix deadlock in RMAppImpl
  

• YARN-4365. Major bug reported by Jason Lowe and fixed by Kuhu Shukla (resourcemanager)
  FileSystemNodeLabelStore should check for root dir existence on startup
  

• YARN-4348. Blocker bug reported by Tsuyoshi Ozawa and fixed by Tsuyoshi Ozawa
  ZKRMStateStore.syncInternal shouldn't wait for sync completion for avoiding blocking ZK's event thread
  

• YARN-4344. Critical bug reported by Varun Vasudev and fixed by Varun Vasudev (resourcemanager)
  NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations
  

• YARN-4326. Major bug reported by MENG DING and fixed by MENG DING
  Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188
  

• YARN-4320. Major bug reported by Varun Saxena and fixed by Varun Saxena
  TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188
  

• YARN-4312. Major bug reported by Varun Saxena and fixed by Varun Saxena
  TestSubmitApplicationWithRMHA fails on branch-2.7 and branch-2.6 as some of the test cases time out
  

• YARN-4241. Major bug reported by Anthony Rojas and fixed by Anthony Rojas (documentation)
  Fix typo of property name in yarn-default.xml
  

• YARN-3925. Critical bug reported by zhihai xu and fixed by zhihai xu (nodemanager)
  ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks.
  

• YARN-3878. Critical bug reported by Varun Saxena and fixed by Varun Saxena
  AsyncDispatcher can hang while stopping if it is configured for draining events on stop
  

• YARN-2859. Critical bug reported by Hitesh Shah and fixed by Vinod Kumar Vavilapalli (timelineserver)
  ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster
  

• MAPREDUCE-6549. Major bug reported by Dustin Cote and fixed by Wilfred Spiegelenburg (mrv1 , mrv2)
  multibyte delimiters with LineRecordReader cause duplicate records
  

• MAPREDUCE-6540. Major bug reported by Sangjin Lee and fixed by Sangjin Lee (test)
  TestMRTimelineEventHandling fails
  

• MAPREDUCE-6528. Critical bug reported by Junping Du and fixed by Junping Du (jobhistoryserver)
  Memory leak for HistoryFileManager.getJobSummary()
  

• MAPREDUCE-6481. Critical bug reported by zhihai xu and fixed by zhihai xu (mrv2)
  LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes.
  

• MAPREDUCE-6377. Minor bug reported by Bibin A Chundatt and fixed by zhihai xu (jobhistoryserver)
  JHS sorting on state column not working in webUi
  

• MAPREDUCE-6273. Minor bug reported by zhihai xu and fixed by zhihai xu (jobhistoryserver)
  HistoryFileManager should check whether summaryFile exists to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED state
  

• MAPREDUCE-5948. Critical bug reported by Kris Geusebroek and fixed by Akira AJISAKA
  org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well
  

• MAPREDUCE-5883. Minor bug reported by Nathan Roberts and fixed by Nathan Roberts
  "Total megabyte-seconds" in job counters is slightly misleading
  

• HDFS-9470. Critical bug reported by Xiao Chen and fixed by Xiao Chen
  Encryption zone on root not loaded from fsimage after NN restart
  

• HDFS-9434. Major improvement reported by Tsz Wo Nicholas Sze and fixed by Tsz Wo Nicholas Sze (namenode)
  Recommission a datanode with 500k blocks may pause NN for 30 seconds
  

• HDFS-9431. Major bug reported by Kazuho Fujii and fixed by Kazuho Fujii (hdfs-client)
  DistributedFileSystem#concat fails if the target path is relative.
  

• HDFS-9289. Critical bug reported by Chang Li and fixed by Chang Li
  Make DataStreamer#block thread safe and verify genStamp in commitBlock
  

• HDFS-9273. Critical bug reported by Xiao Chen and fixed by Xiao Chen (namenode)
  ACLs on root directory may be lost after NN restart
  

• HDFS-9083. Blocker bug reported by Rushabh S Shah and fixed by Rushabh S Shah (namenode)
  Replication violates block placement policy.
  

• HDFS-8615. Major bug reported by Akira AJISAKA and fixed by Brahma Reddy Battula (documentation)
  Correct HTTP method in WebHDFS document
  

• HADOOP-12577. Blocker bug reported by Wei-Chiu Chuang and fixed by Wei-Chiu Chuang (build , security)
  Bump up commons-collections version to 3.2.2 to address a security flaw
  

• HADOOP-12526. Major bug reported by Sangjin Lee and fixed by Sangjin Lee (build)
  [Branch-2] there are duplicate dependency definitions in pom's
  

• HADOOP-12413. Major improvement reported by zhihai xu and fixed by zhihai xu (security)
  AccessControlList should avoid calling getGroupNames in isUserInList with empty groups.
  

• HADOOP-12230. Minor bug reported by Steve Loughran and fixed by Rakesh R (build)
  hadoop-project declares duplicate, conflicting curator dependencies
  

• HADOOP-11267. Minor bug reported by Stephen Chu and fixed by Stephen Chu (security , test)
  TestSecurityUtil fails when run with JDK8 because of empty principal names
  

• HADOOP-10668. Major test reported by Ted Yu and fixed by Ming Ma (test)
  TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails
  

• HADOOP-10134. Minor bug reported by Andrew Purtell and fixed by Andrew Purtell
  [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments
  

• HADOOP-9242. Major bug reported by Andrey Klochkov and fixed by Andrey Klochkov (test)
  Duplicate surefire plugin config in hadoop-common