Apache Hadoop Changelog

Release 3.0.0-beta1 - 2017-09-28

INCOMPATIBLE CHANGES:

JIRA Summary Priority Component Reporter Contributor
HADOOP-14539 Move commons logging APIs over to slf4j in hadoop-common Major . Akira Ajisaka Wenxin He
HDFS-12206 Rename the split EC / replicated block metrics Major metrics Andrew Wang Andrew Wang
HADOOP-13595 Rework hadoop_usage to be broken up by clients/daemons/etc. Blocker scripts Allen Wittenauer Allen Wittenauer
HDFS-6984 Serialize FileStatus via protobuf Major . Colin P. McCabe Chris Douglas
YARN-6961 Remove commons-logging dependency from hadoop-yarn-server-applicationhistoryservice module Minor build Akira Ajisaka Yeliang Cang
HDFS-11957 Enable POSIX ACL inheritance by default Major security John Zhuge John Zhuge
MAPREDUCE-6870 Add configuration for MR job to finish when all reducers are complete (even with unfinished mappers) Major . Zhe Zhang Peter Bacsko
HADOOP-14260 Configuration.dumpConfiguration should redact sensitive information Major conf, security Vihang Karajgaonkar John Zhuge
HADOOP-14726 Mark FileStatus::isDir as final Minor fs Chris Douglas Chris Douglas
HDFS-12303 Change default EC cell size to 1MB for better performance Blocker . Wei Zhou Wei Zhou
HDFS-12258 ec -listPolicies should list all policies in system, no matter it’s enabled or disabled Major . SammiChen Wei Zhou
MAPREDUCE-6892 Issues with the count of failed/killed tasks in the jhist file Major client, jobhistoryserver Peter Bacsko Peter Bacsko
HADOOP-14414 Calling maven-site-plugin directly for docs profile is unnecessary Minor . Andras Bokor Andras Bokor
HDFS-12218 Rename split EC / replicated block metrics in BlockManager Blocker erasure-coding, metrics Andrew Wang Andrew Wang
HADOOP-14847 Remove Guava Supplier and change to java Supplier in AMRMClient and AMRMClientAysnc Blocker . Bharat Viswanadham Bharat Viswanadham
HDFS-12414 Ensure to use CLI command to enable/disable erasure coding policy Major . SammiChen SammiChen
HDFS-12438 Rename dfs.datanode.ec.reconstruction.stripedblock.threads.size to dfs.datanode.ec.reconstruction.threads Major . Andrew Wang Andrew Wang
HADOOP-14738 Remove S3N and obsolete bits of S3A; rework docs Blocker fs/s3 Steve Loughran Steve Loughran
HDFS-7859 Erasure Coding: Persist erasure coding policies in NameNode Major . Kai Zheng SammiChen
HDFS-12395 Support erasure coding policy operations in namenode edit log Major erasure-coding SammiChen SammiChen
HADOOP-14670 Increase minimum cmake version for all platforms Major build Allen Wittenauer Allen Wittenauer
HDFS-12447 Rename AddECPolicyResponse to AddErasureCodingPolicyResponse Major . SammiChen SammiChen
HDFS-7337 Configurable and pluggable erasure codec and policy Critical erasure-coding Zhe Zhang SammiChen

IMPORTANT ISSUES:

JIRA Summary Priority Component Reporter Contributor
YARN-6959 RM may allocate wrong AM Container for new attempt Major capacity scheduler, fairscheduler, scheduler Yuqi Wang Yuqi Wang

NEW FEATURES:

JIRA Summary Priority Component Reporter Contributor
YARN-4161 Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration Major capacity scheduler Mayank Bansal Wei Yan
HADOOP-14560 Make HttpServer2 backlog size configurable Major common Alexander Krasheninnikov Alexander Krasheninnikov
HDFS-10899 Add functionality to re-encrypt EDEKs Major encryption, kms Xiao Chen Xiao Chen
YARN-5355 YARN Timeline Service v.2: alpha 2 Critical timelineserver Sangjin Lee Vrushali C
HADOOP-13345 S3Guard: Improved Consistency for S3A Major fs/s3 Chris Nauroth Chris Nauroth
HADOOP-12077 Provide a multi-URI replication Inode for ViewFs Major fs Gera Shegalov Gera Shegalov
HDFS-7877 Support maintenance state for datanodes Major datanode, namenode Ming Ma Ming Ma
YARN-2915 Enable YARN RM scale out via federation using multiple RM’s Major nodemanager, resourcemanager Sriram Rao Subru Krishnan

IMPROVEMENTS:

JIRA Summary Priority Component Reporter Contributor
HDFS-12042 Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption Major . Misha Dmitriev Misha Dmitriev
HDFS-12078 Add time unit to the description of property dfs.namenode.stale.datanode.interval in hdfs-default.xml Minor documentation, hdfs Weiwei Yang Weiwei Yang
YARN-6752 Display reserved resources in web UI per application Major fairscheduler Abdullah Yousufi Abdullah Yousufi
YARN-6746 SchedulerUtils.checkResourceRequestMatchingNodePartition() is dead code Minor scheduler Daniel Templeton Deepti Sawhney
YARN-6410 FSContext.scheduler should be final Minor fairscheduler Daniel Templeton Yeliang Cang
YARN-6764 Simplify the logic in FairScheduler#attemptScheduling Trivial fairscheduler Yufei Gu Yufei Gu
HADOOP-14443 Azure: Support retry and client side failover for authorization, SASKey and delegation token generation Major fs/azure Santhosh G Nayak Santhosh G Nayak
HADOOP-14535 wasb: implement high-performance random access and seek of block blobs Major fs/azure Thomas Marquardt Thomas Marquardt
HADOOP-14629 Improve exception checking in FileContext related JUnit tests Major fs, test Andras Bokor Andras Bokor
YARN-6689 PlacementRule should be configurable Major . Jonathan Hung Jonathan Hung
HDFS-12130 Optimizing permission check for getContentSummary Major namenode Chen Liang Chen Liang
HDFS-12137 DN dataset lock should be fair Critical datanode Daryn Sharp Daryn Sharp
HDFS-11786 Add support to make copyFromLocal multi threaded Major hdfs Mukul Kumar Singh Mukul Kumar Singh
HDFS-12138 Remove redundant ‘public’ modifiers from BlockCollection Trivial namenode Chen Liang Chen Liang
HADOOP-14640 Azure: Support affinity for service running on localhost and reuse SPNEGO hadoop.auth cookie for authorization, SASKey and delegation token generation Major fs/azure Santhosh G Nayak Santhosh G Nayak
YARN-6778 In ResourceWeights, weights and setWeights() should be final Minor scheduler Daniel Templeton Daniel Templeton
HDFS-12067 Correct dfsadmin commands usage message to reflects IPC port Major . steven-wugang steven-wugang
HADOOP-14666 Tests use assertTrue(….equals(…)) instead of assertEquals() Minor test Daniel Templeton Daniel Templeton
HADOOP-14659 UGI getShortUserName does not need to search the Subject Major common Daryn Sharp Daryn Sharp
HADOOP-14557 Document HADOOP-8143 (Change distcp to have -pb on by default) Trivial . Wei-Chiu Chuang Bharat Viswanadham
YARN-6768 Improve performance of yarn api record toString and fromString Major . Jonathan Eagles Jonathan Eagles
YARN-6779 DominantResourceFairnessPolicy.DominantResourceFairnessComparator.calculateShares() should be @VisibleForTesting Trivial fairscheduler Daniel Templeton Yeliang Cang
YARN-6845 Variable scheduler of FSLeafQueue duplicates the one of its parent FSQueue. Trivial fairscheduler Yufei Gu Yufei Gu
HADOOP-14597 Native compilation broken with OpenSSL-1.1.0 because EVP_CIPHER_CTX has been made opaque Major . Ravi Prakash Ravi Prakash
HDFS-12193 Fix style issues in HttpFS tests Trivial httpfs Zoran Dimitrijevic Zoran Dimitrijevic
HADOOP-14681 Remove MockitoMaker class Major test Andras Bokor Andras Bokor
HDFS-12143 Improve performance of getting and removing inode features Major namenode Daryn Sharp Daryn Sharp
HDFS-12171 Reduce IIP object allocations for inode lookup Major namenode Daryn Sharp Daryn Sharp
HDFS-12190 Enable ‘hdfs dfs -stat’ to display access time Major hdfs, shell Yongjun Zhang Yongjun Zhang
YARN-6864 FSPreemptionThread cleanup for readability Minor fairscheduler Daniel Templeton Daniel Templeton
HADOOP-14455 ViewFileSystem#rename should support be supported within same nameservice with different mountpoints Major viewfs Brahma Reddy Battula Brahma Reddy Battula
HADOOP-14690 RetryInvocationHandler$RetryInfo should override toString() Minor . Akira Ajisaka Yeliang Cang
HADOOP-14709 Fix checkstyle warnings in ContractTestUtils Minor test Steve Loughran Thomas Marquardt
MAPREDUCE-6914 Tests use assertTrue(….equals(…)) instead of assertEquals() Minor test Daniel Templeton Daniel Templeton
YARN-6832 Tests use assertTrue(….equals(…)) instead of assertEquals() Minor test Daniel Templeton Daniel Templeton
HADOOP-14706 Adding a helper method to determine whether a log is Log4j implement Minor util Wenxin He Wenxin He
HADOOP-14471 Upgrade Jetty to latest 9.3 version Major . John Zhuge John Zhuge
HDFS-12251 Add document for StreamCapabilities Major . Lei (Eddy) Xu Lei (Eddy) Xu
HDFS-12224 Add tests to TestJournalNodeSync for sync after JN downtime Major hdfs Hanisha Koneru Hanisha Koneru
YARN-6802 Add Max AM Resource and AM Resource Usage to Leaf Queue View in FairScheduler WebUI Major fairscheduler YunFan Zhou YunFan Zhou
HDFS-12036 Add audit log for some erasure coding operations Major namenode Wei-Chiu Chuang Huafeng Wang
HDFS-12264 DataNode uses a deprecated method IoUtils#cleanup. Major . Ajay Kumar Ajay Kumar
YARN-6811 [ATS1.5] All history logs should be kept under its own User Directory. Major timelineclient, timelineserver Rohith Sharma K S Rohith Sharma K S
YARN-6879 TestLeafQueue.testDRFUserLimits() has commented out code Trivial capacity scheduler, test Daniel Templeton Angela Wang
MAPREDUCE-6923 Optimize MapReduce Shuffle I/O for small partitions Major . Robert Schmidtke Robert Schmidtke
HDFS-12287 Remove a no-longer applicable TODO comment in DatanodeManager Trivial namenode Chen Liang Chen Liang
YARN-6952 Enable scheduling monitor in FS Major fairscheduler, resourcemanager Yufei Gu Yufei Gu
YARN-6884 AllocationFileLoaderService.loadQueue() has an if without braces Trivial fairscheduler Daniel Templeton weiyuan
YARN-6882 AllocationFileLoaderService.reloadAllocations() should use the diamond operator Trivial fairscheduler Daniel Templeton Larry Lo
HADOOP-14627 Support MSI and DeviceCode token provider in ADLS Major fs/adl Atul Sikaria Atul Sikaria
HDFS-12221 Replace xerces in XmlEditsVisitor Major . Lei (Eddy) Xu Ajay Kumar
HADOOP-14741 Refactor curator based ZooKeeper communication into common library Major . Subru Krishnan Íñigo Goiri
HDFS-12162 Update listStatus document to describe the behavior when the argument is a file Major hdfs, httpfs Yongjun Zhang Ajay Kumar
YARN-6881 LOG is unused in AllocationConfiguration Major fairscheduler Daniel Templeton weiyuan
YARN-6917 Queue path is recomputed from scratch on every allocation Minor capacityscheduler Jason Lowe Eric Payne
HADOOP-14673 Remove leftover hadoop_xml_escape from functions Major scripts Allen Wittenauer Ajay Kumar
HADOOP-14662 Update azure-storage sdk to version 5.4.0 Major fs/azure Thomas Marquardt Thomas Marquardt
HDFS-12301 NN File Browser UI: Navigate to a path when enter is pressed Trivial ui Ravi Prakash Ravi Prakash
HDFS-12269 Better to return a Map rather than HashMap in getErasureCodingCodecs Minor erasure-coding Huafeng Wang Huafeng Wang
YARN-3254 HealthReport should include disk full information Major nodemanager Akira Ajisaka Suma Shivaprasad
HDFS-12072 Provide fairness between EC and non-EC recovery tasks. Major erasure-coding Lei (Eddy) Xu Lei (Eddy) Xu
HDFS-12117 HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface Major httpfs Wellington Chevreuil Wellington Chevreuil
HADOOP-14705 Add batched interface reencryptEncryptedKeys to KMS Major kms Xiao Chen Xiao Chen
YARN-7053 Move curator transaction support to ZKCuratorManager Major . Jonathan Hung Jonathan Hung
HADOOP-14251 Credential provider should handle property key deprecation Critical security John Zhuge John Zhuge
YARN-7049 FSAppAttempt preemption related fields have confusing names Major fairscheduler Karthik Kambatla Karthik Kambatla
HDFS-11986 Dfsadmin should report erasure coding related information separately Major erasure-coding, hdfs Manoj Govindassamy Manoj Govindassamy
YARN-6999 Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster Minor documentation, security Linlin Zhou Linlin Zhou
YARN-7037 Optimize data transfer with zero-copy approach for containerlogs REST API in NMWebServices Major nodemanager Tao Yang Tao Yang
HDFS-12356 Unit test for JournalNode sync during Rolling Upgrade Major ha Hanisha Koneru Hanisha Koneru
YARN-6780 ResourceWeights.toString() cleanup Minor scheduler Daniel Templeton weiyuan
YARN-6721 container-executor should have stack checking Critical nodemanager, security Allen Wittenauer Allen Wittenauer
HADOOP-14781 Clarify that HADOOP_CONF_DIR shouldn’t actually be set in hadoop-env.sh Major documentation, scripts Allen Wittenauer Allen Wittenauer
HDFS-12380 Simplify dataQueue.wait condition logical operation in DataStreamer::run() Major hdfs-client liaoyuxiangqin liaoyuxiangqin
HDFS-12300 Audit-log delegation token related operations Major namenode Xiao Chen Xiao Chen
YARN-7022 Improve click interaction in queue topology in new YARN UI Major yarn-ui-v2 Abdullah Yousufi Abdullah Yousufi
HDFS-12182 BlockManager.metaSave does not distinguish between “under replicated” and “missing” blocks Trivial hdfs Wellington Chevreuil Wellington Chevreuil
HADOOP-14688 Intern strings in KeyVersion and EncryptedKeyVersion Major kms Xiao Chen Xiao Chen
HDFS-12377 Refactor TestReadStripedFileWithDecoding to avoid test timeouts Major erasure-coding Andrew Wang Andrew Wang
HADOOP-14827 Allow StopWatch to accept a Timer parameter for tests Minor common, test Erik Krogen Erik Krogen
HDFS-12131 Add some of the FSNamesystem JMX values as metrics Minor hdfs, namenode Erik Krogen Erik Krogen
HDFS-12402 Refactor ErasureCodingPolicyManager and related codes Major erasure-coding SammiChen SammiChen
YARN-6930 Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager Major nodemanager Vinod Kumar Vavilapalli Shane Kumpf
HADOOP-14844 Remove requirement to specify TenantGuid for MSI Token Provider Major fs/adl Atul Sikaria Atul Sikaria
YARN-6799 Remove the duplicated code in CGroupsHandlerImp.java Trivial nodemanager Yufei Gu weiyuan
HADOOP-14520 WASB: Block compaction for Azure Block Blobs Major fs/azure Georgi Chalakov Georgi Chalakov
HADOOP-14839 DistCp log output should contain copied and deleted files and directories Major tools/distcp Konstantin Shaposhnikov Yiqun Lin
YARN-7132 FairScheduler.initScheduler() contains a surprising unary plus Minor fairscheduler Daniel Templeton Yeliang Cang
HADOOP-14843 Improve FsPermission symbolic parsing unit test coverage Minor fs Jason Lowe Bharat Viswanadham
YARN-7057 FSAppAttempt#getResourceUsage doesn’t need to consider resources queued for preemption Major fairscheduler Karthik Kambatla Karthik Kambatla
HDFS-12412 Change ErasureCodingWorker.stripedReadPool to cached thread pool Major erasure-coding Lei (Eddy) Xu Lei (Eddy) Xu
HADOOP-14804 correct wrong parameters format order in core-default.xml Trivial . Chen Hongfei Chen Hongfei
HDFS-12409 Add metrics of execution time of different stages in EC recovery task Minor erasure-coding Lei (Eddy) Xu Lei (Eddy) Xu
HADOOP-14864 FSDataInputStream#unbuffer UOE should include stream class name Minor fs John Zhuge Bharat Viswanadham
HADOOP-14869 Upgrade apache kerby verion to v1.0.1 Major . Wei Zhou Wei Zhou
MAPREDUCE-6956 FileOutputCommitter to gain abstract superclass PathOutputCommitter Minor mrv2 Steve Loughran Steve Loughran
MAPREDUCE-6954 Disable erasure coding for files that are uploaded to the MR staging area Major client Peter Bacsko Peter Bacsko
HDFS-12349 Improve log message when it could not alloc enough blocks for EC Minor erasure-coding Lei (Eddy) Xu Lei (Eddy) Xu
HDFS-12441 Suppress UnresolvedPathException in namenode log Minor . Kihwal Lee Kihwal Lee
HADOOP-13714 Tighten up our compatibility guidelines for Hadoop 3 Blocker documentation Karthik Kambatla Daniel Templeton
HDFS-12472 Add JUNIT timeout to TestBlockStatsMXBean Minor . Lei (Eddy) Xu Bharat Viswanadham
HDFS-12460 Make addErasureCodingPolicy an idempotent operation Major erasure-coding SammiChen SammiChen
HDFS-12479 Some misuses of lock in DFSStripedOutputStream Minor erasure-coding Huafeng Wang Huafeng Wang
MAPREDUCE-6958 Shuffle audit logger should log size of shuffle transfer Minor . Jason Lowe Jason Lowe
HDFS-12444 Reduce runtime of TestWriteReadStripedFile Major erasure-coding, test Andrew Wang Huafeng Wang
HDFS-12445 Correct spellings of choosen to chosen. Trivial . hu xiaodong hu xiaodong
HADOOP-7308 Remove unused TaskLogAppender configurations from log4j.properties Major conf Todd Lipcon Todd Lipcon
HDFS-12496 Make QuorumJournalManager timeout properties configurable Major . Ajay Kumar Ajay Kumar
HDFS-12530 Processor argument in Offline Image Viewer should be case insensitive Minor tools Hanisha Koneru Hanisha Koneru
HDFS-12304 Remove unused parameter from FsDatasetImpl#addVolume Minor . Chen Liang Chen Liang
YARN-65 Reduce RM app memory footprint once app has completed Major resourcemanager Jason Lowe Manikandan R

BUG FIXES:

JIRA Summary Priority Component Reporter Contributor
YARN-6093 Minor bugs with AMRMtoken renewal and state store availability when using FederationRMFailoverProxyProvider during RM failover Minor amrmproxy, federation Botong Huang Botong Huang
YARN-6370 Properly handle rack requests for non-active subclusters in LocalityMulticastAMRMProxyPolicy Minor . Botong Huang Botong Huang
HDFS-12043 Add counters for block re-replication Major . Chen Liang Chen Liang
YARN-6694 Add certain envs to the default yarn.nodemanager.env-whitelist Major . Jian He Jian He
MAPREDUCE-6905 Fix meaningless operations in TestDFSIO in some situation. Major tools/rumen LiXin Ge LiXin Ge
HDFS-12079 Description of dfs.block.invalidate.limit is incorrect in hdfs-default.xml Minor documentation Weiwei Yang Weiwei Yang
HADOOP-13414 Hide Jetty Server version header in HTTP responses Major security Vinayakumar B Surendra Singh Lilhore
HDFS-12089 Fix ambiguous NN retry log message Major webhdfs Eric Badger Eric Badger
HADOOP-14608 KMS JMX servlet path not backwards compatible Minor kms John Zhuge John Zhuge
YARN-6708 Nodemanager container crash after ext3 folder limit Critical . Bibin A Chundatt Bibin A Chundatt
HADOOP-14563 LoadBalancingKMSClientProvider#warmUpEncryptedKeys swallows IOException Major . Rushabh S Shah Rushabh S Shah
MAPREDUCE-6246 DBOutputFormat.java appending extra semicolon to query which is incompatible with DB2 Major mrv1, mrv2 ramtin Gergely Novák
HADOOP-14634 Remove jline from main Hadoop pom.xml Major . Ray Chiang Ray Chiang
YARN-6428 Queue AM limit is not honored in CS always Major . Bibin A Chundatt Bibin A Chundatt
YARN-6770 [Docs] A small mistake in the example of TimelineClient Trivial docs Jinjiang Ling Jinjiang Ling
HADOOP-10829 Iteration on CredentialProviderFactory.serviceLoader is thread-unsafe Major security Benoy Antony Benoy Antony
HDFS-12085 Reconfigure namenode heartbeat interval fails if the interval was set with time unit Minor hdfs, tools Weiwei Yang Weiwei Yang
HDFS-12052 Set SWEBHDFS delegation token kind when ssl is enabled in HttpFS Major httpfs, webhdfs Zoran Dimitrijevic Zoran Dimitrijevic
HDFS-12114 Consistent HttpFS property names Major httpfs John Zhuge John Zhuge
HADOOP-14581 Restrict setOwner to list of user when security is enabled in wasb Major fs/azure Varada Hemeswari Varada Hemeswari
YARN-6809 Fix typo in ResourceManagerHA.md Trivial documentation Akira Ajisaka Yeliang Cang
YARN-6797 TimelineWriter does not fully consume the POST response Major timelineclient Jason Lowe Jason Lowe
HDFS-11502 Datanode UI should display hostname based on JMX bean instead of window.location.hostname Major hdfs Jeffrey E Rodriguez Jeffrey E Rodriguez
HADOOP-14646 FileContextMainOperationsBaseTest#testListStatusFilterWithSomeMatches never runs Minor test Andras Bokor Andras Bokor
YARN-6654 RollingLevelDBTimelineStore backwards incompatible after fst upgrade Blocker . Jonathan Eagles Jonathan Eagles
YARN-6805 NPE in LinuxContainerExecutor due to null PrivilegedOperationException exit code Major nodemanager Jason Lowe Jason Lowe
YARN-6792 Incorrect XML convertion in NodeIDsInfo and LabelsToNodesInfo Blocker resourcemanager Giovanni Matteo Fumarola Giovanni Matteo Fumarola
YARN-6769 Make schedulables without demand less needy in FairSharePolicy#compare Major fairscheduler YunFan Zhou YunFan Zhou
YARN-6759 Fix TestRMRestart.testRMRestartWaitForPreviousAMToFinish failure Major . Naganarasimha G R Naganarasimha G R
YARN-3260 AM attempt fail to register before RM processes launch event Critical resourcemanager Jason Lowe Bibin A Chundatt
HDFS-12140 Remove BPOfferService lock contention to get block pool id Critical datanode Daryn Sharp Daryn Sharp
YARN-6625 yarn application -list returns a tracking URL for AM that doesn’t work in secured and HA environment Major amrmproxy Yufei Gu Yufei Gu
HDFS-12112 TestBlockManager#testBlockManagerMachinesArray sometimes fails with NPE Minor . Wei-Chiu Chuang Wei-Chiu Chuang
YARN-6714 IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler Major . Tao Yang Tao Yang
MAPREDUCE-6889 Add Job#close API to shutdown MR client services. Major . Rohith Sharma K S Rohith Sharma K S
MAPREDUCE-6910 MapReduceTrackingUriPlugin can not return the right URI of history server with HTTPS Major jobhistoryserver Lantao Jin Lantao Jin
HDFS-12154 Incorrect javadoc description in StorageLocationChecker#check Major . Nandakumar Nandakumar
YARN-6798 Fix NM startup failure with old state store due to version mismatch Major nodemanager Ray Chiang Botong Huang
HADOOP-14637 GenericTestUtils.waitFor needs to check condition again after max wait time Major . Daniel Templeton Daniel Templeton
YARN-6819 Application report fails if app rejected due to nodesize Major . Bibin A Chundatt Bibin A Chundatt
HADOOP-14669 GenericTestUtils.waitFor should use monotonic time Trivial test Jason Lowe Daniel Templeton
HDFS-12133 Correct ContentSummaryComputationContext Logger class name. Minor namenode Surendra Singh Lilhore Surendra Singh Lilhore
HDFS-12158 Secondary Namenode’s web interface lack configs for X-FRAME-OPTIONS protection Major namenode Mukul Kumar Singh Mukul Kumar Singh
HDFS-12139 HTTPFS liststatus returns incorrect pathSuffix for path of file Major httpfs Yongjun Zhang Yongjun Zhang
YARN-6837 Null LocalResource visibility or resource type can crash the nodemanager Major . Jinjiang Ling Jinjiang Ling
HDFS-11472 Fix inconsistent replica size after a data pipeline failure Critical datanode Wei-Chiu Chuang Erik Krogen
HDFS-12166 Do not deprecate HTTPFS_TEMP Minor httpfs John Zhuge John Zhuge
HDFS-11742 Improve balancer usability after HDFS-8818 Blocker . Kihwal Lee Kihwal Lee
HDFS-12094 Log torrent when none isa-l EC is used. Minor erasure-coding LiXin Ge LiXin Ge
HDFS-12176 dfsadmin shows DFS Used%: NaN% if the cluster has zero block. Trivial . Wei-Chiu Chuang Weiwei Yang
YARN-6844 AMRMClientImpl.checkNodeLabelExpression() has wrong error message Minor . Daniel Templeton Manikandan R
YARN-6150 TestContainerManagerSecurity tests for Yarn Server are flakey Major test Daniel Sturman Daniel Sturman
YARN-6307 Refactor FairShareComparator#compare Major fairscheduler Yufei Gu Yufei Gu
YARN-6102 RMActiveService context to be updated with new RMContext on failover Critical . Ajith S Rohith Sharma K S
HADOOP-14578 Bind IPC connections to kerberos UPN host for proxy users Major ipc Daryn Sharp Daryn Sharp
HDFS-11896 Non-dfsUsed will be doubled on dead node re-registration Blocker . Brahma Reddy Battula Brahma Reddy Battula
HADOOP-14692 Upgrade Apache Rat Trivial build Allen Wittenauer Allen Wittenauer
HDFS-12062 removeErasureCodingPolicy needs super user permission Critical erasure-coding Wei-Chiu Chuang Wei-Chiu Chuang
HDFS-12044 Mismatch between BlockManager#maxReplicationStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and bursty recovery Major erasure-coding Lei (Eddy) Xu Lei (Eddy) Xu
HADOOP-14229 hadoop.security.auth_to_local example is incorrect in the documentation Major . Andras Bokor Andras Bokor
YARN-6870 Fix floating point inaccuracies in resource availability check in AllocationBasedResourceUtilizationTracker Major api, nodemanager Brook Zhou Brook Zhou
YARN-5728 TestMiniYarnClusterNodeUtilization.testUpdateNodeUtilization timeout Major test Akira Ajisaka Akira Ajisaka
HADOOP-14677 mvn clean compile fails Major build Andras Bokor Andras Bokor
HDFS-12082 BlockInvalidateLimit value is incorrectly set after namenode heartbeat interval reconfigured Major hdfs, namenode Weiwei Yang Weiwei Yang
MAPREDUCE-6924 Revert MAPREDUCE-6199 MAPREDUCE-6286 and MAPREDUCE-5875 Major . Andrew Wang Junping Du
HADOOP-14420 generateReports property is not applicable for maven-site-plugin:attach-descriptor goal Minor . Andras Bokor Andras Bokor
HADOOP-14644 Increase max heap size of Maven javadoc plugin Major test Andras Bokor Andras Bokor
HADOOP-14343 Wrong pid file name in error message when starting secure daemon Minor . Andras Bokor Andras Bokor
MAPREDUCE-6921 TestUmbilicalProtocolWithJobToken#testJobTokenRpc fails Major . Sonia Garudi Sonia Garudi
HADOOP-14676 Wrong default value for “fs.df.interval” Major common, conf, fs Konstantin Shvachko xiangguang zheng
HADOOP-14701 Configuration can log misleading warnings about an attempt to override final parameter Major conf Andrew Sherman Andrew Sherman
YARN-5731 Preemption calculation is not accurate when reserved containers are present in queue. Major capacity scheduler Sunil G Wangda Tan
HADOOP-14683 FileStatus.compareTo binary compatible issue Blocker . Sergey Shelukhin Akira Ajisaka
HDFS-12107 FsDatasetImpl#removeVolumes floods the logs when removing the volume Major . Haohui Mai Kelvin Chu
HADOOP-14702 Fix formatting issue and regression caused by conversion from APT to Markdown Minor documentation Doris Gu Doris Gu
YARN-6872 Ensure apps could run given NodeLabels are disabled post RM switchover/restart Major resourcemanager Sunil G Sunil G
HDFS-12217 HDFS snapshots doesn’t capture all open files when one of the open files is deleted Major snapshots Manoj Govindassamy Manoj Govindassamy
YARN-6846 Nodemanager can fail to fully delete application local directories when applications are killed Critical nodemanager Jason Lowe Jason Lowe
YARN-6678 Handle IllegalStateException in Async Scheduling mode of CapacityScheduler Major capacityscheduler Tao Yang Tao Yang
YARN-6932 Fix TestFederationRMFailoverProxyProvider test case failure Major . Arun Suresh Subru Krishnan
YARN-6895 [FairScheduler] Preemption reservation may cause regular reservation leaks Blocker fairscheduler Miklos Szegedi Miklos Szegedi
HADOOP-13963 /bin/bash is hard coded in some of the scripts Major scripts Miklos Szegedi Ajay Kumar
HADOOP-14722 Azure: BlockBlobInputStream position incorrect after seek Major fs/azure Thomas Marquardt Thomas Marquardt
YARN-6951 Fix debug log when Resource Handler chain is enabled Minor . Yang Wang Yang Wang
HADOOP-14727 Socket not closed properly when reading Configurations with BlockReaderRemote Blocker conf Xiao Chen Jonathan Eagles
YARN-6920 Fix resource leak that happens during container re-initialization. Major nodemanager Arun Suresh Arun Suresh
HADOOP-14730 Support protobuf FileStatus in AdlFileSystem Major . Vishwajeet Dusane Chris Douglas
HDFS-12198 Document missing namenode metrics that were added recently Minor documentation Yiqun Lin Yiqun Lin
HADOOP-14680 Azure: IndexOutOfBoundsException in BlockBlobInputStream Minor fs/azure Rajesh Balamohan Thomas Marquardt
YARN-6757 Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path Minor nodemanager Miklos Szegedi Miklos Szegedi
MAPREDUCE-6927 MR job should only set tracking url if history was successfully written Major . Eric Badger Eric Badger
YARN-6890 If UI is not secured, we allow user to kill other users’ job even yarn cluster is secured. Critical . Sumana Sathish Junping Du
HDFS-10326 Disable setting tcp socket send/receive buffers for write pipelines Major datanode, hdfs Daryn Sharp Daryn Sharp
HADOOP-14598 Blacklist Http/HttpsFileSystem in FsUrlStreamHandlerFactory Major fs/azure, test Steve Loughran Steve Loughran
YARN-6515 Fix warnings from Spotbugs in hadoop-yarn-server-nodemanager Major nodemanager Naganarasimha G R Naganarasimha G R
HDFS-12157 Do fsyncDirectory(..) outside of FSDataset lock Critical datanode Vinayakumar B Vinayakumar B
HDFS-12278 LeaseManager operations are inefficient in 2.8. Blocker namenode Rushabh S Shah Rushabh S Shah
HADOOP-14743 CompositeGroupsMapping should not swallow exceptions Major security Wei-Chiu Chuang Wei-Chiu Chuang
HADOOP-14754 TestCommonConfigurationFields failed: core-default.xml has 2 wasb properties missing in classes Minor common, fs/azure John Zhuge John Zhuge
HADOOP-14760 Add missing override to LoadBalancingKMSClientProvider Minor kms Xiao Chen Xiao Chen
YARN-5927 BaseContainerManagerTest::waitForNMContainerState timeout accounting is not accurate Trivial . Miklos Szegedi Kai Sasaki
YARN-6967 Limit application attempt’s diagnostic message size thoroughly Major resourcemanager Chengbing Liu Chengbing Liu
HDFS-11303 Hedged read might hang infinitely if read data from all DN failed Major hdfs-client Chen Zhang Chen Zhang
YARN-6996 Change javax.cache library implementation from JSR107 to Apache Geronimo Blocker . Ray Chiang Ray Chiang
YARN-6987 Log app attempt during InvalidStateTransition Major . Jonathan Eagles Jonathan Eagles
HDFS-11696 Fix warnings from Spotbugs in hadoop-hdfs Major . Yiqun Lin Yiqun Lin
HDFS-12066 When Namenode is in safemode,may not allowed to remove an user’s erasure coding policy Major hdfs lufei lufei
HDFS-12054 FSNamesystem#addErasureCodingPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode Major hdfs lufei lufei
YARN-7014 container-executor has off-by-one error which can corrupt the heap Critical yarn Shane Kumpf Jason Lowe
HADOOP-14773 Extend ZKCuratorManager API for more reusability Major . Íñigo Goiri Íñigo Goiri
YARN-6965 Duplicate instantiation in FairSchedulerQueueInfo Minor fairscheduler Masahiro Tanaka Masahiro Tanaka
YARN-7020 TestAMRMProxy#testAMRMProxyTokenRenewal is flakey Major . Robert Kanter Robert Kanter
MAPREDUCE-6940 Copy-paste error in the TaskAttemptUnsuccessfulCompletionEvent constructor Minor . Oleg Danilov Oleg Danilov
MAPREDUCE-6936 Remove unnecessary dependency of hadoop-yarn-server-common from hadoop-mapreduce-client-common Major mrv2 Haibo Chen Haibo Chen
HDFS-12250 Reduce usage of FsPermissionExtension in unit tests Minor test Chris Douglas Chris Douglas
HDFS-12316 Verify HDFS snapshot deletion doesn’t crash the ongoing file writes Major . Manoj Govindassamy Manoj Govindassamy
YARN-7007 NPE in RM while using YarnClient.getApplications() Major . Lingfeng Su Lingfeng Su
HDFS-12325 SFTPFileSystem operations should restore cwd Major . Namit Maheshwari Chen Liang
HDFS-11738 Hedged pread takes more time when block moved from initial locations Major hdfs-client Vinayakumar B Vinayakumar B
YARN-2416 InvalidStateTransitonException in ResourceManager if AMLauncher does not receive response for startContainers() call in time Critical resourcemanager Jian Fang Jonathan Eagles
YARN-7048 Fix tests faking kerberos to explicitly set ugi auth type Major yarn Daryn Sharp Daryn Sharp
HADOOP-14687 AuthenticatedURL will reuse bad/expired session cookies Critical common Daryn Sharp Daryn Sharp
YARN-6251 Do async container release to prevent deadlock during container updates Major . Arun Suresh Arun Suresh
YARN-7090 testRMRestartAfterNodeLabelDisabled get failed when CapacityScheduler is configured Major test Yesha Vora Wangda Tan
HDFS-12318 Fix IOException condition for openInfo in DFSInputStream Major . legend legend
YARN-7074 Fix NM state store update comment Minor nodemanager Botong Huang Botong Huang
HDFS-12344 LocatedFileStatus regression: no longer accepting null FSPermission Minor fs Ewan Higgs Ewan Higgs
YARN-6640 AM heartbeat stuck when responseId overflows MAX_INT Blocker . Botong Huang Botong Huang
HDFS-12319 DirectoryScanner will throw IllegalStateException when Multiple BP’s are present Blocker . Brahma Reddy Battula Brahma Reddy Battula
HDFS-12299 Race Between update pipeline and DN Re-Registration Critical . Brahma Reddy Battula Brahma Reddy Battula
YARN-7052 RM SchedulingMonitor gives no indication why the spawned thread crashed. Critical yarn Eric Payne Eric Payne
YARN-7087 NM failed to perform log aggregation due to absent container Blocker log-aggregation Jason Lowe Jason Lowe
HDFS-12215 DataNode#transferBlock does not create its daemon in the xceiver thread group Major datanode Lei (Eddy) Xu Lei (Eddy) Xu
HDFS-12248 SNN will not upload fsimage on IOE and Interrupted exceptions Critical ha, namenode, rolling upgrades Brahma Reddy Battula Brahma Reddy Battula
HDFS-12358 Handle IOException when transferring edit log to Journal current dir through JN sync Major . Hanisha Koneru Hanisha Koneru
MAPREDUCE-6945 TestMapFileOutputFormat missing @after annotation Minor . Ajay Kumar Ajay Kumar
YARN-7051 Avoid concurrent modification exception in FifoIntraQueuePreemptionPlugin Critical capacity scheduler, scheduler preemption, yarn Eric Payne Eric Payne
YARN-7099 ResourceHandlerModule.parseConfiguredCGroupPath only works for privileged yarn users. Minor nodemanager Miklos Szegedi Miklos Szegedi
YARN-7112 TestAMRMProxy is failing with invalid request Major . Jason Lowe Jason Lowe
HDFS-12293 DataNode should log file name on disk error Major datanode Wei-Chiu Chuang Ajay Kumar
YARN-7076 yarn application -list -appTypes <appType> is not working Blocker . Jian He Jian He
YARN-5816 TestDelegationTokenRenewer#testCancelWithMultipleAppSubmissions is still flakey Minor resourcemanager, test Daniel Templeton Robert Kanter
YARN-6756 ContainerRequest#executionTypeRequest causes NPE Critical . Jian He Jian He
HDFS-12191 Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done to this file Major hdfs, namenode Yongjun Zhang Yongjun Zhang
YARN-6982 Potential issue on setting AMContainerSpec#tokenConf to null before app is completed Major . Rohith Sharma K S Manikandan R
YARN-6868 Add test scope to certain entries in hadoop-yarn-server-resourcemanager pom.xml Major yarn Ray Chiang Ray Chiang
HDFS-12336 Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory Minor encryption, hdfs Wellington Chevreuil Wellington Chevreuil
HADOOP-14814 Fix incompatible API change on FsServerDefaults to HADOOP-14104 Blocker . Junping Du Junping Du
MAPREDUCE-6931 Remove TestDFSIO “Total Throughput” calculation Critical benchmarks, test Dennis Huo Dennis Huo
YARN-7115 Move BoundedAppender to org.hadoop.yarn.util pacakge Major . Jian He Jian He
YARN-7077 TestAMSimulator and TestNMSimulator fail Major test Akira Ajisaka Akira Ajisaka
YARN-7116 CapacityScheduler Web UI: Queue’s AM usage is always show on per-user’s AM usage. Major capacity scheduler, webapp Wangda Tan Wangda Tan
YARN-6726 Fix issues with docker commands executed by container-executor Major nodemanager Shane Kumpf Shane Kumpf
HADOOP-14364 refresh changelog/release notes with newer Apache Yetus build Major build, documentation Allen Wittenauer Allen Wittenauer
HDFS-12317 HDFS metrics render error in the page of Github Minor documentation, metrics Yiqun Lin Yiqun Lin
HADOOP-14824 Update ADLS SDK to 2.2.2 for MSI fix Major fs/adl Atul Sikaria Atul Sikaria
HDFS-12363 Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompactStorages Major namenode Xiao Chen Xiao Chen
YARN-7141 Move logging APIs to slf4j in timelineservice after ATSv2 merge Minor . Varun Saxena Varun Saxena
HDFS-11964 Decoding inputs should be correctly prepared in pread Major erasure-coding Lei (Eddy) Xu Takanobu Asanuma
YARN-7120 CapacitySchedulerPage NPE in “Aggregate scheduler counts” section Minor . Eric Payne Eric Payne
HADOOP-14674 Correct javadoc for getRandomizedTempPath Major common Mukul Kumar Singh Mukul Kumar Singh
YARN-7023 Incorrect ReservationId.compareTo() implementation Minor reservation system Oleg Danilov Oleg Danilov
HDFS-12383 Re-encryption updater should handle canceled tasks better Major encryption Xiao Chen Xiao Chen
YARN-7152 [ATSv2] Registering timeline client before AMRMClient service init throw exception. Major timelineclient Rohith Sharma K S Rohith Sharma K S
HDFS-12388 A bad error message in DFSStripedOutputStream Major erasure-coding Kai Zheng Huafeng Wang
HADOOP-14820 Wasb mkdirs security checks inconsistent with HDFS Major fs/azure Sivaguru Sankaridurg Sivaguru Sankaridurg
HDFS-12359 Re-encryption should operate with minimum KMS ACL requirements. Major encryption Xiao Chen Xiao Chen
HDFS-11882 Precisely calculate acked length of striped block groups in updatePipeline Critical erasure-coding, test Akira Ajisaka Andrew Wang
HDFS-12392 Writing striped file failed due to different cell size Major erasure-coding SammiChen SammiChen
YARN-7164 TestAMRMClientOnRMRestart fails sporadically with bind address in use Major test Jason Lowe Jason Lowe
YARN-6992 Kill application button is visible even if the application is FINISHED in RM UI Major . Sumana Sathish Suma Shivaprasad
HDFS-12357 Let NameNode to bypass external attribute provider for special user Major . Yongjun Zhang Yongjun Zhang
HDFS-12369 Edit log corruption due to hard lease recovery of not-closed file which has snapshots Major namenode Xiao Chen Xiao Chen
HDFS-12404 Rename hdfs config authorization.provider.bypass.users to attributes.provider.bypass.users Major hdfs Yongjun Zhang Manoj Govindassamy
HDFS-12400 Provide a way for NN to drain the local key cache before re-encryption Major encryption Xiao Chen Xiao Chen
YARN-7140 CollectorInfo should have Public visibility Minor . Varun Saxena Varun Saxena
YARN-7130 ATSv2 documentation changes post merge Major timelineserver Varun Saxena Varun Saxena
HADOOP-14851 LambdaTestUtils.eventually() doesn’t spin on Assertion failures Major test Steve Loughran Steve Loughran
YARN-7181 CPUTimeTracker.updateElapsedJiffies can report negative usage Major . Miklos Szegedi Miklos Szegedi
HDFS-12417 Disable flaky TestDFSStripedOutputStreamWithFailure Major test Chris Douglas Andrew Wang
HADOOP-14856 Fix AWS, Jetty, HBase, Ehcache entries for NOTICE.txt Major . Ray Chiang Ray Chiang
HDFS-12407 Journal nodes fails to shutdown cleanly if JournalNodeHttpServer or JournalNodeRpcServer fails to start Major . Ajay Kumar Ajay Kumar
YARN-7185 ContainerScheduler should only look at availableResource for GUARANTEED containers when OPPORTUNISTIC container queuing is enabled. Blocker yarn Sumana Sathish Tan, Wangda
HDFS-12222 Document and test BlockLocation for erasure-coded files Major . Andrew Wang Huafeng Wang
HADOOP-14867 Update HDFS Federation setup document, for incorrect property name for secondary name node http address Major . Bharat Viswanadham Bharat Viswanadham
YARN-4727 Unable to override the $HADOOP_CONF_DIR env variable for container Major nodemanager Terence Yim Jason Lowe
MAPREDUCE-6957 shuffle hangs after a node manager connection timeout Major mrv2 Jooseong Kim Jooseong Kim
YARN-7146 Many RM unit tests failing with FairScheduler Major test Robert Kanter Robert Kanter
HDFS-12457 Revert HDFS-11156 Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API Major webhdfs Andrew Wang Andrew Wang
HDFS-12378 TestClientProtocolForPipelineRecovery#testZeroByteBlockRecovery fails on trunk Blocker test Xiao Chen Lei (Eddy) Xu
HDFS-12456 TestNamenodeMetrics.testSyncAndBlockReportMetric fails Minor hdfs, metrics Bharat Viswanadham Bharat Viswanadham
YARN-7163 RMContext need not to be injected to webapp and other Always Running services. Blocker resourcemanager Rohith Sharma K S Rohith Sharma K S
HDFS-12424 Datatable sorting on the Datanode Information page in the Namenode UI is broken Major . Shawna Martell Shawna Martell
HADOOP-14853 hadoop-mapreduce-client-app is not a client module Major . Haibo Chen Haibo Chen
HDFS-12323 NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout Major namenode, qjm Erik Krogen Erik Krogen
HDFS-10701 TestDFSStripedOutputStreamWithFailure#testBlockTokenExpired occasionally fails Major erasure-coding Wei-Chiu Chuang SammiChen
YARN-6977 Node information is not provided for non am containers in RM logs Major capacity scheduler Sumana Sathish Suma Shivaprasad
YARN-7149 Cross-queue preemption sometimes starves an underserved queue Major capacity scheduler Eric Payne Eric Payne
YARN-7192 Add a pluggable StateMachine Listener that is notified of NM Container State changes Major . Arun Suresh Arun Suresh
HADOOP-14835 mvn site build throws SAX errors Blocker build, site Allen Wittenauer Andrew Wang
MAPREDUCE-6960 Shuffle Handler prints disk error stack traces for every read failure. Major . Kuhu Shukla Kuhu Shukla
HDFS-12480 TestNameNodeMetrics#testTransactionAndCheckpointMetrics Fails in trunk Blocker test Brahma Reddy Battula Hanisha Koneru
HDFS-11799 Introduce a config to allow setting up write pipeline with fewer nodes than replication factor Major . Yongjun Zhang Brahma Reddy Battula
HDFS-12449 TestReconstructStripedFile.testNNSendsErasureCodingTasks randomly cannot finish in 60s Major erasure-coding SammiChen SammiChen
HDFS-12437 Fix test setup in TestLeaseRecoveryStriped Major erasure-coding, test Arpit Agarwal Andrew Wang
YARN-7196 Fix finicky TestContainerManager tests Major . Arun Suresh Arun Suresh
YARN-6771 Use classloader inside configuration class to make new classes Major . Jongyoul Lee Jongyoul Lee
HDFS-12526 FSDirectory should use Time.monotonicNow for durations Minor . Chetna Chaudhari Bharat Viswanadham
YARN-6968 Hardcoded absolute pathname in DockerLinuxContainerRuntime Major nodemanager Miklos Szegedi Eric Badger
HDFS-12371 “BlockVerificationFailures” and “BlocksVerified” show up as 0 in Datanode JMX Major metrics Sai Nukavarapu Hanisha Koneru
MAPREDUCE-6964 BaileyBorweinPlouffe should use Time.monotonicNow for measuring durations Minor examples Chetna Chaudhari Chetna Chaudhari
YARN-6991 “Kill application” button does not show error if other user tries to kill the application for secure cluster Major . Sumana Sathish Suma Shivaprasad
YARN-7034 DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor Blocker nodemanager Miklos Szegedi Miklos Szegedi
HDFS-12523 Thread pools in ErasureCodingWorker do not shutdown Major erasure-coding Lei (Eddy) Xu Huafeng Wang
MAPREDUCE-6966 DistSum should use Time.monotonicNow for measuring durations Minor . Chetna Chaudhari Chetna Chaudhari
MAPREDUCE-6965 QuasiMonteCarlo should use Time.monotonicNow for measuring durations Minor examples Chetna Chaudhari Chetna Chaudhari
MAPREDUCE-6967 gridmix/SleepReducer should use Time.monotonicNow for measuring durations Minor . Chetna Chaudhari Chetna Chaudhari
YARN-7153 Remove duplicated code in AMRMClientAsyncImpl.java Minor client Sen Zhao Sen Zhao
HADOOP-14897 Loosen compatibility guidelines for native dependencies Blocker documentation, native Chris Douglas Daniel Templeton
HADOOP-14903 Add json-smart explicitly to pom.xml Major common Ray Chiang Ray Chiang
YARN-7118 AHS REST API can return NullPointerException Major . Prabhu Joseph Billie Rinaldi
HDFS-12495 TestPendingInvalidateBlock#testPendingDeleteUnknownBlocks fails intermittently Major . Eric Badger Eric Badger
MAPREDUCE-6968 Staging directory erasure coding config property has a typo Major client Jason Lowe Jason Lowe
HADOOP-14822 hadoop-project/pom.xml is executable Minor . Akira Ajisaka Ajay Kumar
YARN-7157 Add admin configuration to filter per-user’s apps in secure cluster Major webapp Sunil G Sunil G
YARN-7253 Shared Cache Manager daemon command listed as admin subcmd in yarn script Trivial . Chris Trezzo Chris Trezzo
YARN-7257 AggregatedLogsBlock reports a bad ‘end’ value as a bad ‘start’ value Major log-aggregation Jason Lowe Jason Lowe
HDFS-12458 TestReencryptionWithKMS fails regularly Major encryption, test Konstantin Shvachko Xiao Chen

TESTS:

JIRA Summary Priority Component Reporter Contributor
YARN-5548 Use MockRMMemoryStateStore to reduce test failures Major . Bibin A Chundatt Bibin A Chundatt
HDFS-2319 Add test cases for FSshell -stat Trivial test XieXianshan Bharat Viswanadham
HADOOP-14245 Use Mockito.when instead of Mockito.stub Minor test Akira Ajisaka Andras Bokor
YARN-5349 TestWorkPreservingRMRestart#testUAMRecoveryOnRMWorkPreservingRestart fail intermittently Minor . sandflee Jason Lowe
HDFS-11988 Verify HDFS Snapshots with open files captured are safe across truncates and appends on current version file Major hdfs, snapshots Manoj Govindassamy Manoj Govindassamy
HADOOP-14729 Upgrade JUnit 3 test cases to JUnit 4 Major . Akira Ajisaka Ajay Kumar
HDFS-11912 Add a snapshot unit test with randomized file IO operations Minor hdfs George Huang George Huang
MAPREDUCE-6953 Skip the testcase testJobWithChangePriority if FairScheduler is used Major client Peter Bacsko Peter Bacsko

SUB-TASKS:

JIRA Summary Priority Component Reporter Contributor
YARN-5300 Exclude generated federation protobuf sources from YARN Javadoc/findbugs build Minor nodemanager, resourcemanager Subru Krishnan Subru Krishnan
YARN-5156 YARN_CONTAINER_FINISHED of YARN_CONTAINERs will always have running state Major timelineserver Li Lu Vrushali C
YARN-3662 Federation Membership State Store internal APIs Major nodemanager, resourcemanager Subru Krishnan Subru Krishnan
YARN-5229 Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl Minor timelineserver Joep Rottinghuis Vrushali C
YARN-5406 In-memory based implementation of the FederationMembershipStateStore Major nodemanager, resourcemanager Subru Krishnan Ellen Hui
YARN-5390 Federation Subcluster Resolver Major nodemanager, resourcemanager Carlo Curino Ellen Hui
YARN-5307 Federation Application State Store internal APIs Major nodemanager, resourcemanager Subru Krishnan Subru Krishnan
YARN-3664 Federation PolicyStore internal APIs Major nodemanager, resourcemanager Subru Krishnan Subru Krishnan
YARN-5408 Compose Federation membership/application/policy APIs into an uber FederationStateStore API Major nodemanager, resourcemanager Subru Krishnan Ellen Hui
YARN-5407 In-memory based implementation of the FederationApplicationStateStore, FederationPolicyStateStore Major nodemanager, resourcemanager Subru Krishnan Ellen Hui
YARN-5519 Add SubClusterId in AddApplicationHomeSubClusterResponse for Router Failover Major nodemanager, resourcemanager Giovanni Matteo Fumarola Ellen Hui
YARN-3672 Create Facade for Federation State and Policy Store Major nodemanager, resourcemanager Subru Krishnan Subru Krishnan
YARN-5467 InputValidator for the FederationStateStore internal APIs Major nodemanager, resourcemanager Subru Krishnan Giovanni Matteo Fumarola
YARN-3673 Create a FailoverProxy for Federation services Major nodemanager, resourcemanager Subru Krishnan Subru Krishnan
YARN-3671 Integrate Federation services with ResourceManager Major nodemanager, resourcemanager Subru Krishnan Subru Krishnan
YARN-5612 Return SubClusterId in FederationStateStoreFacade#addApplicationHomeSubCluster for Router Failover Major nodemanager, resourcemanager Giovanni Matteo Fumarola Giovanni Matteo Fumarola
YARN-5601 Make the RM epoch base value configurable Major nodemanager, resourcemanager Subru Krishnan Subru Krishnan
YARN-5323 Policies APIs (for Router and AMRMProxy policies) Major nodemanager, resourcemanager Carlo Curino Carlo Curino
YARN-5324 Stateless Federation router policies implementation Major nodemanager, resourcemanager Carlo Curino Carlo Curino
YARN-5325 Stateless ARMRMProxy policies implementation Major nodemanager, resourcemanager Carlo Curino Carlo Curino
YARN-5638 Introduce a collector timestamp to uniquely identify collectors creation order in collector discovery Major timelineserver Li Lu Li Lu
YARN-3649 Allow configurable prefix for hbase table names (like prod, exp, test etc) Major timelineserver Vrushali C Vrushali C
YARN-5715 introduce entity prefix for return and sort order Critical timelineserver Sangjin Lee Rohith Sharma K S
YARN-5391 PolicyManager to tie together Router/AMRM Federation policies Major nodemanager, resourcemanager Carlo Curino Carlo Curino
YARN-5265 Make HBase configuration for the timeline service configurable Major timelineserver Joep Rottinghuis Joep Rottinghuis
YARN-3359 Recover collector list when RM fails over Major resourcemanager Junping Du Li Lu
YARN-5634 Simplify initialization/use of RouterPolicy via a RouterPolicyFacade Major nodemanager, resourcemanager Carlo Curino Carlo Curino
YARN-5792 adopt the id prefix for YARN, MR, and DS entities Major timelineserver Sangjin Lee Varun Saxena
YARN-5676 Add a HashBasedRouterPolicy, and small policies and test refactoring. Major nodemanager, resourcemanager Carlo Curino Carlo Curino
YARN-5872 Add AlwayReject policies for router and amrmproxy. Major nodemanager, resourcemanager Carlo Curino Carlo Curino
YARN-5905 Update the RM webapp host that is reported as part of Federation membership to current primary RM’s IP Minor federation, resourcemanager Subru Krishnan Subru Krishnan
YARN-5739 Provide timeline reader API to list available timeline entity types for one application Major timelinereader Li Lu Li Lu
MAPREDUCE-6818 Remove direct reference to TimelineClientImpl Major . Li Lu Li Lu
YARN-5585 [Atsv2] Reader side changes for entity prefix and support for pagination via additional filters Critical timelinereader Rohith Sharma K S Rohith Sharma K S
YARN-5980 Update documentation for single node hbase deploy Major timelineserver Vrushali C Vrushali C
YARN-5378 Accommodate app-id->cluster mapping Major timelineserver Joep Rottinghuis Sangjin Lee
YARN-6064 Support fromId for flowRuns and flow/flowRun apps REST API’s Major timelinereader Rohith Sharma K S Rohith Sharma K S
YARN-6094 Update the coprocessor to be a dynamically loaded one Major timelineserver Vrushali C Vrushali C
YARN-5410 Bootstrap Router server module Major nodemanager, resourcemanager Subru Krishnan Giovanni Matteo Fumarola
YARN-6253 FlowAcitivityColumnPrefix.store(byte[] rowKey, …) drops timestamp Major . Haibo Chen Haibo Chen
YARN-6190 Validation and synchronization fixes in LocalityMulticastAMRMProxyPolicy Minor federation Botong Huang Botong Huang
YARN-6027 Support fromid(offset) filter for /flows API Major timelineserver Rohith Sharma K S Rohith Sharma K S
YARN-6247 Share a single instance of SubClusterResolver instead of instantiating one per AM Minor . Botong Huang Botong Huang
YARN-6256 Add FROM_ID info key for timeline entities in reader response. Major timelineserver Rohith Sharma K S Rohith Sharma K S
YARN-6237 Move UID constant to TimelineReaderUtils Major timelinereader Rohith Sharma K S Rohith Sharma K S
YARN-6318 timeline service schema creator fails if executed from a remote machine Minor timelineserver Sangjin Lee Sangjin Lee
YARN-6146 Add Builder methods for TimelineEntityFilters Major timelineserver Rohith Sharma K S Haibo Chen
YARN-5602 Utils for Federation State and Policy Store Major nodemanager, resourcemanager Giovanni Matteo Fumarola Giovanni Matteo Fumarola
YARN-6203 Occasional test failure in TestWeightedRandomRouterPolicy Minor federation Botong Huang Carlo Curino
YARN-3663 Federation State and Policy Store (DBMS implementation) Major nodemanager, resourcemanager Giovanni Matteo Fumarola Giovanni Matteo Fumarola
YARN-5411 Create a proxy chain for ApplicationClientProtocol in the Router Major nodemanager, resourcemanager Subru Krishnan Giovanni Matteo Fumarola
YARN-5413 Create a proxy chain for ResourceManager Admin API in the Router Major nodemanager, resourcemanager Subru Krishnan Giovanni Matteo Fumarola
YARN-5531 UnmanagedAM pool manager for federating application across clusters Major nodemanager, resourcemanager Subru Krishnan Botong Huang
YARN-6666 Fix unit test failure in TestRouterClientRMService Minor . Botong Huang Botong Huang
YARN-6484 [Documentation] Documenting the YARN Federation feature Major nodemanager, resourcemanager Subru Krishnan Carlo Curino
YARN-6658 Remove columnFor() methods of Columns in HBaseTimeline backend Major . Haibo Chen Haibo Chen
YARN-3666 Federation Intercepting and propagating AM- home RM communications Major nodemanager, resourcemanager Kishore Chaliparambil Botong Huang
YARN-5647 [ATSv2 Security] Collector side changes for loading auth filters and principals Major timelineserver Varun Saxena Varun Saxena
YARN-6511 Federation: transparently spanning application across multiple sub-clusters Major . Botong Huang Botong Huang
YARN-6638 [ATSv2 Security] Timeline reader side changes for loading auth filters and principals Major timelineserver Varun Saxena Varun Saxena
YARN-6724 Add ability to blacklist sub-clusters when invoking Routing policies Major router Subru Krishnan Giovanni Matteo Fumarola
YARN-5648 [ATSv2 Security] Client side changes for authentication Major timelineserver Varun Saxena Varun Saxena
YARN-3659 Federation: routing client invocations transparently to multiple RMs Major client, resourcemanager, router Giovanni Matteo Fumarola Giovanni Matteo Fumarola
YARN-5067 Support specifying resources for AM containers in SLS Major scheduler-load-simulator Wangda Tan Yufei Gu
YARN-6681 Eliminate double-copy of child queues in canAssignToThisQueue Major resourcemanager Daryn Sharp Daryn Sharp
HADOOP-14615 Add ServiceOperations.stopQuietly that accept slf4j logger API Major . Wenxin He Wenxin He
HADOOP-14617 Add ReflectionUtils.logThreadInfo that accept slf4j logger API Major . Wenxin He Wenxin He
HADOOP-14571 Deprecate public APIs relate to log4j1 Major . Akira Ajisaka Wenxin He
HADOOP-14587 Use GenericTestUtils.setLogLevel when available in hadoop-common Major . Wenxin He Wenxin He
YARN-6776 Refactor ApplicaitonMasterService to move actual processing logic to a separate class Minor . Arun Suresh Arun Suresh
HADOOP-14638 Replace commons-logging APIs with slf4j in StreamPumper Major . Wenxin He Wenxin He
YARN-6801 NPE in RM while setting collectors map in NodeHeartbeatResponse Major timelineserver Vrushali C Vrushali C
YARN-6807 Adding required missing configs to Federation configuration guide based on e2e testing Major documentation, federation Subru Krishnan Tanuj Nayak
YARN-6815 [Bug] FederationStateStoreFacade return behavior should be consistent irrespective of whether caching is enabled or not Major nodemanager, resourcemanager Subru Krishnan Subru Krishnan
YARN-6821 Move FederationStateStore SQL DDL files from test resource to sbin Major nodemanager, resourcemanager Subru Krishnan Subru Krishnan
YARN-6706 Refactor ContainerScheduler to make oversubscription change easier Major . Haibo Chen Haibo Chen
HADOOP-14642 wasb: add support for caching Authorization and SASKeys Major fs/azure Sivaguru Sankaridurg Sivaguru Sankaridurg
YARN-6777 Support for ApplicationMasterService processing chain of interceptors Major . Arun Suresh Arun Suresh
YARN-6775 CapacityScheduler: Improvements to assignContainers, avoid unnecessary canAssignToUser/Queue calls Major capacityscheduler Nathan Roberts Nathan Roberts
YARN-4455 Support fetching metrics by time range Major timelineserver Varun Saxena Varun Saxena
YARN-6685 Add job count in to SLS JSON input format Major scheduler-load-simulator Yufei Gu Yufei Gu
YARN-6850 Ensure that supplemented timestamp is stored only for flow run metrics Major timelineserver Vrushali C Varun Saxena
YARN-6733 Add table for storing sub-application entities Major timelineserver Vrushali C Vrushali C
HADOOP-14518 Customize User-Agent header sent in HTTP/HTTPS requests by WASB. Minor fs/azure Georgi Chalakov Georgi Chalakov
YARN-6804 Allow custom hostname for docker containers in native services Major yarn-native-services Billie Rinaldi Billie Rinaldi
YARN-6866 Minor clean-up and fixes in anticipation of YARN-2915 merge with trunk Major federation Subru Krishnan Botong Huang
YARN-5412 Create a proxy chain for ResourceManager REST API in the Router Major nodemanager, resourcemanager Subru Krishnan Giovanni Matteo Fumarola
HADOOP-11875 [JDK9] Add a second copy of Hamlet without _ as a one-character identifier Major . Tsuyoshi Ozawa Akira Ajisaka
YARN-6888 Refactor AppLevelTimelineCollector such that RM does not have aggregator threads created Major timelineserver Vrushali C Vrushali C
HADOOP-14678 AdlFilesystem#initialize swallows exception when getting user name Minor fs/adl John Zhuge John Zhuge
YARN-6734 Ensure sub-application user is extracted & sent to timeline service Major timelineserver Vrushali C Rohith Sharma K S
YARN-6902 Update Microsoft JDBC Driver for SQL Server version in License.txt Minor federation Botong Huang Botong Huang
HADOOP-14672 Shaded Hadoop-client-minicluster include unshaded classes, like: javax, sax, dom, etc. Blocker . Junping Du Bharat Viswanadham
HADOOP-14397 Pull up the builder pattern to FileSystem and add AbstractContractCreateTest for it Major common, fs, hdfs-client Lei (Eddy) Xu Lei (Eddy) Xu
HDFS-12151 Hadoop 2 clients cannot writeBlock to Hadoop 3 DataNodes Major rolling upgrades Sean Mackrory Sean Mackrory
HADOOP-14495 Add set options interface to FSDataOutputStreamBuilder Major fs Lei (Eddy) Xu Lei (Eddy) Xu
YARN-6853 Add MySql Scripts for FederationStateStore Major . Giovanni Matteo Fumarola Giovanni Matteo Fumarola
HDFS-9388 Refactor decommission related code to support maintenance state for datanodes Major . Ming Ma Manoj Govindassamy
YARN-6674 Add memory cgroup settings for opportunistic containers Major nodemanager Haibo Chen Miklos Szegedi
YARN-6673 Add cpu cgroup configurations for opportunistic containers Major . Haibo Chen Miklos Szegedi
YARN-5977 ContainerManagementProtocol changes to support change of container ExecutionType Major . Arun Suresh kartheek muthyala
HADOOP-14126 remove jackson, joda and other transient aws SDK dependencies from hadoop-aws Minor build, fs/s3 Steve Loughran Steve Loughran
HADOOP-14685 Test jars to exclude from hadoop-client-minicluster jar Major common Bharat Viswanadham Bharat Viswanadham
YARN-6957 Moving logging APIs over to slf4j in hadoop-yarn-server-sharedcachemanager Major . Yeliang Cang Yeliang Cang
YARN-6955 Handle concurrent register AM requests in FederationInterceptor Minor . Botong Huang Botong Huang
YARN-6873 Moving logging APIs over to slf4j in hadoop-yarn-server-applicationhistoryservice Major . Yeliang Cang Yeliang Cang
YARN-6897 Refactoring RMWebServices by moving some util methods to RMWebAppUtil Major . Giovanni Matteo Fumarola Giovanni Matteo Fumarola
HADOOP-14715 TestWasbRemoteCallHelper failing Major fs/azure, test Steve Loughran Esfandiar Manii
YARN-6970 Add PoolInitializationException as retriable exception in FederationFacade Major federation Giovanni Matteo Fumarola Giovanni Matteo Fumarola
HDFS-11975 Provide a system-default EC policy Major erasure-coding Lei (Eddy) Xu luhuichun
HADOOP-14628 Upgrade maven enforcer plugin to 3.0.0-M1 Major . Akira Ajisaka Akira Ajisaka
HADOOP-14355 Update maven-war-plugin to 3.1.0 Major build Akira Ajisaka Akira Ajisaka
YARN-6631 Refactor loader.js in new Yarn UI Major . Akhil PB Akhil PB
YARN-6874 Supplement timestamp for min start/max end time columns in flow run table to avoid overwrite Major timelineserver Varun Saxena Vrushali C
YARN-6958 Moving logging APIs over to slf4j in hadoop-yarn-server-timelineservice Major . Yeliang Cang Yeliang Cang
HADOOP-14183 Remove service loader config file for wasb fs Minor fs/azure John Zhuge Esfandiar Manii
YARN-6130 [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM Major timelineserver Varun Saxena Varun Saxena
YARN-6133 [ATSv2 Security] Renew delegation token for app automatically if an app collector is active Major timelineserver Varun Saxena Varun Saxena
HADOOP-10392 Use FileSystem#makeQualified(Path) instead of Path#makeQualified(FileSystem) Minor fs Akira Ajisaka Akira Ajisaka
YARN-6820 Restrict read access to timelineservice v2 data Major timelinereader Vrushali C Vrushali C
YARN-6896 Federation: routing REST invocations transparently to multiple RMs (part 1 - basic execution) Major . Giovanni Matteo Fumarola Giovanni Matteo Fumarola
YARN-6687 Validate that the duration of the periodic reservation is less than the periodicity Major reservation system Subru Krishnan Subru Krishnan
YARN-6905 Multiple HBaseTimelineStorage test failures due to missing FastNumberFormat Major timelineserver Sonia Garudi Haibo Chen
YARN-5978 ContainerScheduler and ContainerManager changes to support ExecType update Major . Arun Suresh kartheek muthyala
YARN-5146 Support for Fair Scheduler in new YARN UI Major . Wangda Tan Abdullah Yousufi
YARN-6741 Deleting all children of a Parent Queue on refresh throws exception Major capacity scheduler Naganarasimha G R Naganarasimha G R
HADOOP-14660 wasb: improve throughput by 34% when account limit exceeded Major fs/azure Thomas Marquardt Thomas Marquardt
YARN-7006 [ATSv2 Security] Changes for authentication for CollectorNodemanagerProtocol Major timelineserver Varun Saxena Varun Saxena
YARN-6900 ZooKeeper based implementation of the FederationStateStore Major federation, nodemanager, resourcemanager Subru Krishnan Íñigo Goiri
HDFS-11082 Provide replicated EC policy to replicate files Critical erasure-coding Rakesh R SammiChen
YARN-6988 container-executor fails for docker when command length > 4096 B Major yarn Eric Badger Eric Badger
YARN-7038 [Atsv2 Security] CollectorNodemanagerProtocol RPC interface doesn’t work when service authorization is enabled Major . Rohith Sharma K S Varun Saxena
HADOOP-14769 WASB: delete recursive should not fail if a file is deleted Major fs/azure Thomas Marquardt Thomas Marquardt
HADOOP-14398 Modify documents for the FileSystem Builder API Major fs Lei (Eddy) Xu Lei (Eddy) Xu
YARN-6852 [YARN-6223] Native code changes to support isolate GPU devices by using CGroups Major . Wangda Tan Wangda Tan
YARN-7041 Nodemanager NPE running jobs with security off Major timelineserver Aaron Gresch Varun Saxena
YARN-6134 [ATSv2 Security] Regenerate delegation token for app just before token expires if app collector is active Major timelineserver Varun Saxena Varun Saxena
YARN-6979 Add flag to notify all types of container updates to NM via NodeHeartbeatResponse Major . Arun Suresh kartheek muthyala
HADOOP-14194 Aliyun OSS should not use empty endpoint as default Major fs/oss Mingliang Liu Genmao Yu
YARN-6861 Reader API for sub application entities Major timelinereader Rohith Sharma K S Rohith Sharma K S
YARN-6323 Rolling upgrade/config change is broken on timeline v2. Major timelineserver Li Lu Vrushali C
YARN-6047 Documentation updates for TimelineService v2 Major documentation, timelineserver Varun Saxena Rohith Sharma K S
MAPREDUCE-6838 [ATSv2 Security] Add timeline delegation token received in allocate response to UGI Major . Varun Saxena Varun Saxena
YARN-5603 Metrics for Federation StateStore Major . Subru Krishnan Ellen Hui
YARN-6923 Metrics for Federation Router Major . Giovanni Matteo Fumarola Giovanni Matteo Fumarola
HADOOP-14787 AliyunOSS: Implement the `createNonRecursive` operator Major fs, fs/oss Genmao Yu Genmao Yu
HADOOP-14649 Update aliyun-sdk-oss version to 2.8.1 Major . Ray Chiang Genmao Yu
YARN-7047 Moving logging APIs over to slf4j in hadoop-yarn-server-nodemanager Major . Yeliang Cang Yeliang Cang
YARN-6876 Create an abstract log writer for extendability Major . Xuan Gong Xuan Gong
YARN-6386 Show decommissioning nodes in new YARN UI Major webapp Elek, Marton Elek, Marton
YARN-7010 Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps) Major . Giovanni Matteo Fumarola Giovanni Matteo Fumarola
YARN-5219 When an export var command fails in launch_container.sh, the full container launch should fail Major . Hitesh Shah Sunil G
HADOOP-14802 Add support for using container saskeys for all accesses Major fs/azure Sivaguru Sankaridurg Sivaguru Sankaridurg
YARN-7094 Document the current known issue with server-side NM graceful decom Blocker graceful Robert Kanter Robert Kanter
YARN-7095 Federation: routing getNode/getNodes/getMetrics REST invocations transparently to multiple RMs Major . Giovanni Matteo Fumarola Giovanni Matteo Fumarola
YARN-6033 Add support for sections in container-executor configuration file Major nodemanager Varun Vasudev Varun Vasudev
YARN-6877 Create an abstract log reader for extendability Major . Xuan Gong Xuan Gong
YARN-7071 Add vcores and number of containers in new YARN UI node heat map Major yarn-ui-v2 Abdullah Yousufi Abdullah Yousufi
YARN-7075 Better styling for donut charts in new YARN UI Major . Da Ding Da Ding
HADOOP-14103 Sort out hadoop-aws contract-test-options.xml Minor fs/s3, test Steve Loughran John Zhuge
YARN-7148 TestLogsCLI fails in trunk and branch-2 and javadoc error Major . Xuan Gong Xuan Gong
YARN-6978 Add updateContainer API to NMClient. Major . Arun Suresh kartheek muthyala
HADOOP-14774 S3A case “testRandomReadOverBuffer” failed due to improper range parameter Minor fs/s3 Yonger Yonger
YARN-7144 Log Aggregation controller should not swallow the exceptions when it calls closeWriter and closeReader. Major . Xuan Gong Xuan Gong
YARN-7104 Improve Nodes Heatmap in new YARN UI with better color coding Major . Da Ding Da Ding
HADOOP-13421 Switch to v2 of the S3 List Objects API in S3A Minor fs/s3 Steven K. Wong Aaron Fabbri
YARN-6600 Introduce default and max lifetime of application at LeafQueue level Major capacity scheduler Rohith Sharma K S Rohith Sharma K S
YARN-6849 NMContainerStatus should have the Container ExecutionType. Major . Arun Suresh kartheek muthyala
YARN-7128 The error message in TimelineSchemaCreator is not enough to find out the error. Major timelineserver Jinjiang Ling Jinjiang Ling
YARN-7173 Container update RM-NM communication fix for backward compatibility Major . Arun Suresh Arun Suresh
HADOOP-14798 Update sshd-core and related mina-core library versions Major . Ray Chiang Ray Chiang
HADOOP-14796 Update json-simple version to 1.1.1 Major . Ray Chiang Ray Chiang
HADOOP-14648 Bump commons-configuration2 to 2.1.1 Major . Ray Chiang Ray Chiang
HADOOP-14653 Update joda-time version to 2.9.9 Major . Ray Chiang Ray Chiang
HADOOP-14797 Update re2j version to 1.1 Major . Ray Chiang Ray Chiang
HADOOP-14857 Fix downstream shaded client integration test Blocker . Sean Busbey Sean Busbey
HADOOP-14089 Automated checking for malformed client artifacts. Blocker . David Phillips Sean Busbey
YARN-7162 Remove XML excludes file format Blocker graceful Robert Kanter Robert Kanter
HADOOP-14553 Add (parallelized) integration tests to hadoop-azure Major fs/azure Steve Loughran Steve Loughran
YARN-7174 Add retry logic in LogsCLI when fetch running application logs Major . Xuan Gong Xuan Gong
HDFS-12470 DiskBalancer: Some tests create plan files under system directory Major diskbalancer, test Akira Ajisaka Hanisha Koneru
HADOOP-14583 wasb throws an exception if you try to create a file and there’s no parent directory Minor fs/azure Steve Loughran Esfandiar Manii
HDFS-12473 Change hosts JSON file format Major . Ming Ma Ming Ma
HDFS-11035 Better documentation for maintenace mode and upgrade domain Major datanode, documentation Wei-Chiu Chuang Ming Ma
YARN-4266 Allow users to enter containers as UID:GID pair instead of by username Major yarn Sidharta Seethana luhuichun
MAPREDUCE-6947 Moving logging APIs over to slf4j in hadoop-mapreduce-examples Major . Gergely Novák Gergely Novák
HADOOP-14799 Update nimbus-jose-jwt to 4.41.1 Major . Ray Chiang Ray Chiang
HADOOP-14892 MetricsSystemImpl should use Time.monotonicNow for measuring durations Minor . Chetna Chaudhari Chetna Chaudhari
HADOOP-14881 LoadGenerator should use Time.monotonicNow() to measure durations Major . Chetna Chaudhari Bharat Viswanadham
HADOOP-14220 Enhance S3GuardTool with bucket-info and set-capacity commands, tests Major fs/s3 Steve Loughran Steve Loughran
HADOOP-14893 WritableRpcEngine should use Time.monotonicNow Minor . Chetna Chaudhari Chetna Chaudhari
HADOOP-14890 Move up to AWS SDK 1.11.199 Blocker build, fs/s3 Steve Loughran Steve Loughran
HDFS-12386 Add fsserver defaults call to WebhdfsFileSystem. Minor webhdfs Rushabh S Shah Rushabh S Shah
YARN-6691 Update YARN daemon startup/shutdown scripts to include Router service Major nodemanager, resourcemanager Subru Krishnan Giovanni Matteo Fumarola

OTHER:

JIRA Summary Priority Component Reporter Contributor
YARN-6969 Clean up unused code in class FairSchedulerQueueInfo Trivial fairscheduler Yufei Gu Larry Lo
YARN-6622 Document Docker work as experimental Blocker documentation Varun Vasudev Varun Vasudev
YARN-7203 Add container ExecutionType into ContainerReport Minor . Botong Huang Botong Huang