Apache Hadoop Changelog

Release 2.0.2-alpha - 2012-10-09

INCOMPATIBLE CHANGES:

JIRA Summary Priority Component Reporter Contributor
MAPREDUCE-4072 User set java.library.path seems to overwrite default creating problems native lib loading Major mrv2 Anupam Seth Anupam Seth
MAPREDUCE-3812 Lower default allocation sizes, fix allocation configurations and document them Major mrv2, performance Vinod Kumar Vavilapalli Harsh J
HDFS-3318 Hftp hangs on transfers >2GB Blocker hdfs-client Daryn Sharp Daryn Sharp
HADOOP-8388 Remove unused BlockLocation serialization Minor . Colin P. McCabe Colin P. McCabe
HADOOP-8368 Use CMake rather than autotools to build native code Minor . Colin P. McCabe Colin P. McCabe
HDFS-3522 If NN is in safemode, it should throw SafeModeException when getBlockLocations has zero locations Major namenode Brandon Li Brandon Li
HADOOP-8458 Add management hook to AuthenticationHandler to enable delegation token operations support Major security Alejandro Abdelnur Alejandro Abdelnur
MAPREDUCE-4311 Capacity scheduler.xml does not accept decimal values for capacity and maximum-capacity settings Major capacity-sched, mrv2 Thomas Graves Karthik Kambatla
HDFS-3446 HostsFileReader silently ignores bad includes/excludes Major namenode Matthew Jacobs Matthew Jacobs
HDFS-3675 libhdfs: follow documented return codes Minor libhdfs Colin P. McCabe Colin P. McCabe
HDFS-2617 Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution Major security Jakob Homan Jakob Homan
HADOOP-8551 fs -mkdir creates parent directories without the -p option Major fs Robert Joseph Evans John George
HADOOP-8689 Make trash a server side configuration option Major fs Eli Collins Eli Collins
HADOOP-8710 Remove ability for users to easily run the trash emptier Major fs Eli Collins Eli Collins
HDFS-2727 libhdfs should get the default block size from the server Minor libhdfs Sho Shimauchi Colin P. McCabe
HDFS-2686 Remove DistributedUpgrade related code Major datanode, namenode Todd Lipcon Suresh Srinivas
MAPREDUCE-4629 Remove JobHistory.DEBUG_MODE Major . Karthik Kambatla Karthik Kambatla
HADOOP-8794 Modifiy bin/hadoop to point to HADOOP_YARN_HOME Major . Vinod Kumar Vavilapalli Vinod Kumar Vavilapalli

NEW FEATURES:

JIRA Summary Priority Component Reporter Contributor
HDFS-2978 The NameNode should expose name dir statuses via JMX Major namenode Aaron T. Myers Aaron T. Myers
HADOOP-8135 Add ByteBufferReadable interface to FSDataInputStream Major fs Henry Robinson Henry Robinson
MAPREDUCE-3773 Add queue metrics with buckets for job run times Major jobtracker Owen O’Malley Owen O’Malley
HDFS-744 Support hsync in HDFS Major datanode, hdfs-client Hairong Kuang Lars Hofhansl
HDFS-3042 Automatic failover support for NN HA Major auto-failover, ha Todd Lipcon Todd Lipcon
HADOOP-8465 hadoop-auth should support ephemeral authentication Major security Alejandro Abdelnur Alejandro Abdelnur
HDFS-3535 Audit logging should log denied accesses Major namenode Andy Isaacson Andy Isaacson
MAPREDUCE-4355 Add RunningJob.getJobStatus() Major mrv1, mrv2 Karthik Kambatla Karthik Kambatla
MAPREDUCE-3451 Port Fair Scheduler to MR2 Major mrv2, scheduler NO NAME NO NAME
MAPREDUCE-987 Exposing MiniDFS and MiniMR clusters as a single process command-line Minor build, test Philip Zeyliger Ahmed Radwan
MAPREDUCE-4417 add support for encrypted shuffle Major mrv2, security Alejandro Abdelnur Alejandro Abdelnur
HDFS-3113 httpfs does not support delegation tokens Major . Alejandro Abdelnur Alejandro Abdelnur
HADOOP-8644 AuthenticatedURL should be able to use SSLFactory Critical security Alejandro Abdelnur Alejandro Abdelnur
HDFS-3637 Add support for encrypting the DataTransferProtocol Major datanode, hdfs-client, security Aaron T. Myers Aaron T. Myers
HADOOP-8581 add support for HTTPS to the web UIs Major security Alejandro Abdelnur Alejandro Abdelnur
HDFS-3150 Add option for clients to contact DNs via hostname Major datanode, hdfs-client Eli Collins Eli Collins
HDFS-2793 Add an admin command to trigger an edit log roll Major namenode Aaron T. Myers Todd Lipcon

IMPROVEMENTS:

JIRA Summary Priority Component Reporter Contributor
HDFS-2834 ByteBuffer-based read API for DFSInputStream Major hdfs-client, performance Henry Robinson Henry Robinson
HADOOP-8242 AbstractDelegationTokenIdentifier: add getter methods for owner and realuser Minor . Colin P. McCabe Colin P. McCabe
HADOOP-8244 Improve comments on ByteBufferReadable.read Major . Henry Robinson Henry Robinson
HDFS-3110 libhdfs implementation of direct read API Major libhdfs, performance Henry Robinson Henry Robinson
MAPREDUCE-4059 The history server should have a separate pluggable storage/query interface Major mrv2 Robert Joseph Evans Robert Joseph Evans
MAPREDUCE-4017 Add jobname to jobsummary log Trivial jobhistoryserver, jobtracker Koji Noguchi Thomas Graves
HADOOP-7510 Tokens should use original hostname provided instead of ip Major security Daryn Sharp Daryn Sharp
HADOOP-8286 Simplify getting a socket address from conf Major conf Daryn Sharp Daryn Sharp
MAPREDUCE-4151 RM scheduler web page should filter apps to those that are relevant to scheduling Major mrv2, webapps Jason Lowe Jason Lowe
HDFS-2652 Port token service changes from 205 Major . Daryn Sharp Daryn Sharp
MAPREDUCE-4190 Improve web UI for task attempts userlog link Major mrv2, webapps Thomas Graves Thomas Graves
MAPREDUCE-4079 Allow MR AppMaster to limit ephemeral port range. Blocker mr-am, mrv2 Robert Joseph Evans Robert Joseph Evans
HADOOP-8227 Allow RPC to limit ephemeral port range. Blocker . Robert Joseph Evans Robert Joseph Evans
HADOOP-8335 Improve Configuration’s address handling Major util Daryn Sharp Daryn Sharp
MAPREDUCE-4210 Expose listener address for WebApp Major webapps Daryn Sharp Daryn Sharp
MAPREDUCE-4205 retrofit all JVM shutdown hooks to use ShutdownHookManager Major mrv2 Alejandro Abdelnur Alejandro Abdelnur
MAPREDUCE-3850 Avoid redundant calls for tokens in TokenCache Major security Daryn Sharp Daryn Sharp
HADOOP-8373 Port RPC.getServerAddress to 0.23 Major ipc Daryn Sharp Daryn Sharp
HDFS-3390 DFSAdmin should print full stack traces of errors when DEBUG logging is enabled Minor hdfs-client Aaron T. Myers Aaron T. Myers
HDFS-3341 Change minimum RPC versions to 2.0.0-SNAPSHOT instead of 2.0.0 Minor . Todd Lipcon Todd Lipcon
HADOOP-8340 SNAPSHOT build versions should compare as less than their eventual final release Minor util Todd Lipcon Todd Lipcon
MAPREDUCE-3659 Host-based token support Major security Daryn Sharp Daryn Sharp
HDFS-3230 Cleanup DatanodeID creation in the tests Minor test Eli Collins Eli Collins
HDFS-3401 Cleanup DatanodeDescriptor creation in the tests Major datanode, test Eli Collins Eli Collins
HDFS-3400 DNs should be able start with jsvc even if security is disabled Major datanode, scripts Aaron T. Myers Aaron T. Myers
HADOOP-8224 Don’t hardcode hdfs.audit.logger in the scripts Major conf Eli Collins Tomohiko Kinebuchi
HDFS-3134 Harden edit log loader against malformed or malicious input Major namenode Colin P. McCabe Colin P. McCabe
HADOOP-8361 Avoid out-of-memory problems when deserializing strings Minor . Colin P. McCabe Colin P. McCabe
HDFS-3404 Make putImage in GetImageServlet infer remote address to fetch from request Major . Aaron T. Myers Aaron T. Myers
HDFS-3335 check for edit log corruption at the end of the log Major . Colin P. McCabe Colin P. McCabe
HDFS-3416 Cleanup DatanodeID and DatanodeRegistration constructors used by testing Minor datanode Eli Collins Eli Collins
HDFS-3417 Rename BalancerDatanode#getName to getDisplayName to be consistent with Datanode Minor datanode Eli Collins Eli Collins
HDFS-3419 Cleanup LocatedBlock Minor . Eli Collins Eli Collins
HADOOP-8398 Cleanup BlockLocation Minor . Eli Collins Eli Collins
HDFS-3438 BootstrapStandby should not require a rollEdits on active node Major ha Todd Lipcon Todd Lipcon
HDFS-2885 Remove “federation” from the nameservice config options Major namenode Eli Collins Tsz Wo Nicholas Sze
HDFS-3394 Do not use generic in INodeFile.getLastBlock() Minor namenode Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
MAPREDUCE-4274 MapOutputBuffer should use native byte order for kvmeta Minor performance, task Todd Lipcon Todd Lipcon
HDFS-3454 Balancer unconditionally logs InterruptedException at INFO level on shutdown if security is enabled Minor balancer & mover Eli Collins Eli Collins
HADOOP-8367 Improve documentation of declaringClassProtocolName in rpc headers Major . Sanjay Radia Sanjay Radia
HDFS-1013 Miscellaneous improvements to HTML markup for web UIs Minor . Todd Lipcon Eugene Koontz
HADOOP-8323 Revert HADOOP-7940 and improve javadocs and test for Text.clear() Critical io Harsh J Harsh J
HDFS-2391 Newly set BalancerBandwidth value is not displayed anywhere Major balancer & mover Rajit Saha Harsh J
HADOOP-8358 Config-related WARN for dfs.web.ugi can be avoided. Trivial conf Harsh J Harsh J
MAPREDUCE-4146 Support limits on task status string length and number of block locations in branch-2 Major . Tom White Ahmed Radwan
MAPREDUCE-4301 Dedupe some strings in MRAM for memory savings Major applicationmaster Robert Joseph Evans Robert Joseph Evans
HDFS-3040 TestMulitipleNNDataBlockScanner is misspelled Trivial test Aaron T. Myers madhukara phatak
MAPREDUCE-3842 stop webpages from automatic refreshing Critical mrv2, webapps Alejandro Abdelnur Thomas Graves
HDFS-3514 Add missing TestParallelLocalRead Major test Henry Robinson Henry Robinson
MAPREDUCE-3871 Allow symlinking in LocalJobRunner DistributedCache Major distributed-cache Tom White Tom White
MAPREDUCE-3921 MR AM should act on the nodes liveliness information when nodes go up/down/unhealthy Major mr-am, mrv2 Vinod Kumar Vavilapalli Bikas Saha
HDFS-3520 Add transfer rate logging to TransferFsImage Minor namenode Eli Collins Eli Collins
HDFS-3504 Configurable retry in DFSClient Major hdfs-client Siddharth Seth Tsz Wo Nicholas Sze
HDFS-3372 offlineEditsViewer should be able to read a binary edits file with recovery mode Minor tools Colin P. McCabe Colin P. McCabe
HADOOP-8524 Allow users to get source of a Configuration parameter Trivial conf Harsh J Harsh J
HDFS-3516 Check content-type in WebHdfsFileSystem Major hdfs-client, webhdfs Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-3481 Refactor HttpFS handling of JAX-RS query string parameters Major . Alejandro Abdelnur Alejandro Abdelnur
HDFS-3002 TestNameNodeMetrics need not wait for metrics update with new metrics framework Trivial test Suresh Srinivas Suresh Srinivas
HADOOP-8535 Cut hadoop build times in half (upgrade maven-compiler-plugin to 2.5.1) Major build Jonathan Eagles Jonathan Eagles
HDFS-3475 Make the replication and invalidation rates configurable Trivial . Harsh J Harsh J
HADOOP-6802 Remove FS_CLIENT_BUFFER_DIR_KEY = “fs.client.buffer.dir” from CommonConfigurationKeys.java (not used, deprecated) Major conf, fs Erik Steffl Sho Shimauchi
HADOOP-3450 Add tests to Local Directory Allocator for asserting their URI-returning capability Minor fs Ari Rabkin Sho Shimauchi
HADOOP-8533 Remove Parallel Call in IPC Major ipc Suresh Srinivas Brandon Li
HADOOP-8463 hadoop.security.auth_to_local needs a key definition and doc Major security Eli Collins madhukara phatak
HDFS-3343 Improve metrics for DN read latency Major datanode Todd Lipcon Andrew Wang
HDFS-3170 Add more useful metrics for write latency Major datanode Todd Lipcon Matthew Jacobs
HDFS-3604 Add dfs.webhdfs.enabled to hdfs-default.xml Minor . Eli Collins Eli Collins
HDFS-2988 Improve error message when storage directory lock fails Minor namenode Todd Lipcon Miomir Boljanovic
MAPREDUCE-3907 Document entries mapred-default.xml for the jobhistory server. Minor documentation Eugene Koontz Eugene Koontz
MAPREDUCE-3906 Fix inconsistency in documentation regarding mapreduce.jobhistory.principal Trivial documentation Eugene Koontz Eugene Koontz
HADOOP-8525 Provide Improved Traceability for Configuration Trivial . Robert Joseph Evans Robert Joseph Evans
HDFS-3613 GSet prints some INFO level values, which aren’t really very useful to all Trivial namenode Harsh J Andrew Wang
HDFS-3582 Hook daemon process exit for testing Minor test Eli Collins Eli Collins
HADOOP-8541 Better high-percentile latency metrics Major metrics Andrew Wang Andrew Wang
HDFS-3641 Move server Util time methods to common and use now instead of System#currentTimeMillis Minor . Eli Collins Eli Collins
HDFS-3612 Single namenode image directory config warning can be improved Trivial namenode Harsh J Andy Isaacson
HDFS-3568 fuse_dfs: add support for security Major . Colin P. McCabe Colin P. McCabe
HDFS-799 libhdfs must call DetachCurrentThread when a thread is destroyed Major . Christian Kunz Colin P. McCabe
HDFS-3610 fuse_dfs: Provide a way to use the default (configured) NN URI Minor . Colin P. McCabe Colin P. McCabe
HADOOP-8362 Improve exception message when Configuration.set() is called with a null key or value Trivial conf Todd Lipcon madhukara phatak
HDFS-3663 MiniDFSCluster should capture the code path that led to the first ExitException Major test Eli Collins Eli Collins
YARN-420 Enable the RM to work with AM’s that are not managed by it Major applications/unmanaged-AM-launcher Bikas Saha Bikas Saha
HDFS-3659 Add missing @Override to methods across the hadoop-hdfs project Minor documentation Brandon Li Brandon Li
HADOOP-8531 SequenceFile Writer can throw out a better error if a serializer or deserializer isn’t available Trivial io Harsh J madhukara phatak
HDFS-3537 Move libhdfs and fuse-dfs source to native subdirectories Minor fuse-dfs, libhdfs Colin P. McCabe Colin P. McCabe
HDFS-3666 Plumb more exception messages to terminate Minor . Eli Collins Eli Collins
MAPREDUCE-4283 Display tail of aggregated logs by default Major jobhistoryserver, mrv2 Jason Lowe Jason Lowe
MAPREDUCE-4422 YARN_APPLICATION_CLASSPATH needs a documented default value in YarnConfiguration Major nodemanager Arun C Murthy Ahmed Radwan
MAPREDUCE-4157 ResourceManager should not kill apps that are well behaved Major mrv2 Jason Lowe Jason Lowe
HDFS-3583 Convert remaining tests to Junit4 Major test Eli Collins Andrew Wang
HADOOP-8609 IPC server logs a useless message when shutting down socket Major . Todd Lipcon Jon Zuanich
HDFS-3711 Manually convert remaining tests to JUnit4 Major . Andrew Wang Andrew Wang
YARN-419 Add client side for Unmanaged-AMs Major applications/unmanaged-AM-launcher Bikas Saha Bikas Saha
HADOOP-8623 hadoop jar command should respect HADOOP_OPTS Minor scripts Steven Willis Steven Willis
HDFS-3650 Use MutableQuantiles to provide latency histograms for various operations Major . Andrew Wang Andrew Wang
HADOOP-8635 Cannot cancel paths registered deleteOnExit Critical fs Daryn Sharp Daryn Sharp
MAPREDUCE-4375 Show Configuration Tracability in MR UI Major applicationmaster Robert Joseph Evans Robert Joseph Evans
HADOOP-8620 Add -Drequire.fuse and -Drequire.snappy Minor build Colin P. McCabe Colin P. McCabe
HDFS-3513 HttpFS should cache filesystems Major . Alejandro Abdelnur Alejandro Abdelnur
HDFS-3697 Enable fadvise readahead by default Minor datanode, performance Todd Lipcon Todd Lipcon
MAPREDUCE-3289 Make use of fadvise in the NM’s shuffle handler Major mrv2, nodemanager, performance Todd Lipcon Todd Lipcon
HDFS-3276 initializeSharedEdits should have a -nonInteractive flag Minor ha, namenode Vinithra Varadharajan Todd Lipcon
HADOOP-8687 Upgrade log4j to 1.2.17 Minor . Eli Collins Eli Collins
HDFS-3765 Namenode INITIALIZESHAREDEDITS should be able to initialize all shared storages Major ha Vinayakumar B Vinayakumar B
HDFS-3723 All commands should support meaningful –help Major scripts, tools E. Sammer Jing Zhao
HDFS-3802 StartupOption.name in HdfsServerConstants should be final Trivial . Jing Zhao Jing Zhao
HDFS-3796 Speed up edit log tests by avoiding fsync() Minor test Todd Lipcon Todd Lipcon
HADOOP-8278 Make sure components declare correct set of dependencies Major build Tom White Tom White
MAPREDUCE-4511 Add IFile readahead Major mrv1, mrv2, performance Ahmed Radwan Ahmed Radwan
HADOOP-8700 Move the checksum type constants to an enum Minor util Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-2421 Improve the concurrency of SerialNumberMap in NameNode Major namenode Hairong Kuang Jing Zhao
HDFS-3672 Expose disk-location information for blocks to enable better scheduling Major . Andrew Wang Andrew Wang
HADOOP-8240 Allow users to specify a checksum type on create() Major fs Kihwal Lee Kihwal Lee
HADOOP-8239 Extend MD5MD5CRC32FileChecksum to show the actual checksum type being used Major fs Kihwal Lee Kihwal Lee
HDFS-3819 Should check whether invalidate work percentage default value is not greater than 1.0f Minor . Jing Zhao Jing Zhao
HADOOP-8075 Lower native-hadoop library log from info to debug Major native Eli Collins Hızır Sefa İrken
MAPREDUCE-4408 allow jobs to set a JAR that is in the distributed cached Major mrv1, mrv2 Alejandro Abdelnur Robert Kanter
HDFS-3844 Add @Override where necessary and remove unnecessary {@inheritdoc} and imports Trivial . Jing Zhao Jing Zhao
HADOOP-8748 Move dfsclient retry to a util class Minor io Arun C Murthy Arun C Murthy
MAPREDUCE-4614 Simplify debugging a job’s tokens Major client, task Daryn Sharp Daryn Sharp
HDFS-3871 Change NameNodeProxies to use HADOOP-8748 Minor hdfs-client Arun C Murthy Arun C Murthy
MAPREDUCE-2786 TestDFSIO should also test compression reading/writing from command-line. Minor benchmarks Plamen Jeliazkov Plamen Jeliazkov
YARN-10 dist-shell shouldn’t have a (test) dependency on hadoop-mapreduce-client-core Major . Arun C Murthy Hitesh Shah
HDFS-3866 HttpFS POM should have property where to download tomcat from Minor build Ryan Hennig Plamen Jeliazkov
HDFS-3887 Remove redundant chooseTarget methods in BlockPlacementPolicy.java Trivial namenode Jing Zhao Jing Zhao
HADOOP-8624 ProtobufRpcEngine should log all RPCs if TRACE logging is enabled Minor ipc Todd Lipcon Todd Lipcon
HADOOP-8754 Deprecate all the RPC.getServer() variants Minor ipc Brandon Li Brandon Li
MAPREDUCE-4638 MR AppMaster shouldn’t rely on YARN_APPLICATION_CLASSPATH providing MR jars Major . Arun C Murthy Arun C Murthy
YARN-80 Support delay scheduling for node locality in MR2’s capacity scheduler Major capacityscheduler Todd Lipcon Arun C Murthy
YARN-9 Rename YARN_HOME to HADOOP_YARN_HOME Major . Arun C Murthy Vinod Kumar Vavilapalli
YARN-137 Change the default scheduler to the CapacityScheduler Major scheduler Siddharth Seth Siddharth Seth
HDFS-3607 log a message when fuse_dfs is not built Minor fuse-dfs Colin P. McCabe Colin P. McCabe
HDFS-3227 Mavenise libhdfs tests Major libhdfs Henry Robinson
HDFS-3907 Allow multiple users for local block readers Major datanode Eli Collins Eli Collins

BUG FIXES:

JIRA Summary Priority Component Reporter Contributor
HADOOP-7703 WebAppContext should also be stopped and cleared Major . Devaraj K Devaraj K
HDFS-2285 BackupNode should reject requests trying to modify namespace Major namenode Konstantin Shvachko Konstantin Shvachko
HDFS-2759 Pre-allocate HDFS edit log files after writing version number Major ha, namenode Aaron T. Myers Aaron T. Myers
HADOOP-8104 Inconsistent Jackson versions Major . Colin P. McCabe Alejandro Abdelnur
MAPREDUCE-3728 ShuffleHandler can’t access results when configured in a secure mode Critical mrv2, nodemanager Roman Shaposhnik Ding Yuan
HDFS-3037 TestMulitipleNNDataBlockScanner#testBlockScannerAfterRestart is racy Minor test Aaron T. Myers Aaron T. Myers
HDFS-2966 TestNameNodeMetrics tests can fail under load Minor test Steve Loughran Steve Loughran
MAPREDUCE-3348 mapred job -status fails to give info even if the job is present in History Major mrv2 Devaraj K Devaraj K
HADOOP-8167 Configuration deprecation logic breaks backwards compatibility Blocker conf Alejandro Abdelnur Alejandro Abdelnur
HDFS-3067 NPE in DFSInputStream.readBuffer if read is repeated on corrupted block Major hdfs-client Henry Robinson Henry Robinson
MAPREDUCE-4010 TestWritableJobConf fails on trunk Critical mrv2 Jason Lowe Alejandro Abdelnur
HADOOP-8197 Configuration logs WARNs on every use of a deprecated key Critical conf Alejandro Abdelnur Alejandro Abdelnur
MAPREDUCE-3992 Reduce fetcher doesn’t verify HTTP status code of response Major mrv1 Todd Lipcon Todd Lipcon
MAPREDUCE-4082 hadoop-mapreduce-client-app’s mrapp-generated-classpath file should not be in the module JAR Critical build Alejandro Abdelnur Alejandro Abdelnur
MAPREDUCE-4091 tools testcases failing because of MAPREDUCE-4082 Critical build, test Alejandro Abdelnur Alejandro Abdelnur
MAPREDUCE-4092 commitJob Exception does not fail job (regression in 0.23 vs 0.20) Blocker mrv2 Jonathan Eagles Jonathan Eagles
MAPREDUCE-4089 Hung Tasks never time out. Blocker mrv2 Robert Joseph Evans Robert Joseph Evans
MAPREDUCE-4024 RM webservices can’t query on finalStatus Major mrv2 Thomas Graves Thomas Graves
MAPREDUCE-4060 Multiple SLF4J binding warning Major build Jason Lowe Jason Lowe
MAPREDUCE-4012 Hadoop Job setup error leaves no useful info to users (when LinuxTaskController is used) Minor . Koji Noguchi Thomas Graves
MAPREDUCE-4062 AM Launcher thread can hang forever Major mrv2 Thomas Graves Thomas Graves
MAPREDUCE-3988 mapreduce.job.local.dir doesn’t point to a single directory on a node. Major mrv2 Vinod Kumar Vavilapalli Eric Payne
HDFS-3166 Hftp connections do not have a timeout Critical hdfs-client Daryn Sharp Daryn Sharp
MAPREDUCE-3999 Tracking link gives an error if the AppMaster hasn’t started yet Major mrv2, webapps Ravi Prakash Ravi Prakash
HDFS-3176 JsonUtil should not parse the MD5MD5CRC32FileChecksum bytes on its own. Major hdfs-client Kihwal Lee Kihwal Lee
MAPREDUCE-4020 Web services returns incorrect JSON for deep queue tree Major mrv2, webapps Jason Lowe Anupam Seth
MAPREDUCE-3672 Killed maps shouldn’t be counted towards JobCounter.NUM_FAILED_MAPS Major mr-am, mrv2 Vinod Kumar Vavilapalli Anupam Seth
MAPREDUCE-3682 Tracker URL says AM tasks run on localhost Major mrv2 David Capwell Ravi Prakash
MAPREDUCE-3082 archive command take wrong path for input file with current directory Major harchive Rajit Saha John George
MAPREDUCE-3650 testGetTokensForHftpFS() fails Blocker mrv2 Thomas Graves Ravi Prakash
HADOOP-8088 User-group mapping cache incorrectly does negative caching on transient failures Major security Kihwal Lee Kihwal Lee
HADOOP-8179 risk of NPE in CopyCommands processArguments() Minor fs Steve Loughran Daryn Sharp
MAPREDUCE-4097 tools testcases fail because missing mrapp-generated-classpath file in classpath Major build Alejandro Abdelnur Roman Shaposhnik
HADOOP-8180 Remove hsqldb since its not needed from pom.xml Major . Ravi Prakash Ravi Prakash
HADOOP-6963 Fix FileUtil.getDU. It should not include the size of the directory or follow symbolic links Critical fs Owen O’Malley Ravi Prakash
MAPREDUCE-3621 TestDBJob and TestDataDrivenDBInputFormat ant tests fail Major mrv2 Thomas Graves Ravi Prakash
MAPREDUCE-4073 CS assigns multiple off-switch containers when using multi-level-queues Critical mrv2, scheduler Siddharth Seth Siddharth Seth
HDFS-3136 Multiple SLF4J binding warning Major build Jason Lowe Jason Lowe
HADOOP-8014 ViewFileSystem does not correctly implement getDefaultBlockSize, getDefaultReplication, getContentSummary Major fs Daryn Sharp John George
MAPREDUCE-4117 mapred job -status throws NullPointerException Critical client, mrv2 Devaraj K Devaraj K
HDFS-3235 MiniDFSClusterManager doesn’t correctly support -format option Minor . Henry Robinson Henry Robinson
HDFS-3243 TestParallelRead timing out on jenkins Major hdfs-client, test Todd Lipcon Henry Robinson
MAPREDUCE-4040 History links should use hostname rather than IP address. Minor jobhistoryserver, mrv2 Bhallamudi Venkata Siva Kamesh Bhallamudi Venkata Siva Kamesh
MAPREDUCE-4099 ApplicationMaster may fail to remove staging directory Critical mrv2 Jason Lowe Jason Lowe
MAPREDUCE-3932 MR tasks failing and crashing the AM when available-resources/headRoom becomes zero Critical mr-am, mrv2 Vinod Kumar Vavilapalli Robert Joseph Evans
MAPREDUCE-4140 mapreduce classes incorrectly importing “clover.org.apache.*” classes Major client, mrv2 Patrick Hunt Patrick Hunt
HADOOP-8144 pseudoSortByDistance in NetworkTopology doesn’t work properly if no local node and first node is local rack node Minor io Junping Du Junping Du
MAPREDUCE-4050 Invalid node link Major mrv2 Bhallamudi Venkata Siva Kamesh Bhallamudi Venkata Siva Kamesh
MAPREDUCE-4128 AM Recovery expects all attempts of a completed task to also be completed. Major mrv2 Bikas Saha Bikas Saha
HADOOP-8005 Multiple SLF4J binding message in .out file for all daemons Major scripts Joe Crobak Jason Lowe
MAPREDUCE-4144 ResourceManager NPE while handling NODE_UPDATE Critical mrv2 Jason Lowe Jason Lowe
MAPREDUCE-4156 ant build fails compiling JobInProgress Major build Thomas Graves Thomas Graves
MAPREDUCE-4160 some mrv1 ant tests fail with timeout - due to 4156 Major test Thomas Graves Thomas Graves
MAPREDUCE-4139 Potential ResourceManager deadlock when SchedulerEventDispatcher is stopped Major mrv2 Jason Lowe Jason Lowe
MAPREDUCE-4074 Client continuously retries to RM When RM goes down before launching Application Master Major . Devaraj K xieguiming
HADOOP-8288 Remove references of mapred.child.ulimit etc. since they are not being used any more Major . Ravi Prakash Ravi Prakash
MAPREDUCE-4159 Job is running in Uber mode after setting “mapreduce.job.ubertask.maxreduces” to zero Major mrv2 Nishan Shetty Devaraj K
MAPREDUCE-4165 Committing is misspelled as commiting in task logs Trivial mrv2 Jonathan Eagles Jonathan Eagles
MAPREDUCE-4129 Lots of unneeded counters log messages Major mrv2 Ahmed Radwan Ahmed Radwan
MAPREDUCE-3947 yarn.app.mapreduce.am.resource.mb not documented Minor . Todd Lipcon Devaraj K
HDFS-3308 hftp/webhdfs can’t get tokens if authority has no port Critical webhdfs Daryn Sharp Daryn Sharp
MAPREDUCE-4133 MR over viewfs is broken Major . John George John George
HDFS-3312 Hftp selects wrong token service Blocker hdfs-client Daryn Sharp Daryn Sharp
HDFS-3321 Error message for insufficient data nodes to come out of safemode is wrong. Major . Ravi Prakash Ravi Prakash
MAPREDUCE-4194 ConcurrentModificationError in DirectoryCollection Major mrv2 Jonathan Eagles Jonathan Eagles
MAPREDUCE-4169 Container Logs appear in unsorted order Minor mrv2 Jonathan Eagles Jonathan Eagles
MAPREDUCE-4189 TestContainerManagerSecurity is failing Critical mrv2 Devaraj K Devaraj K
HADOOP-8305 distcp over viewfs is broken Major viewfs John George John George
HDFS-3334 ByteRangeInputStream leaks streams Major hdfs-client Daryn Sharp Daryn Sharp
HDFS-3331 setBalancerBandwidth do not checkSuperuserPrivilege Major namenode Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
MAPREDUCE-4209 junit dependency in hadoop-mapreduce-client is missing scope test Major build Radim Kolar
MAPREDUCE-4206 Sorting by Last Health-Update on the RM nodes page sorts does not work correctly Minor mrv2 Jonathan Eagles Jonathan Eagles
HADOOP-8334 HttpServer sometimes returns incorrect port Major . Daryn Sharp Daryn Sharp
HADOOP-8325 Add a ShutdownHookManager to be used by different components instead of the JVM shutdownhook Critical fs Alejandro Abdelnur Alejandro Abdelnur
HADOOP-8330 TestSequenceFile.testCreateUsesFsArg() is broken Minor test John George John George
HDFS-3275 Format command overwrites contents of non-empty shared edits dir if name dirs are empty without any prompting Major ha, namenode Vinithra Varadharajan amith
MAPREDUCE-4211 Error conditions (missing appid, appid not found) are masked in the RM app page Minor mrv2 Jonathan Eagles Jonathan Eagles
HADOOP-8317 Update maven-assembly-plugin to 2.3 - fix build on FreeBSD Major build Radim Kolar
HADOOP-8172 Configuration no longer sets all keys in a deprecated key list. Critical conf Robert Joseph Evans Anupam Seth
HADOOP-8342 HDFS command fails with exception following merge of HADOOP-8325 Major fs Randy Clayton Alejandro Abdelnur
HDFS-3359 DFSClient.close should close cached sockets Critical hdfs-client Todd Lipcon Todd Lipcon
MAPREDUCE-4048 NullPointerException exception while accessing the Application Master UI Major mrv2 Devaraj K Devaraj K
HADOOP-8327 distcpv2 and distcpv1 jars should not coexist Major . Dave Thompson Dave Thompson
HADOOP-8328 Duplicate FileSystem Statistics object for ‘file’ scheme Major fs Tom White Tom White
MAPREDUCE-4220 RM apps page starttime/endtime sorts are incorrect Minor mrv2 Jonathan Eagles Jonathan Eagles
MAPREDUCE-4226 ConcurrentModificationException in FileSystemCounterGroup Major mrv2 Tom White Tom White
HADOOP-8341 Fix or filter findbugs issues in hadoop-tools Major . Robert Joseph Evans Robert Joseph Evans
MAPREDUCE-4215 RM app page shows 500 error on appid parse error Major mrv2 Jonathan Eagles Jonathan Eagles
MAPREDUCE-4237 TestNodeStatusUpdater can fail if localhost has a domain associated with it Major . Robert Joseph Evans Robert Joseph Evans
HADOOP-8372 normalizeHostName() in NetUtils is not working properly in resolving a hostname start with numeric character Major io, util Junping Du Junping Du
HDFS-3385 ClassCastException when trying to append a file Major namenode Brahma Reddy Battula Tsz Wo Nicholas Sze
MAPREDUCE-4148 MapReduce should not have a compile-time dependency on HDFS Major mrv2 Tom White Tom White
HADOOP-8316 Audit logging should be disabled by default Major conf Eli Collins Eli Collins
MAPREDUCE-4233 NPE can happen in RMNMNodeInfo. Critical . Robert Joseph Evans Robert Joseph Evans
HDFS-3414 Balancer does not find NameNode if rpc-address or servicerpc-address are not set in client configs Minor balancer & mover Aaron T. Myers Aaron T. Myers
HDFS-3031 HA: Fix complete() and getAdditionalBlock() RPCs to be idempotent. Major ha Stephen Chu Todd Lipcon
MAPREDUCE-4238 mavenize data_join Critical mrv2 Thomas Graves Thomas Graves
HADOOP-8393 hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster Major scripts Patrick Hunt Patrick Hunt
MAPREDUCE-4250 hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster Major nodemanager Patrick Hunt Patrick Hunt
MAPREDUCE-4102 job counters not available in Jobhistory webui for killed jobs Major webapps Thomas Graves Bhallamudi Venkata Siva Kamesh
HDFS-3413 TestFailureToReadEdits timing out Critical ha, test Todd Lipcon Aaron T. Myers
HADOOP-8400 All commands warn “Kerberos krb5 configuration not found” when security is not enabled Major security Eli Collins Alejandro Abdelnur
HDFS-3422 TestStandbyIsHot timeouts too aggressive Minor test Todd Lipcon Todd Lipcon
HADOOP-8406 CompressionCodecFactory.CODEC_PROVIDERS iteration is thread-unsafe Major io Todd Lipcon Todd Lipcon
MAPREDUCE-4264 Got ClassCastException when using mapreduce.history.server.delegationtoken.required=true Blocker mrv2 Thomas Graves Thomas Graves
HDFS-3433 GetImageServlet should allow administrative requestors when security is enabled Major namenode Aaron T. Myers Aaron T. Myers
MAPREDUCE-3543 Mavenize Gridmix. Critical mrv2 Mahadev konar Thomas Graves
HDFS-1153 dfsnodelist.jsp should handle invalid input parameters Minor datanode Ravi Phulari Ravi Phulari
HDFS-2800 HA: TestStandbyCheckpoints.testCheckpointCancellation is racy Major ha, test Aaron T. Myers Todd Lipcon
HDFS-3391 TestPipelinesFailover#testLeaseRecoveryAfterFailover is failing Critical . Arun C Murthy Todd Lipcon
HADOOP-8287 etc/hadoop is missing hadoop-env.sh Major conf Eli Collins Eli Collins
MAPREDUCE-4197 Include the hsqldb jar in the hadoop-mapreduce tar file Major . Ravi Prakash Ravi Prakash
HDFS-3440 should more effectively limit stream memory consumption when reading corrupt edit logs Minor . Colin P. McCabe Colin P. McCabe
HDFS-3444 hdfs groups command doesn’t work with security enabled Major hdfs-client Aaron T. Myers Aaron T. Myers
HADOOP-8329 Build fails with Java 7 Major build Kumar Ravi Eli Collins
MAPREDUCE-4002 MultiFileWordCount job fails if the input path is not from default file system Major examples Bhallamudi Venkata Siva Kamesh Bhallamudi Venkata Siva Kamesh
MAPREDUCE-4269 documentation: Gridmix has javadoc warnings in StressJobFactory Major mrv2 Jonathan Eagles Jonathan Eagles
MAPREDUCE-3870 Invalid App Metrics Major mrv2 Bhallamudi Venkata Siva Kamesh Bhallamudi Venkata Siva Kamesh
HADOOP-8408 MR doesn’t work with a non-default ViewFS mount table and security enabled Major viewfs Aaron T. Myers Aaron T. Myers
HDFS-3415 During NameNode starting up, it may pick wrong storage directory inspector when the layout versions of the storage directories are different Major namenode Brahma Reddy Battula Brandon Li
HDFS-3436 adding new datanode to existing pipeline fails in case of Append/Recovery Major datanode Brahma Reddy Battula Vinayakumar B
MAPREDUCE-4262 NM gives wrong log message saying “Connected to ResourceManager” before trying to connect Minor mrv2, nodemanager Devaraj K Devaraj K
HDFS-2982 Startup performance suffers when there are many edit log segments Critical namenode Todd Lipcon Colin P. McCabe
MAPREDUCE-4276 Allow setting yarn.nodemanager.delete.debug-delay-sec property to “-1” for easier container debugging. Major mrv2 Ahmed Radwan Ahmed Radwan
MAPREDUCE-4224 TestFifoScheduler throws org.apache.hadoop.metrics2.MetricsException Major mrv2, scheduler, test Devaraj K Devaraj K
HDFS-3460 HttpFS proxyuser validation with Kerberos ON uses full principal name Critical . Alejandro Abdelnur Alejandro Abdelnur
HADOOP-8422 Deprecate FileSystem#getDefault* and getServerDefault methods that don’t take a Path argument Minor fs Eli Collins Eli Collins
HDFS-3368 Missing blocks due to bad DataNodes coming up and down. Major namenode Konstantin Shvachko Konstantin Shvachko
HADOOP-8268 A few pom.xml across Hadoop project may fail XML validation Major build Radim Kolar Radim Kolar
HADOOP-8444 Fix the tests FSMainOperationsBaseTest.java and F ileContextMainOperationsBaseTest.java to avoid potential test failure Major fs, test Mariappan Asokan madhukara phatak
MAPREDUCE-3493 Add the default mapreduce.shuffle.port property to mapred-default.xml Minor mrv2 Ahmed Radwan
HDFS-3398 Client will not retry when primaryDN is down once it’s just got pipeline Minor hdfs-client Brahma Reddy Battula amith
MAPREDUCE-4152 map task left hanging after AM dies trying to connect to RM Major mrv2 Thomas Graves Thomas Graves
HADOOP-8452 DN logs backtrace when running under jsvc and /jmx is loaded Minor . Andy Isaacson Andy Isaacson
MAPREDUCE-4297 Usersmap file in gridmix should not fail on empty lines Major contrib/gridmix Ravi Prakash Ravi Prakash
HDFS-3484 hdfs fsck doesn’t work if NN HTTP address is set to 0.0.0.0 even if NN RPC address is configured Minor hdfs-client Aaron T. Myers Aaron T. Myers
HDFS-3486 offlineimageviewer can’t read fsimage files that contain persistent delegation tokens Minor security, tools Colin P. McCabe Colin P. McCabe
HDFS-3487 offlineimageviewer should give byte offset information when it encounters an exception Minor tools Colin P. McCabe Colin P. McCabe
HADOOP-8460 Document proper setting of HADOOP_PID_DIR and HADOOP_SECURE_DN_PID_DIR Major documentation Robert Joseph Evans Robert Joseph Evans
HADOOP-8466 hadoop-client POM incorrectly excludes avro Major build Bruno Mahé Bruno Mahé
MAPREDUCE-4302 NM goes down if error encountered during log aggregation Critical nodemanager Daryn Sharp Daryn Sharp
HDFS-3442 Incorrect count for Missing Replicas in FSCK report Minor . suja s Andrew Wang
MAPREDUCE-4307 TeraInputFormat calls FileSystem.getDefaultBlockSize() without a Path - Failure when using ViewFileSystem Major mrv2 Ahmed Radwan Ahmed Radwan
HDFS-2025 Go Back to File View link is not working in tail.jsp Minor datanode sravankorumilli Ashish Singhi
HADOOP-8450 Remove src/test/system Trivial test Colin P. McCabe Eli Collins
MAPREDUCE-3350 Per-app RM page should have the list of application-attempts like on the app JHS page Critical mrv2, webapps Vinod Kumar Vavilapalli Jonathan Eagles
HDFS-3501 Checkpointing with security enabled will stop working after ticket lifetime expires Major ha, namenode Aaron T. Myers Aaron T. Myers
HADOOP-8481 update BUILDING.txt to talk about cmake rather than autotools Trivial documentation Colin P. McCabe Colin P. McCabe
HDFS-3266 DFSTestUtil#waitCorruptReplicas doesn’t sleep between checks Minor . Aaron T. Myers madhukara phatak
MAPREDUCE-4313 TestTokenCache doesn’t compile due TokenCache.getDelegationToken compilation error Blocker build, test Eli Collins Robert Joseph Evans
MAPREDUCE-3873 Nodemanager is not getting decommisioned if the absolute ip is given in exclude file. Minor mrv2, nodemanager Nishan Shetty xieguiming
HDFS-3505 DirectoryScanner does not join all threads in shutdown Minor . Colin P. McCabe Colin P. McCabe
HADOOP-8485 Don’t hardcode “Apache Hadoop 0.23” in the docs Minor documentation Eli Collins Eli Collins
HDFS-3485 DataTransferThrottler will over-throttle when currentTimeMillis jumps Minor . Andy Isaacson Andy Isaacson
HADOOP-8488 test-patch.sh gives +1 even if the native build fails. Minor . Colin P. McCabe Colin P. McCabe
HDFS-2914 HA: Standby should not enter safemode when resources are low Major ha, namenode Hari Mankude Vinayakumar B
HDFS-3490 DN WebHDFS methods throw NPE if Namenode RPC address param not specified Minor webhdfs Todd Lipcon Tsz Wo Nicholas Sze
MAPREDUCE-3927 Shuffle hang when set map.failures.percent Critical mrv2 MengWang Bhallamudi Venkata Siva Kamesh
HDFS-2797 Fix misuses of InputStream#skip in the edit log code Major ha, namenode Aaron T. Myers Colin P. McCabe
HDFS-3517 TestStartup should bind ephemeral ports Minor test Eli Collins Eli Collins
HADOOP-8501 Gridmix fails to compile on OpenJDK7u4 Major benchmarks Radim Kolar Radim Kolar
HDFS-3428 move DelegationTokenRenewer to common Major security Alejandro Abdelnur Alejandro Abdelnur
HADOOP-8507 Avoid OOM while deserializing DelegationTokenIdentifer Minor . Colin P. McCabe Colin P. McCabe
HDFS-3531 EditLogFileOutputStream#preallocate should check for incomplete writes Minor namenode Colin P. McCabe Colin P. McCabe
HDFS-766 Error message not clear for set space quota out of boundary values. Minor . Ravi Phulari Jon Zuanich
HADOOP-8433 Don’t set HADOOP_LOG_DIR in hadoop-env.sh Major scripts Brahma Reddy Battula Brahma Reddy Battula
HDFS-3480 Multiple SLF4J binding warning Major build Eli Collins Vinayakumar B
HADOOP-8509 JarFinder duplicate entry: META-INF/MANIFEST.MF exception Minor util Matteo Bertozzi Alejandro Abdelnur
HDFS-3524 TestFileLengthOnClusterRestart failed due to error message change Major test Eli Collins Brandon Li
HDFS-3518 Provide API to check HDFS operational state Major hdfs-client Bikas Saha Tsz Wo Nicholas Sze
HADOOP-8495 Update Netty to avoid leaking file descriptors during shuffle Critical build Jason Lowe Jason Lowe
HADOOP-8512 AuthenticatedURL should reset the Token when the server returns other than OK on authentication Minor security Alejandro Abdelnur Alejandro Abdelnur
MAPREDUCE-4341 add types to capacity scheduler properties documentation Major capacity-sched, mrv2 Thomas Graves Karthik Kambatla
MAPREDUCE-4267 mavenize pipes Critical mrv2 Thomas Graves Thomas Graves
MAPREDUCE-4270 data_join test classes are in the wrong packge Major mrv2 Brock Noland Thomas Graves
MAPREDUCE-4306 Problem running Distributed Shell applications as a user other than the one started the daemons Major mrv2 Ahmed Radwan Ahmed Radwan
MAPREDUCE-3889 job client tries to use /tasklog interface, but that doesn’t exist anymore Critical mrv2 Thomas Graves Devaraj K
MAPREDUCE-4320 gridmix mainClass wrong in pom.xml Major contrib/gridmix Thomas Graves Thomas Graves
MAPREDUCE-4295 RM crashes due to DNS issue Critical mrv2, resourcemanager Thomas Graves Thomas Graves
MAPREDUCE-4031 Node Manager hangs on shut down Critical mrv2, nodemanager Devaraj K Devaraj K
MAPREDUCE-4361 Fix detailed metrics for protobuf-based RPC on 0.23 Major mrv2 Jason Lowe Jason Lowe
MAPREDUCE-4336 Distributed Shell fails when used with the CapacityScheduler Major mrv2 Siddharth Seth Ahmed Radwan
MAPREDUCE-4290 JobStatus.getState() API is giving ambiguous values Major mrv2 Nishan Shetty Devaraj K
HADOOP-7868 Hadoop native fails to compile when default linker option is -Wl,–as-needed Major native James Page Trevor Robinson
MAPREDUCE-2289 Permissions race can make getStagingDir fail on local filesystem Major job submission Todd Lipcon Ahmed Radwan
HADOOP-8129 ViewFileSystemTestSetup setupForViewFileSystem is erring when the user’s home directory is somewhere other than /home (eg. /User) etc. Major fs, test Ravi Prakash Ahmed Radwan
MAPREDUCE-4228 mapreduce.job.reduce.slowstart.completedmaps is not working properly to delay the scheduling of the reduce tasks Major applicationmaster, mrv2 Jason Lowe Jason Lowe
MAPREDUCE-4372 Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager Major mrv2, resourcemanager Devaraj K Devaraj K
HADOOP-8249 invalid hadoop-auth cookies should trigger authentication if info is avail before returning HTTP 401 Major security bc Wong Alejandro Abdelnur
HDFS-3572 Cleanup code which inits SPNEGO in HttpServer Minor namenode, security Todd Lipcon Todd Lipcon
HDFS-3551 WebHDFS CREATE does not use client location for redirection Major webhdfs Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HADOOP-8168 empty-string owners or groups causes {{MissingFormatWidthException}} in o.a.h.fs.shell.Ls.ProcessPath() Major fs Eugene Koontz Eugene Koontz
MAPREDUCE-4376 TestClusterMRNotification times out Major mrv2, test Jason Lowe Kihwal Lee
HDFS-3559 DFSTestUtil: use Builder class to construct DFSTestUtil instances Minor . Colin P. McCabe Colin P. McCabe
HADOOP-8438 hadoop-validate-setup.sh refers to examples jar file which doesn’t exist Major . Devaraj K Devaraj K
MAPREDUCE-4383 HadoopPipes.cc needs to include unistd.h Minor pipes Andy Isaacson Andy Isaacson
HDFS-3491 HttpFs does not set permissions correctly Major . Romain Rigaux Alejandro Abdelnur
HDFS-3580 incompatible types; no instance(s) of type variable(s) V exist so that V conforms to boolean compiling HttpFSServer.java with OpenJDK Minor . Andy Isaacson Andy Isaacson
HADOOP-8449 hadoop fs -text fails with compressed sequence files with the codec file extension Minor . Joey Echeverria Harsh J
HADOOP-8538 CMake builds fail on ARM Major native Trevor Robinson Trevor Robinson
HDFS-3157 Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened Major namenode J.Andreina Ashish Singhi
HDFS-3575 HttpFS does not log Exception Stacktraces Minor . Brock Noland Brock Noland
HADOOP-8110 TestViewFsTrash occasionally fails Major fs Tsz Wo Nicholas Sze Jason Lowe
HDFS-3574 Fix small race and do some cleanup in GetImageServlet Minor namenode Todd Lipcon Todd Lipcon
HADOOP-8547 Package hadoop-pipes examples/bin directory (again) Minor . Colin P. McCabe Colin P. McCabe
HDFS-3581 FSPermissionChecker#checkPermission sticky bit check missing range check Major namenode Eli Collins Eli Collins
MAPREDUCE-4392 Counters.makeCompactString() changed behavior from 0.20 Major mrv2 Jason Lowe Jason Lowe
HADOOP-8563 don’t package hadoop-pipes examples/bin Minor build Colin P. McCabe Colin P. McCabe
MAPREDUCE-4384 Race conditions in IndexCache Major nodemanager Kihwal Lee Kihwal Lee
MAPREDUCE-4387 RM gets fatal error and exits during TestRM Major resourcemanager Kihwal Lee Kihwal Lee
HDFS-2619 Remove my personal email address from the libhdfs build file. Major build Owen O’Malley Owen O’Malley
HADOOP-8566 AvroReflectSerializer.accept(Class) throws a NPE if the class has no package (primitive types and arrays) Major io Alejandro Abdelnur Alejandro Abdelnur
MAPREDUCE-4379 Node Manager throws java.lang.OutOfMemoryError: Java heap space due to org.apache.hadoop.fs.LocalDirAllocator.contexts Blocker mrv2, nodemanager Devaraj K Devaraj K
MAPREDUCE-2220 Fix new API FileOutputFormat-related typos in mapred-default.xml Minor documentation Rui KUBO Rui KUBO
HDFS-3541 Deadlock between recovery, xceiver and packet responder Major datanode suja s Vinayakumar B
HDFS-711 hdfsUtime does not handle atime = 0 or mtime = 0 correctly Major documentation freestyler Colin P. McCabe
HDFS-3548 NamenodeFsck.copyBlock fails to create a Block Reader Critical namenode Todd Lipcon Colin P. McCabe
HDFS-3591 Backport HDFS-3357 to branch-0.23 Major . Robert Joseph Evans Robert Joseph Evans
HDFS-3603 Decouple TestHDFSTrash from TestTrash Major test Jason Lowe Jason Lowe
MAPREDUCE-4402 TestFileInputFormat fails intermittently Major test Jason Lowe Jason Lowe
MAPREDUCE-2739 MR-279: Update installation docs (remove YarnClientFactory) Minor mrv2 Ahmed Radwan Bo Wang
MAPREDUCE-3993 Graceful handling of codec errors during decompression Major mrv1, mrv2 Todd Lipcon Karthik Kambatla
MAPREDUCE-4300 OOM in AM can turn it into a zombie. Major applicationmaster Robert Joseph Evans Robert Joseph Evans
HDFS-3555 idle client socket triggers DN ERROR log (should be INFO or DEBUG) Major datanode, hdfs-client Jeff Lord Andy Isaacson
MAPREDUCE-4252 MR2 job never completes with 1 pending task Major mrv2 Tom White Tom White
HADOOP-8573 Configuration tries to read from an inputstream resource multiple times. Major conf Robert Joseph Evans Robert Joseph Evans
HDFS-3629 fix the typo in the error message about inconsistent storage layout version Trivial namenode Brandon Li Brandon Li
HDFS-3611 NameNode prints unnecessary WARNs about edit log normally skipping a few bytes Trivial namenode Harsh J Colin P. McCabe
HADOOP-8586 Fixup a bunch of SPNEGO misspellings Major . Eli Collins Eli Collins
HADOOP-3886 Error in javadoc of Reporter, Mapper and Progressable Minor documentation brien colwell Jingguo Yao
HDFS-3615 Two BlockTokenSecretManager findbugs warnings Major security Eli Collins Aaron T. Myers
HADOOP-8587 HarFileSystem access of harMetaCache isn’t threadsafe Minor fs Eli Collins Eli Collins
HADOOP-8585 Fix initialization circularity between UserGroupInformation and HadoopConfiguration Minor . Colin P. McCabe Colin P. McCabe
MAPREDUCE-4416 Some tests fail if Clover is enabled Critical client, mrv2 Kihwal Lee Kihwal Lee
HDFS-3633 libhdfs: hdfsDelete should pass JNI_FALSE or JNI_TRUE Minor libhdfs Colin P. McCabe Colin P. McCabe
HDFS-3306 fuse_dfs: don’t lock release operations Minor . Colin P. McCabe Colin P. McCabe
MAPREDUCE-4432 Confusing warning message when GenericOptionsParser is not used Trivial . Gabriel Reid
MAPREDUCE-4441 Fix build issue caused by MR-3451 Blocker . Karthik Kambatla Karthik Kambatla
MAPREDUCE-4419 ./mapred queue -info <queuename> -showJobs displays all the jobs irrespective of <queuename> Major mrv2 Nishan Shetty Devaraj K
MAPREDUCE-4299 Terasort hangs with MR2 FifoScheduler Major mrv2 Tom White Tom White
HADOOP-8543 Invalid pom.xml files on 0.23 branch Major build Radim Kolar Radim Kolar
HADOOP-8499 Lower min.user.id to 500 for the tests Minor . Colin P. McCabe Colin P. McCabe
HDFS-470 libhdfs should handle 0-length reads from FSInputStream correctly Minor . Pete Wyckoff Colin P. McCabe
HDFS-3609 libhdfs: don’t force the URI to look like hdfs://hostname:port Major libhdfs Colin P. McCabe Colin P. McCabe
HDFS-3539 libhdfs code cleanups Minor . Colin P. McCabe Colin P. McCabe
HADOOP-7818 DiskChecker#checkDir should fail if the directory is not executable Minor util Eli Collins madhukara phatak
MAPREDUCE-4395 Possible NPE at ClientDistributedCacheManager#determineTimestamps Critical distributed-cache, job submission, mrv2 Bhallamudi Venkata Siva Kamesh Bhallamudi Venkata Siva Kamesh
HDFS-3622 Backport HDFS-3541 to branch-0.23 Major . Robert Joseph Evans Robert Joseph Evans
MAPREDUCE-4447 Remove aop from cruft from the ant build Major build Eli Collins Eli Collins
MAPREDUCE-4437 Race in MR ApplicationMaster can cause reducers to never be scheduled Critical applicationmaster, mrv2 Jason Lowe Jason Lowe
HADOOP-8423 MapFile.Reader.get() crashes jvm or throws EOFException on Snappy or LZO block-compressed data Major io Jason B Todd Lipcon
HADOOP-8599 Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file Major fs Andrey Klochkov Andrey Klochkov
MAPREDUCE-4440 Change SchedulerApp & SchedulerNode to be a minimal interface Major . Arun C Murthy Arun C Murthy
MAPREDUCE-4449 Incorrect MR_HISTORY_STORAGE property name in JHAdminConfig Major mrv2 Ahmed Radwan Ahmed Radwan
MAPREDUCE-4380 Empty Userlogs directory is getting created under logs directory Minor mrv2, nodemanager Devaraj K Devaraj K
MAPREDUCE-4448 Nodemanager crashes upon application cleanup if aggregation failed to start Critical mrv2, nodemanager Jason Lowe Jason Lowe
HADOOP-8537 Two TFile tests failing recently Major io Todd Lipcon Todd Lipcon
MAPREDUCE-4406 Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports Major mrv2, test Ahmed Radwan Ahmed Radwan
MAPREDUCE-4407 Add hadoop-yarn-server-tests-<version>-tests.jar to hadoop dist package Major build, mrv2 Ahmed Radwan Ahmed Radwan
HDFS-3605 Block mistakenly marked corrupt during edit log catchup phase of failover Major ha, namenode Brahma Reddy Battula Todd Lipcon
HDFS-3646 LeaseRenewer can hold reference to inactive DFSClient instances forever Critical hdfs-client Kihwal Lee Kihwal Lee
HDFS-3673 libhdfs: fix some compiler warnings Minor . Colin P. McCabe Colin P. McCabe
HDFS-1249 with fuse-dfs, chown which only has owner (or only group) argument fails with Input/output error. Minor fuse-dfs matsusaka kentaro Colin P. McCabe
HDFS-3690 BlockPlacementPolicyDefault incorrectly casts LOG Major . Eli Collins Eli Collins
HDFS-3577 WebHdfsFileSystem can not read files larger than 24KB Blocker webhdfs Alejandro Abdelnur Tsz Wo Nicholas Sze
HDFS-3597 SNN can fail to start on upgrade Minor namenode Andy Isaacson Andy Isaacson
HDFS-3608 fuse_dfs: detect changes in UID ticket cache Minor . Colin P. McCabe Colin P. McCabe
HDFS-3688 Namenode loses datanode hostname if datanode re-registers Major datanode Jason Lowe Jason Lowe
MAPREDUCE-3893 allow capacity scheduler configs maximum-applications and maximum-am-resource-percent configurable on a per queue basis Critical mrv2 Thomas Graves Thomas Graves
HADOOP-8606 FileSystem.get may return the wrong filesystem Major fs Daryn Sharp Daryn Sharp
MAPREDUCE-4467 IndexCache failures due to missing synchronization Critical nodemanager Andrey Klochkov Kihwal Lee
MAPREDUCE-4465 Update description of yarn.nodemanager.address property Trivial . Bo Wang Bo Wang
HDFS-3720 hdfs.h must get packaged Major libhdfs Colin P. McCabe Colin P. McCabe
MAPREDUCE-4423 Potential infinite fetching of map output Critical mrv2 Robert Joseph Evans Robert Joseph Evans
HDFS-3696 Create files with WebHdfsFileSystem goes OOM when file size is big Critical webhdfs Kihwal Lee Tsz Wo Nicholas Sze
HADOOP-8626 Typo in default setting for hadoop.security.group.mapping.ldap.search.filter.user Major security Jonathan Natkins Jonathan Natkins
HADOOP-8613 AbstractDelegationTokenIdentifier#getUser() should set token auth type Critical . Daryn Sharp Daryn Sharp
HDFS-3679 fuse_dfs notrash option sets usetrash Minor fuse-dfs Conrad Meyer Conrad Meyer
HADOOP-8627 FS deleteOnExit may delete the wrong path Critical fs Daryn Sharp Daryn Sharp
HADOOP-8634 Ensure FileSystem#close doesn’t squawk for deleteOnExit paths Critical fs Daryn Sharp Daryn Sharp
HDFS-3732 fuse_dfs: incorrect configuration value checked for connection expiry timer period Minor fuse-dfs Colin P. McCabe Colin P. McCabe
HADOOP-8550 hadoop fs -touchz automatically created parent directories Major fs Robert Joseph Evans John George
MAPREDUCE-4342 Distributed Cache gives inconsistent result if cache files get deleted from task tracker Major . Mayank Bansal Mayank Bansal
MAPREDUCE-4456 LocalDistributedCacheManager can get an ArrayIndexOutOfBounds when creating symlinks Major mrv2 Robert Joseph Evans Robert Joseph Evans
MAPREDUCE-4496 AM logs link is missing user name Major applicationmaster, mrv2 Jason Lowe Jason Lowe
HADOOP-8637 FilterFileSystem#setWriteChecksum is broken Critical fs Daryn Sharp Daryn Sharp
MAPREDUCE-4493 Distibuted Cache Compatability Issues Critical mrv2 Robert Joseph Evans Robert Joseph Evans
MAPREDUCE-4492 Configuring total queue capacity between 100.5 and 99.5 at perticular level is sucessfull Minor mrv2 Nishan Shetty Mayank Bansal
MAPREDUCE-4483 2.0 build does not work Major . John George John George
HADOOP-8370 Native build failure: javah: class file for org.apache.hadoop.classification.InterfaceAudience not found Major native Trevor Robinson Trevor Robinson
MAPREDUCE-4457 mr job invalid transition TA_TOO_MANY_FETCH_FAILURE at FAILED Critical mrv2 Thomas Graves Robert Joseph Evans
MAPREDUCE-4444 nodemanager fails to start when one of the local-dirs is bad Blocker nodemanager Nathan Roberts Jason Lowe
HDFS-3738 TestDFSClientRetries#testFailuresArePerOperation sets incorrect timeout config Minor test Aaron T. Myers Aaron T. Myers
HADOOP-8633 Interrupted FsShell copies may leave tmp files Critical fs Daryn Sharp Daryn Sharp
HADOOP-8480 The native build should honor -DskipTests Trivial . Colin P. McCabe Colin P. McCabe
MAPREDUCE-4504 SortValidator writes to wrong directory Major mrv2 Robert Joseph Evans Robert Joseph Evans
HDFS-3724 add InterfaceAudience annotations to HttpFS classes and making inner enum static Major . Alejandro Abdelnur Alejandro Abdelnur
HDFS-3756 DelegationTokenFetcher creates 2 HTTP connections, the second one not properly configured Critical security Alejandro Abdelnur Alejandro Abdelnur
MAPREDUCE-4503 Should throw InvalidJobConfException if duplicates found in cacheArchives or cacheFiles Major mrv2 Robert Joseph Evans Robert Joseph Evans
MAPREDUCE-4498 Remove hsqldb jar from Hadoop runtime classpath Critical build, examples Robert Kanter Robert Kanter
HDFS-3579 libhdfs: fix exception handling Major libhdfs Colin P. McCabe Colin P. McCabe
MAPREDUCE-4494 TestFifoScheduler failing with Metrics source QueueMetrics,q0=default already exists! Major mrv2, test Ahmed Radwan Ahmed Radwan
MAPREDUCE-4484 Incorrect IS_MINI_YARN_CLUSTER property name in YarnConfiguration Major mrv2 Ahmed Radwan Ahmed Radwan
HDFS-3760 primitiveCreate is a write, not a read Minor hdfs-client Andy Isaacson Andy Isaacson
HADOOP-8660 TestPseudoAuthenticator failing with NPE Major . Eli Collins Alejandro Abdelnur
YARN-12 Several Findbugs issues with new FairScheduler in YARN Major scheduler Junping Du Junping Du
HDFS-3710 libhdfs misuses O_RDONLY/WRONLY/RDWR Minor libhdfs Andy Isaacson Andy Isaacson
HDFS-3755 Creating an already-open-for-write file with overwrite=true fails Major namenode Todd Lipcon Todd Lipcon
YARN-13 Merge of yarn reorg into branch-2 copied trunk tree Critical . Todd Lipcon
MAPREDUCE-3782 teragen terasort jobs fail when using webhdfs:// Critical mrv2 Arpit Gupta Jason Lowe
YARN-14 Symlinks to peer distributed cache files no longer work Major nodemanager Jason Lowe Jason Lowe
HDFS-3721 hsync support broke wire compatibility Critical datanode, hdfs-client Todd Lipcon Aaron T. Myers
HDFS-3758 TestFuseDFS test failing Minor fuse-dfs Colin P. McCabe Colin P. McCabe
HDFS-3754 BlockSender doesn’t shutdown ReadaheadPool threads Major datanode Eli Collins Eli Collins
HADOOP-8659 Native libraries must build with soft-float ABI for Oracle JVM on ARM Major native Trevor Robinson Colin P. McCabe
MAPREDUCE-4053 Counters group names deprecation is wrong, iterating over group names deprecated names don’t show up Major mrv2 Alejandro Abdelnur Robert Joseph Evans
HDFS-3790 test_fuse_dfs.c doesn’t compile on centos 5 Minor fuse-dfs Colin P. McCabe Colin P. McCabe
HDFS-3658 TestDFSClientRetries#testNamenodeRestart failed Major . Eli Collins Tsz Wo Nicholas Sze
HDFS-3718 Datanode won’t shutdown because of runaway DataBlockScanner thread Critical datanode Kihwal Lee Kihwal Lee
HDFS-3794 WebHDFS Open used with Offset returns the original (and incorrect) Content Length in the HTTP Header. Major webhdfs Ravi Prakash Ravi Prakash
HADOOP-8699 some common testcases create core-site.xml in test-classes making other testcases to fail Critical test Alejandro Abdelnur Alejandro Abdelnur
HADOOP-8703 distcpV2: turn CRC checking off for 0 byte size Major . Dave Thompson Dave Thompson
HDFS-3048 Small race in BlockManager#close Major namenode Eli Collins Andy Isaacson
MAPREDUCE-4562 Support for “FileSystemCounter” legacy counter group name for compatibility reasons is creating incorrect counter name Major . Jarek Jarcec Cecho Jarek Jarcec Cecho
HADOOP-8654 TextInputFormat delimiter bug:- Input Text portion ends with & Delimiter starts with same char/char sequence Major util Gelesh
HDFS-2963 Console Output is confusing while executing metasave (dfsadmin command) Minor . J.Andreina Andrew Wang
HADOOP-8390 TestFileSystemCanonicalization fails with JDK7 Major test Trevor Robinson Trevor Robinson
HDFS-3808 fuse_dfs: postpone libhdfs intialization until after fork Critical fuse-dfs Colin P. McCabe Colin P. McCabe
HDFS-3788 distcp can’t copy large files using webhdfs due to missing Content-Length header Critical webhdfs Eli Collins Tsz Wo Nicholas Sze
HADOOP-8692 TestLocalDirAllocator fails intermittently with JDK7 Major test Trevor Robinson Trevor Robinson
HADOOP-8693 TestSecurityUtil fails intermittently with JDK7 Major test Trevor Robinson Trevor Robinson
HADOOP-8697 TestWritableName fails intermittently with JDK7 Major test Trevor Robinson Trevor Robinson
YARN-25 remove old aggregated logs Major . Thomas Graves Robert Joseph Evans
HADOOP-8695 TestPathData fails intermittently with JDK7 Major test Trevor Robinson Trevor Robinson
HDFS-3816 Invalidate work percentage default value should be 0.32f instead of 32 Major namenode Jing Zhao Jing Zhao
HADOOP-7967 Need generalized multi-token filesystem support Critical fs, security Daryn Sharp Daryn Sharp
YARN-27 Failed refreshQueues due to misconfiguration prevents further refreshing of queues Major . Ramya Sunil Arun C Murthy
YARN-58 NM leaks filesystems Critical nodemanager Daryn Sharp Jason Lowe
HDFS-3803 BlockPoolSliceScanner new work period notice is very chatty at INFO level Minor datanode Andrew Purtell
HADOOP-8611 Allow fall-back to the shell-based implementation when JNI-based users-group mapping fails Major security Kihwal Lee Robert Parker
HADOOP-8686 Fix warnings in native code Minor native Colin P. McCabe Colin P. McCabe
HDFS-3707 TestFSInputChecker: improper use of skip Minor . Colin P. McCabe Colin P. McCabe
MAPREDUCE-3506 Calling getPriority on JobInfo after parsing a history log with JobHistoryParser throws a NullPointerException Minor client, mrv2 Ratandeep Ratti Jason Lowe
MAPREDUCE-4570 ProcfsBasedProcessTree#constructProcessInfo() prints a warning if procfsDir/<pid>/stat is not found. Minor mrv2 Ahmed Radwan Ahmed Radwan
HDFS-3194 DataNode block scanner is running too frequently Major datanode suja s Andy Isaacson
YARN-22 Using URI for yarn.nodemanager log dirs fails Minor . Eli Collins Mayank Bansal
HADOOP-8720 TestLocalFileSystem should use test root subdirectory Trivial test Vlad Rozov Vlad Rozov
HDFS-3830 test_libhdfs_threaded: use forceNewInstance Minor libhdfs Colin P. McCabe Colin P. McCabe
HDFS-3832 Remove protocol methods related to DistributedUpgrade Major datanode, namenode Suresh Srinivas Suresh Srinivas
HDFS-3835 Long-lived 2NN cannot perform a checkpoint if security is enabled and the NN restarts with outstanding delegation tokens Major namenode, security Aaron T. Myers Aaron T. Myers
HADOOP-8721 ZKFC should not retry 45 times when attempting a graceful fence during a failover Critical auto-failover, ha suja s Vinayakumar B
MAPREDUCE-4068 Jars in lib subdirectory of the submittable JAR are not added to the classpath Blocker mrv2 Ahmed Radwan Robert Kanter
MAPREDUCE-4577 HDFS-3672 broke TestCombineFileInputFormat.testMissingBlocks() test Minor test Alejandro Abdelnur Aaron T. Myers
MAPREDUCE-4470 Fix TestCombineFileInputFormat.testForEmptyFile Major test Kihwal Lee Ilya Katsov
HDFS-3841 Port HDFS-3835 to branch-0.23 Major . Robert Joseph Evans Robert Joseph Evans
HADOOP-8632 Configuration leaking class-loaders Major conf Costin Leau Costin Leau
HADOOP-8655 In TextInputFormat, while specifying textinputformat.record.delimiter the character/character sequences in data file similar to starting character/starting character sequence in delimiter were found missing in certain cases in the Map Output Major util Arun A K
HADOOP-8225 DistCp fails when invoked by Oozie Blocker security Mithun Radhakrishnan Daryn Sharp
MAPREDUCE-2374 “Text File Busy” errors launching MR tasks Major . Todd Lipcon Andy Isaacson
HADOOP-8709 globStatus changed behavior from 0.20/1.x Critical fs Jason Lowe Jason Lowe
HDFS-3715 Fix TestFileCreation#testFileCreationNamenodeRestart Major test Eli Collins Andrew Wang
HADOOP-8725 MR is broken when security is off Blocker security Daryn Sharp Daryn Sharp
HDFS-3177 Allow DFSClient to find out and use the CRC type being used for a file. Major datanode, hdfs-client Kihwal Lee Kihwal Lee
HDFS-3683 Edit log replay progress indicator shows >100% complete Minor namenode Todd Lipcon Plamen Jeliazkov
HDFS-3853 Port MiniDFSCluster enableManagedDfsDirsRedundancy option to branch-2 Minor namenode Colin P. McCabe Colin P. McCabe
HADOOP-8060 Add a capability to discover and set checksum types per file. Major fs, util Kihwal Lee Kihwal Lee
YARN-37 TestRMAppTransitions.testAppSubmittedKilled passes for the wrong reason Minor resourcemanager Jason Lowe Mayank Bansal
MAPREDUCE-4580 Change MapReduce to use the yarn-client module Major . Vinod Kumar Vavilapalli Vinod Kumar Vavilapalli
HDFS-3856 TestHDFSServerPorts failure is causing surefire fork failure Blocker test Thomas Graves Eli Collins
MAPREDUCE-4579 TestTaskAttempt fails jdk7 Major . Thomas Graves Thomas Graves
YARN-31 TestDelegationTokenRenewer fails on jdk7 Major . Thomas Graves Thomas Graves
HDFS-3860 HeartbeatManager#Monitor may wrongly hold the writelock of namesystem Major . Jing Zhao Jing Zhao
MAPREDUCE-4600 TestTokenCache.java from MRV1 no longer compiles Critical . Robert Joseph Evans Daryn Sharp
HDFS-3849 When re-loading the FSImage, we should clear the existing genStamp and leases. Critical namenode Colin P. McCabe Colin P. McCabe
HDFS-3864 NN does not update internal file mtime for OP_CLOSE when reading from the edit log Major namenode Aaron T. Myers Aaron T. Myers
HADOOP-8737 cmake: always use JAVA_HOME to find libjvm.so, jni.h, jni_md.h Minor native Colin P. McCabe Colin P. McCabe
HADOOP-8614 IOUtils#skipFully hangs forever on EOF Minor . Colin P. McCabe Colin P. McCabe
HADOOP-8747 Syntax error on cmake version 2.6 patch 2 in JNIFlags.cmake Major native Colin P. McCabe Colin P. McCabe
MAPREDUCE-4608 hadoop-mapreduce-client is missing some dependencies Major build Alejandro Abdelnur Alejandro Abdelnur
MAPREDUCE-4610 Support deprecated mapreduce.job.counters.limit property in MR2 Major mrv2 Tom White Tom White
HDFS-3861 Deadlock in DFSClient Blocker hdfs-client Kihwal Lee Kihwal Lee
HADOOP-8726 The Secrets in Credentials are not available to MR tasks Major security Benoy Antony Daryn Sharp
HADOOP-8031 Configuration class fails to find embedded .jar resources; should use URL.openStream() Major conf Elias Ross Elias Ross
MAPREDUCE-4569 TestHsWebServicesJobsQuery fails on jdk7 Major . Thomas Graves Thomas Graves
HDFS-3837 Fix DataNode.recoverBlock findbugs warning Major datanode Eli Collins Eli Collins
HADOOP-8722 Update BUILDING.txt with latest snappy info Minor documentation Eli Collins Colin P. McCabe
HDFS-3733 Audit logs should include WebHDFS access Major webhdfs Andy Isaacson Andy Isaacson
YARN-63 RMNodeImpl is missing valid transitions from the UNHEALTHY state Major resourcemanager Jason Lowe Jason Lowe
HADOOP-8727 Gracefully deprecate dfs.umaskmode in 2.x onwards Major conf Harsh J Harsh J
YARN-66 aggregated logs permissions not set properly Critical nodemanager Thomas Graves Thomas Graves
MAPREDUCE-4612 job summary file permissions not set when its created Critical . Thomas Graves Thomas Graves
HDFS-3833 TestDFSShell fails on Windows due to file concurrent read write Major test Brandon Li Brandon Li
MAPREDUCE-4611 MR AM dies badly when Node is decomissioned Critical . Robert Joseph Evans Robert Joseph Evans
MAPREDUCE-4604 In mapred-default, mapreduce.map.maxattempts & mapreduce.reduce.maxattempts defaults are set to 4 as well as mapreduce.job.maxtaskfailures.per.tracker. Critical mrv2 Ravi Prakash Ravi Prakash
HDFS-3873 Hftp assumes security is disabled if token fetch fails Major hdfs-client Daryn Sharp Daryn Sharp
HDFS-3852 TestHftpDelegationToken is broken after HADOOP-8225 Major hdfs-client, security Aaron T. Myers Daryn Sharp
HDFS-3879 Fix findbugs warning in TransferFsImage on branch-2 Minor namenode Eli Collins Eli Collins
HDFS-3466 The SPNEGO filter for the NameNode should come out of the web keytab file Major namenode, security Owen O’Malley Owen O’Malley
HDFS-3469 start-dfs.sh will start zkfc, but stop-dfs.sh will not stop zkfc similarly. Minor auto-failover Vinayakumar B Vinayakumar B
HDFS-3888 BlockPlacementPolicyDefault code cleanup Minor . Jing Zhao Jing Zhao
YARN-79 Calling YarnClientImpl.close throws Exception Major client Bikas Saha Vinod Kumar Vavilapalli
YARN-42 Node Manager throws NPE on startup Major nodemanager Devaraj K Devaraj K
HADOOP-8764 CMake: HADOOP-8737 broke ARM build Major build Trevor Robinson Trevor Robinson
HDFS-1490 TransferFSImage should timeout Minor namenode Dmytro Molkov Vinayakumar B
HDFS-3054 distcp -skipcrccheck has no effect Major tools patrick white Colin P. McCabe
HADOOP-8770 NN should not RPC to self to find trash defaults (causes deadlock) Blocker trash Todd Lipcon Eli Collins
YARN-68 NodeManager will refuse to shutdown indefinitely due to container log aggregation Major nodemanager patrick white Daryn Sharp
YARN-83 Change package of YarnClient to include apache Major client Bikas Saha Bikas Saha
MAPREDUCE-4635 MR side of YARN-83. Changing package of YarnClient Major . Bikas Saha Bikas Saha
YARN-36 branch-2.1.0-alpha doesn’t build Blocker . Eli Collins Radim Kolar
HADOOP-8648 libhadoop: native CRC32 validation crashes when io.bytes.per.checksum=1 Major . Colin P. McCabe Colin P. McCabe
HADOOP-8766 FileContextMainOperationsBaseTest should randomize the root dir Major test Eli Collins Colin P. McCabe
YARN-87 NM ResourceLocalizationService does not set permissions of local cache directories Critical nodemanager Jason Lowe Jason Lowe
HDFS-3890 filecontext mkdirs doesn’t apply umask as expected Critical . Thomas Graves Thomas Graves
MAPREDUCE-4633 history server doesn’t set permissions on all subdirs Critical jobhistoryserver Thomas Graves oss.wakayama
HADOOP-8749 HADOOP-8031 changed the way in which relative xincludes are handled in Configuration. Major conf Ahmed Radwan Ahmed Radwan
HDFS-3895 hadoop-client must include commons-cli Major build Alejandro Abdelnur Alejandro Abdelnur
MAPREDUCE-4572 Can not access user logs - Jetty is not configured by default to serve aliases/symlinks Major tasktracker, webapps Ahmed Radwan Ahmed Radwan
MAPREDUCE-4641 Exception in commitJob marks job as successful in job history Major mrv2 Jason Lowe Jason Lowe
YARN-15 YarnConfiguration DEFAULT_YARN_APPLICATION_CLASSPATH should be updated Critical nodemanager Alejandro Abdelnur Arun C Murthy
YARN-75 RMContainer should handle a RELEASE event while RUNNING Major . Siddharth Seth Siddharth Seth
HADOOP-8431 Running distcp wo args throws IllegalArgumentException Major . Eli Collins Sandy Ryza
MAPREDUCE-4642 MiniMRClientClusterFactory should not use job.setJar() Major test Robert Kanter Robert Kanter
HADOOP-8775 MR2 distcp permits non-positive value to -bandwidth option which causes job never to complete Major . Sandy Ryza Sandy Ryza
HDFS-2757 Cannot read a local block that’s being written to when using the local read short circuit Major . Jean-Daniel Cryans Jean-Daniel Cryans
HADOOP-8781 hadoop-config.sh should add JAVA_LIBRARY_PATH to LD_LIBRARY_PATH Major scripts Alejandro Abdelnur Alejandro Abdelnur
MAPREDUCE-4646 client does not receive job diagnostics for failed jobs Major mrv2 Jason Lowe Jason Lowe
HDFS-3664 BlockManager race when stopping active services Major test Eli Collins Colin P. McCabe
HDFS-3902 TestDatanodeBlockScanner#testBlockCorruptionPolicy is broken Minor . Andy Isaacson Andy Isaacson
HDFS-3928 MiniDFSCluster should reset the first ExitException on shutdown Major test Eli Collins Eli Collins
HADOOP-8801 ExitUtil#terminate should capture the exception stack trace Major . Eli Collins Eli Collins
YARN-108 FSDownload can create cache directories with the wrong permissions Critical nodemanager Jason Lowe Jason Lowe
YARN-88 DefaultContainerExecutor can fail to set proper permissions Major nodemanager Jason Lowe Jason Lowe
MAPREDUCE-4649 mr-jobhistory-daemon.sh needs to be updated post YARN-1 Major jobhistoryserver Vinod Kumar Vavilapalli Vinod Kumar Vavilapalli
MAPREDUCE-4647 We should only unjar jobjar if there is a lib directory in it. Major mrv2 Robert Joseph Evans Robert Joseph Evans
HDFS-3972 Trash emptier fails in secure HA cluster Critical namenode Todd Lipcon Todd Lipcon
HDFS-3731 2.0 release upgrade must handle blocks being written from 1.0 Blocker datanode Suresh Srinivas Kihwal Lee
YARN-106 Nodemanager needs to set permissions of local directories Major nodemanager Jason Lowe Jason Lowe
MAPREDUCE-4691 Historyserver can report “Unknown job” after RM says job has completed Critical jobhistoryserver, mrv2 Jason Lowe Robert Joseph Evans
MAPREDUCE-4689 JobClient.getMapTaskReports on failed job results in NPE Major client Jason Lowe Jason Lowe
YARN-138 Improve default config values for YARN Major resourcemanager, scheduler Arun C Murthy Harsh J
YARN-174 TestNodeStatusUpdater is failing in trunk Major nodemanager Robert Joseph Evans Vinod Kumar Vavilapalli

TESTS:

JIRA Summary Priority Component Reporter Contributor
MAPREDUCE-3983 TestTTResourceReporting can fail, and should just be deleted Major mrv1 Robert Joseph Evans Ravi Prakash
HADOOP-8283 Allow tests to control token service value Major test Daryn Sharp Daryn Sharp
HDFS-3258 Test for HADOOP-8144 (pseudoSortByDistance in NetworkTopology for first rack local node) Major test Eli Collins Junping Du
MAPREDUCE-4212 TestJobClientGetJob sometimes fails Major test Daryn Sharp Daryn Sharp
HDFS-3606 libhdfs: create self-contained unit test Minor libhdfs Colin P. McCabe Colin P. McCabe
HDFS-3665 Add a test for renaming across file systems via a symlink Major test Eli Collins Eli Collins
HDFS-3709 TestStartup tests still binding to the ephemeral port Major test Eli Collins Eli Collins
HDFS-3291 add test that covers HttpFS working w/ a non-HDFS Hadoop filesystem Major . Alejandro Abdelnur Alejandro Abdelnur
HDFS-3634 Add self-contained, mavenized fuse_dfs test Minor fuse-dfs Colin P. McCabe Colin P. McCabe

SUB-TASKS:

JIRA Summary Priority Component Reporter Contributor
HDFS-2330 In NNStorage.java, IOExceptions of stream closures can mask root exceptions. Major namenode Uma Maheswara Rao G Uma Maheswara Rao G
HDFS-3168 Clean up FSNamesystem and BlockManager Major namenode Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
MAPREDUCE-3942 Randomize master key generation for ApplicationTokenSecretManager and roll it every so often Major mrv2, security Vinod Kumar Vavilapalli Vinod Kumar Vavilapalli
MAPREDUCE-3972 Locking and exception issues in JobHistory Server. Major mrv2 Robert Joseph Evans Robert Joseph Evans
MAPREDUCE-4161 create sockets consistently Major client, mrv2 Daryn Sharp Daryn Sharp
MAPREDUCE-3613 web service calls header contains 2 content types Critical mrv2 Thomas Graves Thomas Graves
MAPREDUCE-4163 consistently set the bind address Major mrv2 Daryn Sharp Daryn Sharp
MAPREDUCE-4162 Correctly set token service Major client, mrv2 Daryn Sharp Daryn Sharp
HDFS-3369 change variable names referring to inode in blockmanagement to more appropriate Minor namenode John George John George
HDFS-2717 BookKeeper Journal output stream doesn’t check addComplete rc Major . Ivan Kelly Ivan Kelly
HDFS-3058 HA: Bring BookKeeperJournalManager up to date with HA changes Major . Ivan Kelly Ivan Kelly
HDFS-3452 BKJM:Switch from standby to active fails and NN gets shut down due to delay in clearing of lock Blocker . suja s Uma Maheswara Rao G
HDFS-3474 Cleanup Exception handling in BookKeeper journal manager Major . Ivan Kelly Ivan Kelly
HDFS-3468 Make BKJM-ZK session timeout configurable. Major . Uma Maheswara Rao G Uma Maheswara Rao G
HDFS-3423 BKJM: NN startup is failing, when tries to recoverUnfinalizedSegments() a bad inProgress_ ZNodes Major . Rakesh R Ivan Kelly
HDFS-3441 Race condition between rolling logs at active NN and purging at standby Major . suja s Rakesh R
HDFS-3502 Change INodeFile and INodeFileUnderConstruction to package private Major namenode Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-3408 BKJM : Namenode format fails, if there is no BK root Minor namenode Rakesh R Rakesh R
HDFS-3389 Document the BKJM usage in Namenode HA. Major namenode Uma Maheswara Rao G Uma Maheswara Rao G
HDFS-3190 Simple refactors in existing NN code to assist QuorumJournalManager extension Minor namenode Todd Lipcon Todd Lipcon
MAPREDUCE-3940 ContainerTokens should have an expiry interval Major mrv2, security Vinod Kumar Vavilapalli Vinod Kumar Vavilapalli
HADOOP-7754 Expose file descriptors from Hadoop-wrapped local FileSystems Major native, performance Todd Lipcon Todd Lipcon
YARN-39 RM-NM secret-keys should be randomly generated and rolled every so often Critical . Vinod Kumar Vavilapalli Vinod Kumar Vavilapalli
YARN-29 Add a yarn-client module Major client Vinod Kumar Vavilapalli Vinod Kumar Vavilapalli
YARN-60 NMs rejects all container tokens after secret key rolls Blocker nodemanager Daryn Sharp Vinod Kumar Vavilapalli

OTHER:

JIRA Summary Priority Component Reporter Contributor
MAPREDUCE-4051 Remove the empty hadoop-mapreduce-project/assembly/all.xml file Major . Ravi Prakash Ravi Prakash
MAPREDUCE-4134 Remove references of mapred.child.ulimit etc. since they are not being used any more Major mrv2 Ravi Prakash Ravi Prakash
HADOOP-8403 bump up POMs version to 2.0.1-SNAPSHOT Major build Alejandro Abdelnur Alejandro Abdelnur
YARN-1 Move YARN out of hadoop-mapreduce Major . Arun C Murthy Arun C Murthy
YARN-154 Create Yarn trunk and commit jobs Major . Eli Collins Robert Joseph Evans