Release Notes - Flume - Version v0.9.3
Bug
- [FLUME-63] - Master complains about logical nodes contexts with multiple WALs
- [FLUME-99] - Errors in default ports documentation
- [FLUME-164] - empty files cause NullPointerException, agent stops collecting further data but keeps running in background
- [FLUME-280] - '+=' Operation not work. bash-3.0
- [FLUME-320] - Race condition in new NIO based TailSource
- [FLUME-333] - 'ant tar' did not include LICENSE, RELEASENOTES, README, and NOTICE
- [FLUME-336] - Fix Tests that fail due to permissions in windows
- [FLUME-337] - TestAvroDataFile tests fail
- [FLUME-339] - Fix Tests that break due to windows path escaping.
- [FLUME-345] - Generated html from ASCIIDOC contains GPL code.
- [FLUME-347] - Developer guide asciidoc does not build.
- [FLUME-348] - ThriftEventAdaptor should return null when a nonexistent attribute is fetched
- [FLUME-349] - Fix tests that break due to file semantics in windows.
- [FLUME-350] - Typo in conf/log4j.properties
- [FLUME-362] - Typos in man pages
- [FLUME-365] - 'refresh' command with auto*Chain replaces autoCollectorSource with logicalSource.
- [FLUME-376] - Multiple WALs not isolated when using multiple agentE2ESinks.
- [FLUME-382] - All logical nodes in multi master mode are stuck in DECOMISSIONED mode.
- [FLUME-395] - Incorrect zip-compression codec name inside flume documentation
- [FLUME-411] - Events sent down each branch of a FanOut sink should be independent
- [FLUME-416] - CollectorSink hangs due to ConcurrentModificationException in RollSink
- [FLUME-430] - E2E Mode recovery doesn't deliver all events.
- [FLUME-433] - Agents end up in ERROR mode when all collectors are killed in BE or DFO mode
- [FLUME-435] - Be nice when there is a null body in ThriftEventAdapter
- [FLUME-439] - Auto Find Port in StatusHttpServer doesn't work.
- [FLUME-466] - Documentation typos
- [FLUME-483] - Some code in src/javatest-torture and plugins fails to build.
- [FLUME-508] - Fix TestMasterReportPusher tests
Improvement
- [FLUME-17] - Remove LET sink expressions
- [FLUME-122] - Make all Source/Sink/Decos API calls cancellable by throwing InterruptedExceptions
- [FLUME-131] - Handle source/sink/deco cancellation cleanly.
- [FLUME-240] - Flume master status page keeps accumulating information
- [FLUME-307] - Auto-generate all build version strings during build.
- [FLUME-327] - StatusHttpServers should use create paths in a OS agnostic way
- [FLUME-377] - Node statuses should be displayed in a sorted order.
- [FLUME-379] - Better error message when mapping already mapped logical node.
- [FLUME-391] - Changing sleep from 100ms to 10ms in exec source
- [FLUME-398] - Node Configurations should be displayed in sorted order.
- [FLUME-399] - Update Source API to use InterruptedExceptions
- [FLUME-405] - Parameterize gossip ack max age
- [FLUME-407] - Remove dead code from FlumeConfiguration
- [FLUME-412] - Text Sink should use KW Args.
- [FLUME-422] - Remove unsupported FanInSource.
- [FLUME-423] - Remove deprecated ExecEventSource
- [FLUME-428] - Get rid of FAILCHAIN from language and flume config parser.
- [FLUME-434] - Remove multi source from configuration grammer
- [FLUME-436] - Reduce the severity of being unable to connect to a master
- [FLUME-437] - Reduce the severity of being unable to connect to a master gossip port
- [FLUME-438] - Add ${user-name} escape sequence to default agent/master log dirs in FlumeConfiguration.
- [FLUME-444] - Remove flumereporter.jsp file from node webapp.
- [FLUME-445] - Remove the use of LET in agentDFOChain sink.
- [FLUME-446] - Reactivate tests in TestAgentSink.
- [FLUME-469] - node table should show flow-id
- [FLUME-470] - Flume code generator should regenerate kwargs
- [FLUME-479] - Lexer error is inconsistent
- [FLUME-487] - Update Thrift to 0.5.0
- [FLUME-488] - Fix some tests that have wrong names
New Feature
- [FLUME-58] - Builders and configuration language should support keyword arguments
- [FLUME-107] - Allow Flume to run on Windows
- [FLUME-165] - Allow collector sink to output to other sinks.
- [FLUME-208] - add "startFromEnd" args to tailDir
- [FLUME-338] - Service'ify flume node/master for windows.
- [FLUME-356] - Installer for Windows Flume.
- [FLUME-360] - Generic JSON output format
- [FLUME-361] - bin/flume dump: Allow specifying output format
- [FLUME-367] - JSON interface for master
- [FLUME-385] - Flume node read-only JSON interface
- [FLUME-408] - Expose ack information in a master for debugging
- [FLUME-410] - Add ability to tail subdirs to tailDir sink
- [FLUME-413] - Sources should have a Context as an argument.
- [FLUME-424] - Make Multi master startup not depend on special config vars or special command line flags.
- [FLUME-425] - Comprehensive node metrics traversal mechanism.
- [FLUME-426] - Use Jettison Library to generate JSON objects in Master
- [FLUME-440] - Add 'dumplog' command to bin/flume
- [FLUME-443] - Simplify how decorators are specified.
- [FLUME-471] - Add metrics to batching/unbatching/gzip/gunzip decorators
- [FLUME-505] - Message Digest decorator
Task
- [FLUME-291] - Support using pmd or checkstyle with Flume
- [FLUME-309] - Logging Developer Guidelines
- [FLUME-315] - Create Developer Guide documentation
- [FLUME-328] - Identify Tests that break/fail in Windows
- [FLUME-335] - Include asciidoc artifacts in repo and only build docs when necessary
- [FLUME-340] - Check that all files use unix style newlines instead of windows style newlines
- [FLUME-341] - Link to the DeveloperGuide from the index.html
- [FLUME-352] - Document running flume on windows.
- [FLUME-415] - Properly handle license for aho-corasick code.
- [FLUME-461] - Document auto find port option of flume node
- [FLUME-462] - Cleanup type casting warnings in core build.
- [FLUME-489] - Update docs to explain new 0.9.3 syntax.