org.apache.crunch.contrib.bloomfilter
Class BloomFilterFactory
java.lang.Object
org.apache.crunch.contrib.bloomfilter.BloomFilterFactory
public class BloomFilterFactory
- extends Object
Factory Class for creating BloomFilters. The APIs require a
BloomFilterFn
which is responsible for generating keys of the filter.
BloomFilterFactory
public BloomFilterFactory()
createFilter
public static PObject<Map<String,org.apache.hadoop.util.bloom.BloomFilter>> createFilter(org.apache.hadoop.fs.Path inputPath,
BloomFilterFn<String> filterFn)
throws IOException
- The method will take an input path and generates BloomFilters for all text
files in that path. The method return back a
PObject
containing a
Map
having file names as keys and filters as values
- Throws:
IOException
createFilter
public static <T> PObject<org.apache.hadoop.util.bloom.BloomFilter> createFilter(PCollection<T> collection,
BloomFilterFn<T> filterFn)
Copyright © 2014 The Apache Software Foundation. All Rights Reserved.