public class JSParseFilter extends Object implements HtmlParseFilter, Parser
Modifier and Type | Field and Description |
---|---|
static org.slf4j.Logger |
LOG |
X_POINT_ID
X_POINT_ID
Constructor and Description |
---|
JSParseFilter() |
Modifier and Type | Method and Description |
---|---|
ParseResult |
filter(Content content,
ParseResult parseResult,
HTMLMetaTags metaTags,
DocumentFragment doc)
Adds metadata or otherwise modifies a parse of HTML content, given
the DOM tree of a page.
|
org.apache.hadoop.conf.Configuration |
getConf() |
ParseResult |
getParse(Content c)
This method parses the given content and returns a map of
<key, parse> pairs.
|
static void |
main(String[] args) |
void |
setConf(org.apache.hadoop.conf.Configuration conf) |
public ParseResult filter(Content content, ParseResult parseResult, HTMLMetaTags metaTags, DocumentFragment doc)
HtmlParseFilter
filter
in interface HtmlParseFilter
public ParseResult getParse(Content c)
Parser
This method parses the given content and returns a map of
<key, parse> pairs. Parse
instances will be persisted
under the given key.
Note: Meta-redirects should be followed only when they are coming from
the original URL. That is:
Assume fetcher is in parsing mode and is currently processing
foo.bar.com/redirect.html. If this url contains a meta redirect
to another url, fetcher should only follow the redirect if the map
contains an entry of the form <"foo.bar.com/redirect.html",
Parse
with a ParseStatus
indicating the redirect>.
public void setConf(org.apache.hadoop.conf.Configuration conf)
setConf
in interface org.apache.hadoop.conf.Configurable
public org.apache.hadoop.conf.Configuration getConf()
getConf
in interface org.apache.hadoop.conf.Configurable
Copyright © 2014 The Apache Software Foundation