org.apache.nutch.net.urlnormalizer.basic

Class BasicURLNormalizer

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.nutch.net.urlnormalizer.basic.BasicURLNormalizer

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, URLNormalizer

public class BasicURLNormalizer
extends org.apache.hadoop.conf.Configured
implements URLNormalizer

Converts URLs to a normal form .

Field Summary

Fields

Modifier and Type	Field and Description
static org.slf4j.Logger	LOG

Fields inherited from interface org.apache.nutch.net.URLNormalizer

X_POINT_ID

Constructor Summary

Constructors

Constructor and Description
BasicURLNormalizer()

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.conf.Configuration	getConf()
String	normalize(String urlString, String scope)
void	setConf(org.apache.hadoop.conf.Configuration conf)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

public static final org.slf4j.Logger LOG

Constructor Detail

BasicURLNormalizer

public BasicURLNormalizer()

Method Detail

normalize

public String normalize(String urlString,
               String scope)
                 throws MalformedURLException

Specified by:

normalize in interface URLNormalizer

Throws:

MalformedURLException

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

Overrides:

setConf in class org.apache.hadoop.conf.Configured

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

Overrides:

getConf in class org.apache.hadoop.conf.Configured