C E I L N O P R S

C

ContentLoader - Interface in org.apache.droids.norobots

An abstract loader intended for retrieving content identified by a URI.

E

exists(URI) - Method in interface org.apache.droids.norobots.ContentLoader

exists(URI) - Method in class org.apache.droids.norobots.SimpleContentLoader

I

isAllowed(String) - Method in interface org.apache.droids.norobots.Rule

Boolean.TRUE means it is allowed.

isUrlAllowed(URI) - Method in class org.apache.droids.norobots.NoRobotClient

Decide if the parsed website will allow this URL to be be seen.

L

load(URI) - Method in interface org.apache.droids.norobots.ContentLoader

load(URI) - Method in class org.apache.droids.norobots.SimpleContentLoader

N

NoRobotClient - Class in org.apache.droids.norobots

A Client which may be used to decide which urls on a website may be looked at, according to the norobots specification located at: http://www.robotstxt.org/wc/norobots-rfc.html

NoRobotClient(ContentLoader, String) - Constructor for class org.apache.droids.norobots.NoRobotClient

Create a Client for a particular user-agent name and the given ContentLoader.

NoRobotClient(String) - Constructor for class org.apache.droids.norobots.NoRobotClient

Create a Client for a particular user-agent name.

NoRobotException - Exception in org.apache.droids.norobots

Application exception for anything that might go wrong in the checking of a robots.txt file.

NoRobotException(String) - Constructor for exception org.apache.droids.norobots.NoRobotException

NoRobotException(String, Throwable) - Constructor for exception org.apache.droids.norobots.NoRobotException

O

org.apache.droids.norobots - package org.apache.droids.norobots

Using norobots-rfc

P

parse(URI) - Method in class org.apache.droids.norobots.NoRobotClient

Head to a website and suck in their robots.txt file.

parse(InputStream) - Static method in class org.apache.droids.norobots.NoRobotClient

parseText(InputStream) - Method in class org.apache.droids.norobots.NoRobotClient

R

Rule - Interface in org.apache.droids.norobots

A robots.txt rule.

S

SimpleContentLoader - Class in org.apache.droids.norobots

A simple implementation of ContentLoader based on URLConnection.

SimpleContentLoader() - Constructor for class org.apache.droids.norobots.SimpleContentLoader

C E I L N O P R S