Package
Class
Use
Tree
Deprecated
Index
Help
PREV NEXT
FRAMES
NO FRAMES
All Classes
C
E
I
L
N
O
P
R
S
C
ContentLoader
- Interface in
org.apache.droids.norobots
An abstract loader intended for retrieving content identified by a URI.
E
exists(URI)
- Method in interface org.apache.droids.norobots.
ContentLoader
exists(URI)
- Method in class org.apache.droids.norobots.
SimpleContentLoader
I
isAllowed(String)
- Method in interface org.apache.droids.norobots.
Rule
Boolean.TRUE means it is allowed.
isUrlAllowed(URI)
- Method in class org.apache.droids.norobots.
NoRobotClient
Decide if the parsed website will allow this URL to be be seen.
L
load(URI)
- Method in interface org.apache.droids.norobots.
ContentLoader
load(URI)
- Method in class org.apache.droids.norobots.
SimpleContentLoader
N
NoRobotClient
- Class in
org.apache.droids.norobots
A Client which may be used to decide which urls on a website may be looked at, according to the norobots specification located at: http://www.robotstxt.org/wc/norobots-rfc.html
NoRobotClient(ContentLoader, String)
- Constructor for class org.apache.droids.norobots.
NoRobotClient
Create a Client for a particular user-agent name and the given
ContentLoader
.
NoRobotClient(String)
- Constructor for class org.apache.droids.norobots.
NoRobotClient
Create a Client for a particular user-agent name.
NoRobotException
- Exception in
org.apache.droids.norobots
Application exception for anything that might go wrong in the checking of a robots.txt file.
NoRobotException(String)
- Constructor for exception org.apache.droids.norobots.
NoRobotException
NoRobotException(String, Throwable)
- Constructor for exception org.apache.droids.norobots.
NoRobotException
O
org.apache.droids.norobots
- package org.apache.droids.norobots
Using norobots-rfc
P
parse(URI)
- Method in class org.apache.droids.norobots.
NoRobotClient
Head to a website and suck in their robots.txt file.
parse(InputStream)
- Static method in class org.apache.droids.norobots.
NoRobotClient
parseText(InputStream)
- Method in class org.apache.droids.norobots.
NoRobotClient
R
Rule
- Interface in
org.apache.droids.norobots
A robots.txt rule.
S
SimpleContentLoader
- Class in
org.apache.droids.norobots
A simple implementation of
ContentLoader
based on
URLConnection
.
SimpleContentLoader()
- Constructor for class org.apache.droids.norobots.
SimpleContentLoader
C
E
I
L
N
O
P
R
S
Package
Class
Use
Tree
Deprecated
Index
Help
PREV NEXT
FRAMES
NO FRAMES
All Classes
Copyright © 2007-2009. All Rights Reserved.