A B C D E F G H I L M N O P R S T U V W X _
All Classes All Packages

A

abort() - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ExecuteMethodThread

abortCheck() - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.AbortChecker

abortChecker - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

Abort checker

AbortChecker(IAbortActivity) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.AbortChecker

abortThread - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ExecuteMethodThread

acls - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

activities - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedContextClass

Activities interface

activities - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.OuterContextClass

Activities interface

activities - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RDFContextClass

Activities interface

activities - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSChannelContextClass

Activities interface

activities - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSContextClass

Activities interface

activities - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.UrlsetContextClass

Activities interface

activities - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.AbortChecker

ACTIVITY_FETCH - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

ACTIVITY_PROCESS - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

ACTIVITY_ROBOTSPARSE - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

add(RSSConnector.MappingRule) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.MappingRules

addAgent(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.Robots.Record

Add a user-agent.

addAllow(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.Robots.Record

Add an allow.

addData(IProcessActivity, String, String, InputStream) - Method in class org.apache.manifoldcf.crawler.connectors.rss.DataCache

Add binary data entry into the cache.

addDisallow(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.Robots.Record

Add a disallow.

addRule(RSSConnector.CanonicalizationPolicy) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.CanonicalizationPolicies

addSeedDocuments(ISeedingActivity, Specification, String, long, int) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Queue "seed" documents.

advance() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorTokenStream

Go on to next token.

allows - Variable in class org.apache.manifoldcf.crawler.connectors.rss.Robots.Record

ATTR_ASPSESSIONREMOVAL - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Aspsessionremoval attribute

ATTR_BVSESSIONREMOVAL - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Bvsessionremoval attribute

ATTR_DESCRIPTION - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Description attribute

ATTR_JAVASESSIONREMOVAL - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Javasessionremoval attribute

ATTR_MAP - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Map attribute

ATTR_MATCH - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Match attribute

ATTR_MODE - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Mode attribute

ATTR_NAME - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Name attribute

ATTR_PHPSESSIONREMOVAL - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Phpsessionremoval attribute

ATTR_REGEXP - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Regexp attribute

ATTR_REORDER - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Reorder attribute

ATTR_TOKEN - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Token attribute

ATTR_URL - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Url attribute

ATTR_VALUE - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Value attribute

authorEmailField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedAuthorContextClass

authorEmailField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedItemContextClass

authorEmailField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSItemContextClass

authorNameField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedAuthorContextClass

authorNameField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedItemContextClass

authorNameField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RDFItemContextClass

authorNameField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSItemContextClass

available() - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledInputstream

Get available.

B

badFeedRescanInterval - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

basicRead(byte[], int, int, int) - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledInputstream

Basic read, which uses the server object to throttle activity.

beginFetch(String) - Method in interface org.apache.manifoldcf.crawler.connectors.rss.IThrottledConnection

Begin the fetch process.

beginFetch(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

Begin the fetch process.

beginTag(String, String, String, Map<String, String>) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedAuthorContextClass

beginTag(String, String, String, Map<String, String>) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedContextClass

beginTag(String, String, String, Map<String, String>) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedItemContextClass

beginTag(String, String, String, Map<String, String>) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.OuterContextClass

Handle the tag beginning to set the correct second-level parsing context

beginTag(String, String, String, Map<String, String>) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RDFContextClass

beginTag(String, String, String, Map<String, String>) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RDFItemContextClass

beginTag(String, String, String, Map<String, String>) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSChannelContextClass

beginTag(String, String, String, Map<String, String>) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSContextClass

beginTag(String, String, String, Map<String, String>) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSItemContextClass

beginTag(String, String, String, Map<String, String>) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.UrlsetContextClass

beginTag(String, String, String, Map<String, String>) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.UrlsetItemContextClass

bodyStream - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ExecuteMethodThread

C

cache - Variable in class org.apache.manifoldcf.crawler.connectors.rss.Robots

This is the cache hash - which is keyed by the protocol/host/port, and has a Host object as the value.

cache - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

cacheData - Variable in class org.apache.manifoldcf.crawler.connectors.rss.DataCache

canBeFlushed(long) - Method in class org.apache.manifoldcf.crawler.connectors.rss.Robots.Host

Check if the current record can be flushed.

canonicalizationPolicies - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

CanonicalizationPolicies() - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.CanonicalizationPolicies

CanonicalizationPolicy(Pattern, boolean, boolean, boolean, boolean, boolean) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.CanonicalizationPolicy

canRemoveAspSession() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.CanonicalizationPolicy

canRemoveBvSession() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.CanonicalizationPolicy

canRemoveJavaSession() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.CanonicalizationPolicy

canRemovePhpSession() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.CanonicalizationPolicy

canReorder() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.CanonicalizationPolicy

categoryField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedItemContextClass

categoryField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSItemContextClass

check() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Check status of connection.

checkException(Throwable) - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ExecuteMethodThread

checkIfValidFeed() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.OuterContextClass

Check if feed was valid

checkingRobots - Variable in class org.apache.manifoldcf.crawler.connectors.rss.Robots.Host

This will be set to nonzero if the robots structure is currently in use

checkMatch(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.CanonicalizationPolicy

checkMatch(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.MappingRule

CHROMED_METADATA_ONLY - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Chromed suppression mode - index metadata only if dechromed content not available

CHROMED_SKIP - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Chromed suppression mode - skip documents if dechromed content not available

CHROMED_USE - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Chromed suppression mode - use chromed content if dechromed content not available

chromedContentMode - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

close() - Method in interface org.apache.manifoldcf.crawler.connectors.rss.IThrottledConnection

Close the connection.

close() - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

Close the connection.

close() - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledInputstream

Close.

compileList(List<Pattern>, List<String>) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Compile all regexp entries in the passed in list, and add them to the output list.

connect(ConfigParams) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Connect.

connectionManager - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

The client connection manager

connectionThrottler - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

The throttling object we use to track connections

connectionTimeoutMilliseconds - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

Connection timeout in milliseconds

contentsFile - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedItemContextClass

contentsFile - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RDFItemContextClass

contentsFile - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSItemContextClass

contentType - Variable in class org.apache.manifoldcf.crawler.connectors.rss.DataCache.DocumentData

The content-type header value

createConnection(IThreadContext, String, String, int, int, String, int, String, String, String, IAbortActivity) - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher

Establish a connection to a specified URL.

D

data - Variable in class org.apache.manifoldcf.crawler.connectors.rss.DataCache.DocumentData

The cache file for the data

DataCache - Class in org.apache.manifoldcf.crawler.connectors.rss

This class is a cache of a specific URL's data.

DataCache() - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.DataCache

Constructor.

DataCache.DocumentData - Class in org.apache.manifoldcf.crawler.connectors.rss

This class represents everything we need to know about a document that's getting passed from the getDocumentVersions() phase to the processDocuments() phase.

DECHROMED_CONTENT - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Dechromed content mode - content field

DECHROMED_DESCRIPTION - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Dechromed content mode - description field

DECHROMED_NONE - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Dechromed content mode - none

dechromedContentMode - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedItemContextClass

dechromedContentMode - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

dechromedContentMode - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RDFItemContextClass

dechromedContentMode - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSItemContextClass

DEFAULT_BUNDLE_NAME - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.Messages

DEFAULT_PATH_NAME - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.Messages

defaultRescanInterval - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

deleteData(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.DataCache

Delete specified item of data.

descriptionField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedItemContextClass

descriptionField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RDFItemContextClass

descriptionField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSItemContextClass

disallows - Variable in class org.apache.manifoldcf.crawler.connectors.rss.Robots.Record

disconnect() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Close the connection.

doCanonicalization(RSSConnector.CanonicalizationPolicy, WebURL) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Code to canonicalize a URL.

DocumentData(File, String) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.DataCache.DocumentData

Constructor.

documentIdentifier - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedContextClass

The document identifier

documentIdentifier - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.OuterContextClass

The document identifier

documentIdentifier - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RDFContextClass

The document identifier

documentIdentifier - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSChannelContextClass

The document identifier

documentIdentifier - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSContextClass

The document identifier

documentIdentifier - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.UrlsetContextClass

The document identifier

doesPathMatch(String, int, String, int) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.Robots

Recursive method for matching specification to path.

doesPathMatch(String, String) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.Robots

Check if path matches specification

doneFetch(IProcessActivity) - Method in interface org.apache.manifoldcf.crawler.connectors.rss.IThrottledConnection

Done with the fetch.

doneFetch(IProcessActivity) - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

Done with the fetch.

E

endTag() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedAuthorContextClass

Convert the individual sub-fields of the item context into their final forms

endTag() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedContextClass

endTag() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedItemContextClass

Convert the individual sub-fields of the item context into their final forms

endTag() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.OuterContextClass

Handle the tag ending

endTag() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RDFContextClass

endTag() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RDFItemContextClass

Convert the individual sub-fields of the item context into their final forms

endTag() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSChannelContextClass

endTag() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSContextClass

endTag() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSItemContextClass

Convert the individual sub-fields of the item context into their final forms

endTag() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.UrlsetContextClass

endTag() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.UrlsetItemContextClass

Convert the individual sub-fields of the item context into their final forms

evalExpression - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.MappingRule

EvaluatorToken() - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorToken

EvaluatorToken(int, int) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorToken

EvaluatorToken(String) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorToken

EvaluatorTokenStream(String) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorTokenStream

Constructor.

excludePatterns - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

The arraylist of exclude patterns

executeFetch(String, int, String, String, String, String, String) - Method in interface org.apache.manifoldcf.crawler.connectors.rss.IThrottledConnection

Execute the fetch and get the return code.

executeFetch(String, int, String, String, String, String, String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

Execute the fetch and get the return code.

executeMethod - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ExecuteMethodThread

executeMethod - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

The method object

ExecuteMethodThread(ThrottledFetcher.ThrottledConnection, IFetchThrottler, HttpClient, HttpRequestBase) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ExecuteMethodThread

F

FeedAuthorContextClass(XMLFuzzyHierarchicalParseState, String, String, String, Map<String, String>) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedAuthorContextClass

FeedContextClass(XMLFuzzyHierarchicalParseState, String, String, String, Map<String, String>, String, IProcessActivity, RSSConnector.Filter) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedContextClass

FeedItemContextClass(XMLFuzzyHierarchicalParseState, String, String, String, Map<String, String>, int) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedItemContextClass

feedTimeoutValue - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

FETCH_BAD_URI - Static variable in interface org.apache.manifoldcf.crawler.connectors.rss.IThrottledConnection

FETCH_CIRCULAR_REDIRECT - Static variable in interface org.apache.manifoldcf.crawler.connectors.rss.IThrottledConnection

FETCH_IO_ERROR - Static variable in interface org.apache.manifoldcf.crawler.connectors.rss.IThrottledConnection

FETCH_NOT_TRIED - Static variable in interface org.apache.manifoldcf.crawler.connectors.rss.IThrottledConnection

FETCH_SEQUENCE_ERROR - Static variable in interface org.apache.manifoldcf.crawler.connectors.rss.IThrottledConnection

FETCH_UNKNOWN_ERROR - Static variable in interface org.apache.manifoldcf.crawler.connectors.rss.IThrottledConnection

fetchCounter - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

The current bytes in the current fetch

fetcher - Variable in class org.apache.manifoldcf.crawler.connectors.rss.Robots

Fetcher to use to get the data from wherever

fetcher - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

The throttled fetcher used by this instance

fetcherMap - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Storage for fetcher objects

fetchThrottler - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ExecuteMethodThread

The fetch throttler

fetchThrottler - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

The throttling object we use to track fetches

fetchType - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

The kind of fetch we are doing

filter - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedContextClass

Filter

filter - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.OuterContextClass

Filter

filter - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RDFContextClass

Filter

filter - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSChannelContextClass

Filter

filter - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSContextClass

Filter

filter - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.UrlsetContextClass

Filter

Filter(Specification, boolean) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

Constructor.

findMatch(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.CanonicalizationPolicies

finishUp() - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ExecuteMethodThread

from - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

The email address for this connector instance

G

generalException - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ExecuteMethodThread

getAcls() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

Get the acls

getActivitiesList() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Return the list of activities that this connector supports (i.e.

getAttributeJavascriptString(String, Locale, String, Object[]) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.Messages

getAttributeJavascriptString(Locale, String) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.Messages

getAttributeJavascriptString(Locale, String, Object[]) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.Messages

getAttributeString(String, Locale, String, Object[]) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.Messages

getAttributeString(Locale, String) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.Messages

getAttributeString(Locale, String, Object[]) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.Messages

getAuthorEmail() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedAuthorContextClass

getAuthorName() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedAuthorContextClass

getBadFeedRescanTime(long) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

Get the next time a "bad feed" should be rescanned

getBinNames(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Get the bin name string for a document identifier.

getBodyJavascriptString(String, Locale, String, Object[]) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.Messages

getBodyJavascriptString(Locale, String) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.Messages

getBodyJavascriptString(Locale, String, Object[]) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.Messages

getBodyString(String, Locale, String, Object[]) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.Messages

getBodyString(Locale, String) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.Messages

getBodyString(Locale, String, Object[]) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.Messages

getCanonicalizationPolicies() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

Get canonicalization policies

getChromedContentMode() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

Get the chromed content mode

getConnectorModel() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Tell the world what model this connector uses for getDocumentIdentifiers().

getContentType() - Method in class org.apache.manifoldcf.crawler.connectors.rss.DataCache.DocumentData

Get the contentType

getContentType(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.DataCache

Get the content type.

getData() - Method in class org.apache.manifoldcf.crawler.connectors.rss.DataCache.DocumentData

Get the data

getData(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.DataCache

Fetch binary data entry from the cache.

getDataLength(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.DataCache

Fetch binary data length.

getDechromedContentMode() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

Get the dechromed content mode

getDefaultRescanTime(long) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

Get the next time (by default) a feed should be scanned

getFeedTimeoutValue() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

Get the feed timeout value

getFetcher() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Given the current parameters, find the correct throttled fetcher object (or create one if not there).

getFirstHeader(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ExecuteMethodThread

getGroupNumber() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorToken

getGroupStyle() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorToken

getHost() - Method in class org.apache.manifoldcf.crawler.connectors.rss.WebURL

getMaxDocumentRequest() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Get the maximum number of documents to amalgamate together into one batch, for this connector.

getMaxOpenConnections(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.ThrottleSpec

Given a bin name, find the max open connections to use for that bin.

getMinimumMillisecondsPerByte(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.ThrottleSpec

Look up minimum milliseconds per byte for a bin.

getMinimumMillisecondsPerFetch(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.ThrottleSpec

Look up minimum milliseconds for a fetch for a bin.

getMinimumRescanTime(long) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

Get the minimum next time a feed should be scanned

getName() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.NameValue

getPath() - Method in class org.apache.manifoldcf.crawler.connectors.rss.WebURL

getPort() - Method in class org.apache.manifoldcf.crawler.connectors.rss.WebURL

getRawQuery() - Method in class org.apache.manifoldcf.crawler.connectors.rss.WebURL

getResponseBodyStream() - Method in interface org.apache.manifoldcf.crawler.connectors.rss.IThrottledConnection

Get the response input stream.

getResponseBodyStream() - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

Get the response input stream.

getResponseCode() - Method in interface org.apache.manifoldcf.crawler.connectors.rss.IThrottledConnection

Get the http response code.

getResponseCode() - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ExecuteMethodThread

getResponseCode() - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

Get the http response code.

getResponseHeader(String) - Method in interface org.apache.manifoldcf.crawler.connectors.rss.IThrottledConnection

Get a specified response header, if it exists.

getResponseHeader(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

Get a specified response header, if it exists.

getRobots(ThrottledFetcher) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Given the current parameters, find the correct robots object (or create one if none found).

getSafeInputStream() - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ExecuteMethodThread

getScheme() - Method in class org.apache.manifoldcf.crawler.connectors.rss.WebURL

GetSeedList - Class in org.apache.manifoldcf.crawler.connectors.rss

This class is used to set the seed list for a specified RSS job.

getSeeds() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

Iterate over all canonicalized seeds

getSession() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Establish a session

getString(String, Locale, String, Object[]) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.Messages

getString(Locale, String) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.Messages

getString(Locale, String, Object[]) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.Messages

getTextValue() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorToken

getType() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorToken

getValue() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.NameValue

globalHandleCount - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher

This counter keeps track of the total outstanding handles across everything, because we do try to control that

globalHandleCounterLock - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher

This is the lock object for that global handle counter

groupNumber - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorToken

groupStyle - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorToken

GROUPSTYLE_LOWER - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorToken

GROUPSTYLE_MIXED - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorToken

GROUPSTYLE_NONE - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorToken

GROUPSTYLE_UPPER - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorToken

guidField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSItemContextClass

H

handleIOException(IOException, String) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

handleRSSFeedSAX(String, IProcessActivity, RSSConnector.Filter) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Handle an RSS feed document, using SAX to limit the memory impact

Host(String, int, String) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.Robots.Host

Constructor.

hostName - Variable in class org.apache.manifoldcf.crawler.connectors.rss.Robots.Host

Host name

httpClient - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ExecuteMethodThread

Client and method, all preconfigured

httpClient - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

The httpclient

I

inputStream - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledInputstream

The stream we are wrapping.

invalidTime - Variable in class org.apache.manifoldcf.crawler.connectors.rss.Robots.Host

Timestamp.

isAgentMatch(String, boolean) - Method in class org.apache.manifoldcf.crawler.connectors.rss.Robots.Record

See if user-agent matches.

isAllowed(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.Robots.Record

See if path is allowed.

isDisallowed(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.Robots.Record

See if path is disallowed.

isFetchAllowed(IThreadContext, String, long, String, String, String, String, int, String, String, String, IProcessActivity, int) - Method in class org.apache.manifoldcf.crawler.connectors.rss.Robots.Host

Check a given path string against this host's robots file.

isFetchAllowed(IThreadContext, String, String, int, String, String, String, String, String, int, String, String, String, IProcessActivity, int) - Method in class org.apache.manifoldcf.crawler.connectors.rss.Robots

Decide whether a specific robot can crawl a specific URL.

isInitialized - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Flag indicating whether session data is initialized

isLegalURL(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

Check for legality of a url.

isMatch(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.MappingRules

isSeed(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

Check if document is a seed

isValid - Variable in class org.apache.manifoldcf.crawler.connectors.rss.Robots.Host

This flag describes whether or not the host record is valid yet.

IThrottledConnection - Interface in org.apache.manifoldcf.crawler.connectors.rss

This interface represents an established connection to a URL.

L

linkField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedItemContextClass

linkField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RDFItemContextClass

linkField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSItemContextClass

linkField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.UrlsetItemContextClass

logFetchCount(int) - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

Log the fetch of a number of bytes.

M

main(String[]) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.GetSeedList

main(String[]) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.SetSeedList

makeDocumentIdentifier(RSSConnector.CanonicalizationPolicies, String, String) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Convert an absolute or relative URL to a document identifier.

makeReadable(String) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.Robots

Convert a string from the robots file into a readable form that does NOT contain NUL characters (since postgresql does not accept those).

makeValid(IThreadContext, String, long, String, String, String, int, String, String, String, String, IProcessActivity, int) - Method in class org.apache.manifoldcf.crawler.connectors.rss.Robots.Host

Initialize the record.

map(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.MappingRule

map(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.MappingRules

mapDocumentURL(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

Scan patterns and return the one that matches first.

MappingRule(Pattern, String) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.MappingRule

MappingRules() - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.MappingRules

mappings - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

mappings - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.MappingRules

mark(int) - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledInputstream

Mark.

markSupported() - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledInputstream

Check if mark is supported.

matchPattern - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.CanonicalizationPolicy

matchPattern - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.MappingRule

maxOpenConnectionsPerServer - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

The maximum open connections

maxOpenConnectionsPerServer - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.ThrottleSpec

mcfException - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.AbortChecker

Messages - Class in org.apache.manifoldcf.crawler.connectors.rss

Messages() - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.Messages

Constructor - do no instantiate

methodThread - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

The thread that is actually doing the work

minimumMillisecondsPerBytePerServer - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

The minimum milliseconds between bytes

minimumMillisecondsPerBytePerServer - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.ThrottleSpec

minimumMillisecondsPerFetchPerServer - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

The minimum milliseconds between fetches

minimumMillisecondsPerFetchPerServer - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.ThrottleSpec

minimumRescanInterval - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

myUrl - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

The current URL being fetched

N

name - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.NameValue

NameValue(String, String) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.NameValue

nextToken() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorTokenStream

NODE_ACCESS - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Access node (forced ACLs).

NODE_BADFEEDRESCAN - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Bad feed rescan time.

NODE_CHROMEDMODE - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Chromed mode.

NODE_DECHROMEDMODE - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Dechromed mode.

NODE_EXCLUDES - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Exclude regexps node.

NODE_FEED - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Feed specification node.

NODE_FEEDRESCAN - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Feed rescan time.

NODE_FEEDTIMEOUT - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Feed timeout.

NODE_MAP - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Map entry specification node.

NODE_MINFEEDRESCAN - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Min feed rescan time.

NODE_URLSPEC - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Url normalization specification; attrs are 'regexp', 'description', 'reorder', 'javasessionremoval', 'aspsessionremoval', 'bvsessionremoval', 'phpsessionremoval'

noteConnectionEstablished() - Method in class org.apache.manifoldcf.crawler.connectors.rss.Robots

Note that a connection has been established.

noteConnectionEstablished() - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher

Note that there is a repository connection that is using this object.

noteConnectionReleased() - Method in class org.apache.manifoldcf.crawler.connectors.rss.Robots

Note that a connection has been released, and free resources if no reason to retain them.

noteConnectionReleased() - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher

Connection pool no longer needed.

O

org.apache.manifoldcf.crawler.connectors.rss - package org.apache.manifoldcf.crawler.connectors.rss

OuterContextClass(XMLFuzzyHierarchicalParseState, String, IProcessActivity, RSSConnector.Filter) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.OuterContextClass

outerTagCount - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.OuterContextClass

Keep track of the number of valid feed signals we saw

outputConfigurationBody(IThreadContext, IHTTPOutput, Locale, ConfigParams, String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Output the configuration body section.

outputConfigurationHeader(IThreadContext, IHTTPOutput, Locale, ConfigParams, List<String>) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Output the configuration header section.

outputResource(IHTTPOutput, Locale, String, Map<String, String>, boolean) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.Messages

outputResourceWithVelocity(IHTTPOutput, Locale, String, Map<String, Object>) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.Messages

outputResourceWithVelocity(IHTTPOutput, Locale, String, Map<String, String>, boolean) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.Messages

outputSpecificationBody(IHTTPOutput, Locale, Specification, int, int, String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Output the specification body section.

outputSpecificationHeader(IHTTPOutput, Locale, Specification, int, List<String>) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Output the specification header section.

P

PARAMETER_BANDWIDTH - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Max kilobytes per second per server

PARAMETER_EMAIL - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Email parameter

PARAMETER_MAXFETCHES - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Max fetches per minute per server

PARAMETER_MAXOPEN - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Max simultaneous open connections per server

PARAMETER_PROXYAUTHDOMAIN - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Proxy auth domain

PARAMETER_PROXYAUTHPASSWORD - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Proxy auth password

PARAMETER_PROXYAUTHUSERNAME - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Proxy auth username

PARAMETER_PROXYHOST - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Proxy host name

PARAMETER_PROXYPORT - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Proxy port

PARAMETER_ROBOTSUSAGE - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Robots usage parameter

PARAMETER_THROTTLEGROUP - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

The throttle group name

parseRobotsTxt(BufferedReader, String, IProcessActivity) - Method in class org.apache.manifoldcf.crawler.connectors.rss.Robots.Host

Parse the robots.txt file using a reader.

peek() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorTokenStream

Get current token.

poll() - Method in class org.apache.manifoldcf.crawler.connectors.rss.Robots

Clean idle stuff out of cache

poll() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

This method is periodically called for all connectors that are connected but not in active use.

poll() - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher

Poll.

port - Variable in class org.apache.manifoldcf.crawler.connectors.rss.Robots.Host

Port

pos - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorTokenStream

process() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedContextClass

Process this data

process() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RDFContextClass

Process this data

process() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSChannelContextClass

Process this data, return true if rescan time was set

process() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSContextClass

Process this data

process() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.UrlsetContextClass

Process this data

process(String, IProcessActivity, RSSConnector.Filter) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedItemContextClass

Process the data accumulated for this item

process(String, IProcessActivity, RSSConnector.Filter) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RDFItemContextClass

Process the data accumulated for this item

process(String, IProcessActivity, RSSConnector.Filter) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSItemContextClass

Process the data accumulated for this item

process(String, IProcessActivity, RSSConnector.Filter) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.UrlsetItemContextClass

Process the data accumulated for this item

processConfigurationPost(IThreadContext, IPostParameters, Locale, ConfigParams) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Process a configuration post.

processDocuments(String[], IExistingVersions, Specification, IProcessActivity, int, boolean) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Process a set of documents.

processSpecificationPost(IPostParameters, Locale, Specification, int) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Process a specification post.

protocol - Variable in class org.apache.manifoldcf.crawler.connectors.rss.Robots.Host

Protocol

proxyAuthDomain - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Proxy auth domain

proxyAuthPassword - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Proxy auth password

proxyAuthUsername - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Proxy auth username

proxyHost - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

The proxy host

proxyPort - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

The proxy port

pubDateField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedItemContextClass

pubDateField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RDFItemContextClass

pubDateField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSItemContextClass

pubDateField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.UrlsetItemContextClass

R

rawQueryPart - Variable in class org.apache.manifoldcf.crawler.connectors.rss.WebURL

RDFContextClass(XMLFuzzyHierarchicalParseState, String, String, String, Map<String, String>, String, IProcessActivity, RSSConnector.Filter) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RDFContextClass

RDFItemContextClass(XMLFuzzyHierarchicalParseState, String, String, String, Map<String, String>, int) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RDFItemContextClass

read() - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledInputstream

Read a byte.

read(byte[]) - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledInputstream

Read lots of bytes.

read(byte[], int, int) - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledInputstream

Read lots of specific bytes.

READ_CHUNK_LENGTH - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher

The read chunk length

readingRobots - Variable in class org.apache.manifoldcf.crawler.connectors.rss.Robots.Host

This will be set to "true" if the robots.txt for this host is in the process of being read.

Record() - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.Robots.Record

Constructor.

recordEverything - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher

This flag determines whether we record everything to the disk, as a means of doing a web snapshot

records - Variable in class org.apache.manifoldcf.crawler.connectors.rss.Robots.Host

This is the list of robots records for the host, or null if no robots.txt found.

refCount - Variable in class org.apache.manifoldcf.crawler.connectors.rss.Robots

Reference count

refCount - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher

Reference count for how many connections to this pool there are

registerGlobalHandle(int) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher

Note that we're about to need a handle (and make sure we have enough)

releaseGlobalHandle() - Static method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher

Note that we're done with a handle (so we can free it)

removeAspSession - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.CanonicalizationPolicy

removeBVSession - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.CanonicalizationPolicy

removeJavaSession - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.CanonicalizationPolicy

removePhpSession - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.CanonicalizationPolicy

reorder - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.CanonicalizationPolicy

rescanTimeSet - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.OuterContextClass

Flag indicating the the rescan time was set for this feed

rescanTimeSet - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSContextClass

Rescan time set flag

reset() - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledInputstream

Reset.

resolve(String) - Method in class org.apache.manifoldcf.crawler.connectors.rss.WebURL

response - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ExecuteMethodThread

responseException - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ExecuteMethodThread

rethrowExceptions() - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.AbortChecker

ROBOT_CONNECTION_TYPE - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.Robots

Robots connection type value

ROBOT_FILE_NAME - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.Robots

Robot file name value

ROBOT_TIMEOUT_MILLISECONDS - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.Robots

Robots fetch timeout value

robots - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

The robots object used by this instance

Robots - Class in org.apache.manifoldcf.crawler.connectors.rss

This class is a cache of a specific robots data.

Robots(ThrottledFetcher) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.Robots

Constructor.

ROBOTS_ALL - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

ROBOTS_DATA - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

ROBOTS_NONE - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Robots.Host - Class in org.apache.manifoldcf.crawler.connectors.rss

This class maintains status for a given host.

Robots.Record - Class in org.apache.manifoldcf.crawler.connectors.rss

This class represents a record in a robots.txt file.

robotsMap - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Storage for robots objects

robotsUsage - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Robots usage flag

RSSChannelContextClass(XMLFuzzyHierarchicalParseState, String, String, String, Map<String, String>, String, IProcessActivity, RSSConnector.Filter) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSChannelContextClass

RSSConfig - Class in org.apache.manifoldcf.crawler.connectors.rss

Constants for the RSS connector configuration.

RSSConfig() - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

RSSConnector - Class in org.apache.manifoldcf.crawler.connectors.rss

This is the RSS implementation of the IRepositoryConnector interface.

RSSConnector() - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Constructor.

RSSConnector.CanonicalizationPolicies - Class in org.apache.manifoldcf.crawler.connectors.rss

Class representing a list of canonicalization rules

RSSConnector.CanonicalizationPolicy - Class in org.apache.manifoldcf.crawler.connectors.rss

Class representing a URL regular expression match, for the purposes of determining canonicalization policy

RSSConnector.EvaluatorToken - Class in org.apache.manifoldcf.crawler.connectors.rss

Evaluator token.

RSSConnector.EvaluatorTokenStream - Class in org.apache.manifoldcf.crawler.connectors.rss

Token stream.

RSSConnector.FeedAuthorContextClass - Class in org.apache.manifoldcf.crawler.connectors.rss

RSSConnector.FeedContextClass - Class in org.apache.manifoldcf.crawler.connectors.rss

RSSConnector.FeedItemContextClass - Class in org.apache.manifoldcf.crawler.connectors.rss

RSSConnector.Filter - Class in org.apache.manifoldcf.crawler.connectors.rss

Class that handles parsing and interpretation of the document specification.

RSSConnector.MappingRule - Class in org.apache.manifoldcf.crawler.connectors.rss

Class representing a mapping rule

RSSConnector.MappingRules - Class in org.apache.manifoldcf.crawler.connectors.rss

Class that represents all mappings

RSSConnector.NameValue - Class in org.apache.manifoldcf.crawler.connectors.rss

Name/value class

RSSConnector.OuterContextClass - Class in org.apache.manifoldcf.crawler.connectors.rss

This class handles the outermost XML context for the feed document.

RSSConnector.RDFContextClass - Class in org.apache.manifoldcf.crawler.connectors.rss

RSSConnector.RDFItemContextClass - Class in org.apache.manifoldcf.crawler.connectors.rss

RSSConnector.RSSChannelContextClass - Class in org.apache.manifoldcf.crawler.connectors.rss

RSSConnector.RSSContextClass - Class in org.apache.manifoldcf.crawler.connectors.rss

RSSConnector.RSSItemContextClass - Class in org.apache.manifoldcf.crawler.connectors.rss

RSSConnector.ThrottleSpec - Class in org.apache.manifoldcf.crawler.connectors.rss

The throttle specification class.

RSSConnector.UrlsetContextClass - Class in org.apache.manifoldcf.crawler.connectors.rss

RSSConnector.UrlsetItemContextClass - Class in org.apache.manifoldcf.crawler.connectors.rss

RSSContextClass(XMLFuzzyHierarchicalParseState, String, String, String, Map<String, String>, String, IProcessActivity, RSSConnector.Filter) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSContextClass

RSSItemContextClass(XMLFuzzyHierarchicalParseState, String, String, String, Map<String, String>, int) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSItemContextClass

rssThrottleGroupType - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

rules - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.CanonicalizationPolicies

run() - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ExecuteMethodThread

S

seeds - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.Filter

serverMap - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher

This hash maps the server string (without port) to a pool throttling object, where we can track the statistics and make sure we throttle appropriately

serverName - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

The server fqdn

serviceInterruption - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.AbortChecker

setDefaultRescanTimeIfNeeded() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.OuterContextClass

Check if the rescan flag was set or not, and if not, make sure it gets set properly

SetSeedList - Class in org.apache.manifoldcf.crawler.connectors.rss

This class is used to set the seed list for a specified RSS job.

shutdownException - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ExecuteMethodThread

skip(long) - Method in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledInputstream

Skip

startFetchTime - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

The start-fetch time

STATUS_NOCHANGE - Static variable in interface org.apache.manifoldcf.crawler.connectors.rss.IThrottledConnection

Status code for fetch: No change.

STATUS_OK - Static variable in interface org.apache.manifoldcf.crawler.connectors.rss.IThrottledConnection

Status code for fetch: OK

STATUS_PAGEERROR - Static variable in interface org.apache.manifoldcf.crawler.connectors.rss.IThrottledConnection

Status code for fetch: Static error; retries won't help, individual page access failed

STATUS_SITEERROR - Static variable in interface org.apache.manifoldcf.crawler.connectors.rss.IThrottledConnection

Status code for fetch: Static error; retries won't help, overall access to site in question

statusCode - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

The status code fetched, if any

streamCreated - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ExecuteMethodThread

streamException - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ExecuteMethodThread

streamThrottler - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledInputstream

Stream throttler

stringToArray(String) - Static method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

Read a string as a sequence of individual expressions, urls, etc.

T

tagCleanup() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedItemContextClass

tagCleanup() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RDFItemContextClass

tagCleanup() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSItemContextClass

tagCleanup() - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.UrlsetItemContextClass

text - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorTokenStream

textValue - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorToken

theConnection - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ExecuteMethodThread

The connection

theURL - Variable in class org.apache.manifoldcf.crawler.connectors.rss.WebURL

threadStarted - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

Set if thread has been started

threadStream - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ExecuteMethodThread

throttledConnection - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledInputstream

Throttled connection

ThrottledConnection(String, IConnectionThrottler, int, int, String, int, String, String, String, IAbortActivity) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

Constructor.

ThrottledFetcher - Class in org.apache.manifoldcf.crawler.connectors.rss

This class uses httpclient to fetch stuff from webservers.

ThrottledFetcher() - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher

Constructor.

ThrottledFetcher.AbortChecker - Class in org.apache.manifoldcf.crawler.connectors.rss

This class furnishes an abort signal whenever the job activity says it should.

ThrottledFetcher.ExecuteMethodThread - Class in org.apache.manifoldcf.crawler.connectors.rss

This thread does the actual socket communication with the server.

ThrottledFetcher.ThrottledConnection - Class in org.apache.manifoldcf.crawler.connectors.rss

This class represents an established connection to a URL.

ThrottledFetcher.ThrottledInputstream - Class in org.apache.manifoldcf.crawler.connectors.rss

This class throttles an input stream based on the specified byte rate parameters.

ThrottledInputstream(ThrottledFetcher.ThrottledConnection, IStreamThrottler, InputStream) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledInputstream

Constructor.

throttleGroupName - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

The throttle group name

ThrottleSpec(int, long, double) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.ThrottleSpec

throwable - Variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher.ThrottledConnection

The error trace, if any

titleField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedItemContextClass

titleField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RDFItemContextClass

titleField - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSItemContextClass

toASCIIString() - Method in class org.apache.manifoldcf.crawler.connectors.rss.WebURL

token - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorTokenStream

toString() - Method in class org.apache.manifoldcf.crawler.connectors.rss.WebURL

ttlValue - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.FeedContextClass

ttl value

ttlValue - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RDFContextClass

ttl value

ttlValue - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.RSSChannelContextClass

TTL value is set on a per-channel basis

ttlValue - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.UrlsetContextClass

ttl value

type - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorToken

TYPE_COMMA - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorToken

TYPE_GROUP - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorToken

TYPE_TEXT - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.EvaluatorToken

U

understoodProtocols - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

UrlsetContextClass(XMLFuzzyHierarchicalParseState, String, String, String, Map<String, String>, String, IProcessActivity, RSSConnector.Filter) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.UrlsetContextClass

UrlsetItemContextClass(XMLFuzzyHierarchicalParseState, String, String, String, Map<String, String>) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.UrlsetItemContextClass

userAgent - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

The user-agent for this connector instance

userAgents - Variable in class org.apache.manifoldcf.crawler.connectors.rss.Robots.Record

V

value - Variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.NameValue

VALUE_ALL - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

All

VALUE_CONTENT - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Content

VALUE_DATA - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Data

VALUE_DESCRIPTION - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Description

VALUE_METADATA - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Metadata

VALUE_NO - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

No

VALUE_NONE - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

None

VALUE_SKIP - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Skip

VALUE_USE - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Use

VALUE_YES - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

Yes

viewConfiguration(IThreadContext, IHTTPOutput, Locale, ConfigParams) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

View configuration.

viewSpecification(IHTTPOutput, Locale, Specification, int) - Method in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

View specification.

W

WebURL - Class in org.apache.manifoldcf.crawler.connectors.rss

Replacement class for java.net.URI, which is broken in many ways.

WebURL(String) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.WebURL

WebURL(String, String, int, String, String) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.WebURL

WebURL(URI) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.WebURL

WebURL(URI, String) - Constructor for class org.apache.manifoldcf.crawler.connectors.rss.WebURL

X

xmlContentTypes - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

_

_rcsid - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.DataCache

_rcsid - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.GetSeedList

_rcsid - Static variable in interface org.apache.manifoldcf.crawler.connectors.rss.IThrottledConnection

_rcsid - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.Robots

_rcsid - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConfig

_rcsid - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.RSSConnector

_rcsid - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.SetSeedList

_rcsid - Static variable in class org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher

A B C D E F G H I L M N O P R S T U V W X _
All Classes All Packages