A C E G H I L M N O P R S T U

A

acceptedUploads - Variable in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo

addResource(String, String) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore

Adds the given resource to the store under the key and the filename.

addResource(String, String) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore

Add a resource to the shared cache and it's associated filename.

addResourceReference(String, SharedCacheResourceReference) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore

Adds the provided resource reference to the cache resource under the key, and updates the access time.

addResourceReference(String, SharedCacheResourceReference) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore

Add a SharedCacheResourceReference to a resource and update the resource access time.

AppChecker - Class in org.apache.hadoop.yarn.server.sharedcachemanager

An interface for checking whether an app is running so that the cleaner service may determine if it can safely remove a cached entry.

AppChecker() - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.AppChecker

AppChecker(String) - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.AppChecker

appChecker - Variable in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore

C

cacheHits - Variable in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo

cacheMisses - Variable in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo

cacheReleases - Variable in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo

canUpload(SCMUploaderCanUploadRequest) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheUploaderService

CleanerMetrics - Class in org.apache.hadoop.yarn.server.sharedcachemanager.metrics

This class is for maintaining the various Cleaner activity statistics and publishing them through the metrics interfaces.

CleanerService - Class in org.apache.hadoop.yarn.server.sharedcachemanager

The cleaner service that maintains the shared cache area, and cleans up stale entries on a regular basis.

CleanerService(SCMStore) - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.CleanerService

cleanResourceReferences(String) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore

Provides atomicity for the method.

cleanResourceReferences(String) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore

Clean all resource references to a cache resource that contain application ids pointing to finished applications.

ClientProtocolService - Class in org.apache.hadoop.yarn.server.sharedcachemanager

This service handles all rpc calls from the client to the shared cache manager.

ClientProtocolService(SCMStore) - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.ClientProtocolService

ClientSCMMetrics - Class in org.apache.hadoop.yarn.server.sharedcachemanager.metrics

This class is for maintaining client requests metrics and publishing them through the metrics interfaces.

content() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMOverviewPage

createAppCheckerService(Configuration) - Static method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore

Create an instance of the AppChecker service via reflection based on the YarnConfiguration.SCM_APP_CHECKER_CLASS parameter.

E

equals(Object) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SharedCacheResourceReference

G

getAcceptedUploads() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.SharedCacheUploaderMetrics

getAcceptedUploads() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo

getActiveApplications() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.AppChecker

Returns the list of all active apps at the given time.

getActiveApplications() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.RemoteAppChecker

getAppId() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SharedCacheResourceReference

getCacheHits() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.ClientSCMMetrics

getCacheHits() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo

getCacheMisses() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.ClientSCMMetrics

getCacheMisses() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo

getCacheReleases() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.ClientSCMMetrics

getCacheReleases() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo

getDeletedFiles() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics

getFileErrors() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics

getInstance() - Static method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics

getInstance() - Static method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.ClientSCMMetrics

getInstance() - Static method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.SharedCacheUploaderMetrics

getProcessedFiles() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics

getRejectUploads() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.SharedCacheUploaderMetrics

getRejectUploads() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo

getResourceReferences(String) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore

Returns the list of resource references currently registered under the cache entry.

getResourceReferences(String) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore

Get the SharedCacheResourceReference(s) associated with the resource.

getShortUserName() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SharedCacheResourceReference

getTotalDeletedFiles() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics

getTotalDeletedFiles() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo

getTotalFileErrors() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics

getTotalProcessedFiles() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics

getTotalProcessedFiles() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo

GLOBAL_CLEANER_PID - Static variable in class org.apache.hadoop.yarn.server.sharedcachemanager.CleanerService

The name of the global cleaner lock that the cleaner creates to indicate that a cleaning process is in progress.

H

hashCode() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SharedCacheResourceReference

I

incAcceptedUploads() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.SharedCacheUploaderMetrics

One accepted upload event

incCacheHitCount() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.ClientSCMMetrics

One cache hit event

incCacheMissCount() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.ClientSCMMetrics

One cache miss event

incCacheRelease() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.ClientSCMMetrics

One cache release event

incRejectedUploads() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.SharedCacheUploaderMetrics

One rejected upload event

index() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMController

InMemorySCMStore - Class in org.apache.hadoop.yarn.server.sharedcachemanager.store

A thread safe version of an in-memory SCM store.

InMemorySCMStore() - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore

InMemorySCMStore(AppChecker) - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore

isApplicationActive(ApplicationId) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.AppChecker

Returns whether the app is in an active state.

isApplicationActive(ApplicationId) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.RemoteAppChecker

isResourceEvictable(String, FileStatus) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore

isResourceEvictable(String, FileStatus) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore

Check if a specific resource is evictable according to the store's enabled cache eviction policies.

L

LOG - Static variable in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics

M

main(String[]) - Static method in class org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager

N

nav() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMOverviewPage

notify(SCMUploaderNotifyRequest) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheUploaderService

O

org.apache.hadoop.yarn.server.sharedcachemanager - package org.apache.hadoop.yarn.server.sharedcachemanager

org.apache.hadoop.yarn.server.sharedcachemanager.metrics - package org.apache.hadoop.yarn.server.sharedcachemanager.metrics

org.apache.hadoop.yarn.server.sharedcachemanager.store - package org.apache.hadoop.yarn.server.sharedcachemanager.store

org.apache.hadoop.yarn.server.sharedcachemanager.webapp - package org.apache.hadoop.yarn.server.sharedcachemanager.webapp

overview() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMController

It is referenced in SCMWebServer.SCMWebApp.setup()

P

preHead(Hamlet.HTML<HtmlPage._>) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMOverviewPage

R

rejectedUploads - Variable in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo

release(ReleaseSharedCacheResourceRequest) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.ClientProtocolService

RemoteAppChecker - Class in org.apache.hadoop.yarn.server.sharedcachemanager

An implementation of AppChecker that queries the resource manager remotely to determine whether the app is running.

RemoteAppChecker() - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.RemoteAppChecker

removeResource(String) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore

Removes the given resource from the store.

removeResource(String) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore

Remove a resource from the shared cache.

removeResourceReference(String, SharedCacheResourceReference, boolean) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore

Removes the provided resource reference from the resource.

removeResourceReference(String, SharedCacheResourceReference, boolean) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore

Remove a SharedCacheResourceReference from a resource.

removeResourceReferences(String, Collection<SharedCacheResourceReference>, boolean) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore

Removes the provided collection of resource references from the resource.

removeResourceReferences(String, Collection<SharedCacheResourceReference>, boolean) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore

Remove a collection of SharedCacheResourceReferences from a resource.

reportAFileDelete() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics

Report a delete operation at the current system time

reportAFileError() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics

Report a process operation error at the current system time

reportAFileProcess() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics

Report a process operation at the current system time

reportCleaningStart() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics

Report the start a new run of the cleaner.

runCleanerTask() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.CleanerService

Execute an on-demand cleaner task.

runCleanerTask(RunSharedCacheCleanerTaskRequest) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.SCMAdminProtocolService

S

SCMAdminProtocolService - Class in org.apache.hadoop.yarn.server.sharedcachemanager

This service handles all SCMAdminProtocol rpc calls from administrators to the shared cache manager.

SCMAdminProtocolService(CleanerService) - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.SCMAdminProtocolService

SCMController - Class in org.apache.hadoop.yarn.server.sharedcachemanager.webapp

The controller class for the shared cache manager web app.

SCMController() - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMController

SCMMetricsInfo - Class in org.apache.hadoop.yarn.server.sharedcachemanager.webapp

This class is used to summarize useful shared cache manager metrics for the webUI display.

SCMMetricsInfo() - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo

SCMMetricsInfo(CleanerMetrics, ClientSCMMetrics, SharedCacheUploaderMetrics) - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo

SCMOverviewPage - Class in org.apache.hadoop.yarn.server.sharedcachemanager.webapp

This class is to render the shared cache manager web ui overview page.

SCMOverviewPage() - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMOverviewPage

SCMStore - Class in org.apache.hadoop.yarn.server.sharedcachemanager.store

An abstract class for the data store used by the shared cache manager service.

SCMStore(String) - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore

SCMWebServer - Class in org.apache.hadoop.yarn.server.sharedcachemanager.webapp

A very simple web interface for the metrics reported by SharedCacheManager TODO: Security for web ui (See YARN-2774)

SCMWebServer(SharedCacheManager) - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMWebServer

serviceInit(Configuration) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.CleanerService

serviceInit(Configuration) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.ClientProtocolService

serviceInit(Configuration) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.RemoteAppChecker

serviceInit(Configuration) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.SCMAdminProtocolService

serviceInit(Configuration) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager

serviceInit(Configuration) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheUploaderService

serviceInit(Configuration) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore

The in-memory store bootstraps itself from the shared cache entries that exist in HDFS.

serviceInit(Configuration) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore

serviceInit(Configuration) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMWebServer

serviceStart() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.CleanerService

serviceStart() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.ClientProtocolService

serviceStart() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.SCMAdminProtocolService

serviceStart() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheUploaderService

serviceStart() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore

serviceStart() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMWebServer

serviceStop() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.CleanerService

serviceStop() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.ClientProtocolService

serviceStop() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.SCMAdminProtocolService

serviceStop() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager

serviceStop() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheUploaderService

serviceStop() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore

serviceStop() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMWebServer

SharedCacheManager - Class in org.apache.hadoop.yarn.server.sharedcachemanager

This service maintains the shared cache meta data.

SharedCacheManager() - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager

SharedCacheResourceReference - Class in org.apache.hadoop.yarn.server.sharedcachemanager.store

This is an object that represents a reference to a shared cache resource.

SharedCacheResourceReference(ApplicationId, String) - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.store.SharedCacheResourceReference

Create a resource reference.

SharedCacheUploaderMetrics - Class in org.apache.hadoop.yarn.server.sharedcachemanager.metrics

This class is for maintaining shared cache uploader requests metrics and publishing them through the metrics interfaces.

SharedCacheUploaderService - Class in org.apache.hadoop.yarn.server.sharedcachemanager

This service handles all rpc calls from the NodeManager uploader to the shared cache manager.

SharedCacheUploaderService(SCMStore) - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheUploaderService

SHUTDOWN_HOOK_PRIORITY - Static variable in class org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager

Priority of the SharedCacheManager shutdown hook.

T

totalDeletedFiles - Variable in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo

totalProcessedFiles - Variable in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo

U

use(UseSharedCacheResourceRequest) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.ClientProtocolService

A C E G H I L M N O P R S T U