MoveAzureDataLakeStorage

Description:

Moves content within an Azure Data Lake Storage Gen 2. After the move, files will be no longer available on source location.

Tags:

azure, microsoft, cloud, storage, adlsgen2, datalake

Properties:

In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.

NameDefault ValueAllowable ValuesDescription
ADLS CredentialsController Service API:
ADLSCredentialsService
Implementation: ADLSCredentialsControllerService
Controller Service used to obtain Azure Credentials.
Source Filesystem${azure.filesystem}Name of the Azure Storage File System from where the move should happen.
Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)
Source Directory${azure.directory}Name of the Azure Storage Directory from where the move should happen. The Directory Name cannot contain a leading '/'. The root directory can be designated by the empty string value.
Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)
Destination FilesystemName of the Azure Storage File System where the files will be moved.
Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)
Destination DirectoryName of the Azure Storage Directory where the files will be moved. The Directory Name cannot contain a leading '/'. The root directory can be designated by the empty string value. Non-existing directories will be created. If the original directory structure should be kept, the full directory path needs to be provided after the destination directory. e.g.: destdir/${azure.directory}
Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)
File Name${azure.filename}The filename
Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)
Conflict Resolution Strategyfail
  • fail
  • replace
  • ignore
Indicates what should happen when a file with the same name already exists in the output directory

Relationships:

NameDescription
successFiles that have been successfully written to Azure storage are transferred to this relationship
failureFiles that could not be written to Azure storage for some reason are transferred to this relationship

Reads Attributes:

None specified.

Writes Attributes:

NameDescription
azure.source.filesystemThe name of the source Azure File System
azure.source.directoryThe name of the source Azure Directory
azure.filesystemThe name of the Azure File System
azure.directoryThe name of the Azure Directory
azure.filenameThe name of the Azure File
azure.primaryUriPrimary location for file content
azure.lengthThe length of the Azure File

State management:

This component does not store state.

Restricted:

This component is not restricted.

Input requirement:

This component requires an incoming relationship.

System Resource Considerations:

None specified.

See Also:

DeleteAzureDataLakeStorage, FetchAzureDataLakeStorage, ListAzureDataLakeStorage