PublishGCPubSubLite

Description:

Publishes the content of the incoming flowfile to the configured Google Cloud PubSub Lite topic. The processor supports dynamic properties. If any dynamic properties are present, they will be sent along with the message in the form of 'attributes'. In its current state, this processor will only work if running on a Google Cloud Compute Engine instance and if using the GCP Credentials Controller Service with 'Use Application Default Credentials' or 'Use Compute Engine Credentials'.

Tags:

google, google-cloud, gcp, message, pubsub, publish, lite

Properties:

In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.

NameDefault ValueAllowable ValuesDescription
Topic NameName of the Google Cloud PubSub Topic. Example: projects/8476107443/locations/europe-west1-d/topics/my-lite-topic
Supports Expression Language: true (will be evaluated using variable registry only)
GCP Credentials Provider ServiceController Service API:
GCPCredentialsService
Implementation: GCPCredentialsControllerService
The Controller Service used to obtain Google Cloud Platform credentials.
Ordering KeyMessages with the same ordering key will always get published to the same partition. When this property is not set, messages can get published to different partitions if more than one partition exists for the topic.
Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)
Batch Size15Indicates the number of messages the cloud service should bundle together in a batch. If not set and left empty, only one message will be used in a batch
Batch Bytes Threshold3 MBPublish request gets triggered based on this Batch Bytes Threshold property and the Batch Size property, whichever condition is met first.
Supports Expression Language: true (will be evaluated using variable registry only)

Dynamic Properties:

Dynamic Properties allow the user to specify both the name and value of a property.

NameValueDescription
Attribute nameValue to be set to the attributeAttributes to be set for the outgoing Google Cloud PubSub Lite message
Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)

Relationships:

NameDescription
successFlowFiles are routed to this relationship after a successful Google Cloud Pub/Sub operation.
failureFlowFiles are routed to this relationship if the Google Cloud Pub/Sub operation fails.

Reads Attributes:

None specified.

Writes Attributes:

NameDescription
gcp.pubsub.messageIdID of the pubsub message published to the configured Google Cloud PubSub topic
gcp.pubsub.topicName of the Google Cloud PubSub topic the message was published to

State management:

This component does not store state.

Restricted:

This component is not restricted.

Input requirement:

This component requires an incoming relationship.

System Resource Considerations:

ResourceDescription
MEMORYThe entirety of the FlowFile's content will be read into memory to be sent as a PubSub message.

See Also:

ConsumeGCPubSubLite