RecordSchemaCacheService
Implementation: VolatileSchemaCache
Specifies a Schema Cache to add the Record Schema to so that Record Readers can quickly lookup the schema. | Schema Protocol Version | 1 | | The protocol version to be used for Schema Write Strategies that require a protocol version, such as Hortonworks Schema Registry strategies. Valid protocol versions for Hortonworks Schema Registry are integer values 1, 2, or 3. Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)
This Property is only considered if the <Schema Write Strategy> Property is set to one of the following values: "hwx-schema-ref-attributes", "hwx-content-encoded-schema" |
Schema Access Strategy | inherit-record-schema | - Inherit Record Schema
- Use 'Schema Name' Property
- Use 'Schema Text' Property
| Specifies how to obtain the schema that is to be used for interpreting the data. |
Schema Registry | | Controller Service API: SchemaRegistry Implementations: ConfluentSchemaRegistry HortonworksSchemaRegistry AvroSchemaRegistry | Specifies the Controller Service to use for the Schema Registry
This Property is only considered if the <Schema Access Strategy> Property is set to one of the following values: "confluent-encoded", "schema-name", "hwx-schema-ref-attributes", "hwx-content-encoded-schema" |
Schema Name | ${schema.name} | | Specifies the name of the schema to lookup in the Schema Registry property Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)
This Property is only considered if the <Schema Access Strategy> Property has a value of "schema-name". |
Schema Version | | | Specifies the version of the schema to lookup in the Schema Registry. If not specified then the latest version of the schema will be retrieved. Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)
This Property is only considered if the <Schema Access Strategy> Property has a value of "schema-name". |
Schema Branch | | | Specifies the name of the branch to use when looking up the schema in the Schema Registry property. If the chosen Schema Registry does not support branching, this value will be ignored. Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)
This Property is only considered if the <Schema Access Strategy> Property has a value of "schema-name". |
Schema Text | ${avro.schema} | | The text of an Avro-formatted Schema Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)
This Property is only considered if the <Schema Access Strategy> Property has a value of "schema-text-property". |
Compression Format | NONE | - BZIP2
- DEFLATE
- NONE
- SNAPPY
- LZO
| Compression type to use when writing Avro files. Default is None. |
Cache Size | 1000 | | Specifies how many Schemas should be cached |
Encoder Pool Size | 32 | | Avro Writers require the use of an Encoder. Creation of Encoders is expensive, but once created, they can be reused. This property controls the maximum number of Encoders that can be pooled and reused. Setting this value too small can result in degraded performance, but setting it higher can result in more heap being used. This property is ignored if the Avro Writer is configured with a Schema Write Strategy of 'Embed Avro Schema'. Supports Expression Language: true (will be evaluated using variable registry only) |
State management:
This component does not store state.Restricted:
This component is not restricted.System Resource Considerations:
None specified.