- All Implemented Interfaces:
- Iterator<BootstrapEvent>
public class BootstrapEventsIterator
extends Object
implements Iterator<BootstrapEvent>
Replication layout is from the root directory of replication Dump is
db
table1
_metadata
data
_files
table2
_metadata
data
_files
_functions
functionName1
_metadata
functionName2
_metadata
this class understands this layout and hence will help in identifying for subsequent bootstrap tasks
as to where the last set of tasks left execution and from where this task should pick up replication.
Since for replication we have the need for hierarchy of tasks we need to make sure that db level are
processed first before table, table level are processed first before partitions etc.
Based on how the metadata is being exported on the file we have to currently take care of the following:
1. Make sure db level are processed first as this will be required before table / functions processing.
2. Table before partition is not explicitly required as table and partition metadata are in the same file.
For future integrations other sources of events like kafka, would require to implement an Iterator