Apache Flume Tools
There are two event validation tools for the events available.
- File channel integrity tool
- Event Validator tool
File channel integrity tool -
This tool verifies the reliability of individual events in the file channel and removes any corrupted events. It can be run as follows:
$bin/flume-ng tool --conf ./conf FCINTEGRITYTOOL -l ./datadir
datadir - Specifies the comma separated list of data directory to be verified.
Below are the lists of options available -
| Option Name | Description |
|---|---|
| h/help | Displays help |
| l/dataDirs | Comma-separated list of data directories |
Event Validator tool -
This tool is designed to validate File Channel Events in a manner specific to the application. It applies user provider validation logic to each event and discards any events that do not conform to this logic.
The tool can be run as follows:
$bin/flume-ng tool --conf ./conf FCINTEGRITYTOOL -l ./datadir -e
org.apache.flume.MyEventValidator -DmaxSize 2000
datadir - Specifies the comma separated list of data directory to be verified.
Below are the lists of options available -
| Option Name | Description |
|---|---|
| h/help | Displays help |
| l/dataDirs | Comma-separated list of data directories |
| e/eventValidator | Fully Qualified Name of Event Validator Implementation |