Examples with DelimitedRecordFormat org.apache.storm.hdfs.trident.format.DelimitedRecordFormat used on opensource projects

Example 1 with DelimitedRecordFormat

use of org.apache.storm.hdfs.trident.format.DelimitedRecordFormat in project storm by apache.

the class HdfsStateTest method createHdfsState.

private HdfsState createHdfsState() {
    Fields hdfsFields = new Fields("f1");
    RecordFormat recordFormat = new DelimitedRecordFormat().withFields(hdfsFields);
    FileRotationPolicy rotationPolicy = new FileSizeRotationPolicy(5.0f, FileSizeRotationPolicy.Units.MB);
    HdfsState.Options options = new HdfsState.HdfsFileOptions().withFileNameFormat(fileNameFormat).withRecordFormat(recordFormat).withRotationPolicy(rotationPolicy).withFsUrl("file://" + TEST_OUT_DIR);
    Map<String, String> conf = new HashMap<>();
    conf.put(Config.TOPOLOGY_NAME, TEST_TOPOLOGY_NAME);
    HdfsState state = new HdfsState(options);
    state.prepare(conf, null, 0, 1);
    return state;
}