Examples with RowConverter org.apache.carbondata.processing.loading.converter.RowConverter used on opensource projects

Example 1 with RowConverter

use of org.apache.carbondata.processing.loading.converter.RowConverter in project carbondata by apache.

the class DataConverterProcessorStepImpl method initialize.

@Override
public void initialize() throws IOException {
    super.initialize();
    child.initialize();
    converters = new ArrayList<>();
    badRecordLogger = BadRecordsLoggerProvider.createBadRecordLogger(configuration);
    RowConverter converter = new RowConverterImpl(child.getOutput(), configuration, badRecordLogger);
    converters.add(converter);
    converter.initialize();
    if (null != configuration.getBucketingInfo()) {
        this.isBucketColumnEnabled = true;
        initializeBucketColumnPartitioner();
    } else if (null != configuration.getSortColumnRangeInfo()) {
        this.isSortColumnRangeEnabled = true;
        initializeSortColumnRangesPartitioner();
    }
}

Example 2 with RowConverter

use of org.apache.carbondata.processing.loading.converter.RowConverter in project carbondata by apache.

the class DataConverterProcessorStepImpl method close.

@Override
public void close() {
    if (!closed) {
        if (null != badRecordLogger) {
            badRecordLogger.closeStreams();
            CarbonBadRecordUtil.renameBadRecord(configuration);
        }
        super.close();
        if (converters != null) {
            for (RowConverter converter : converters) {
                if (null != converter) {
                    converter.finish();
                }
            }
        }
    }
}