Examples with SingleThreadFinalSortFilesMerger org.apache.carbondata.processing.store.SingleThreadFinalSortFilesMerger used on opensource projects

Example 1 with SingleThreadFinalSortFilesMerger

use of org.apache.carbondata.processing.store.SingleThreadFinalSortFilesMerger in project carbondata by apache.

the class ParallelReadMergeSorterImpl method initialize.

@Override
public void initialize(SortParameters sortParameters) {
    this.sortParameters = sortParameters;
    intermediateFileMerger = new SortIntermediateFileMerger(sortParameters);
    String storeLocation = CarbonDataProcessorUtil.getLocalDataFolderLocation(sortParameters.getDatabaseName(), sortParameters.getTableName(), String.valueOf(sortParameters.getTaskNo()), sortParameters.getPartitionID(), sortParameters.getSegmentId() + "", false);
    // Set the data file location
    String dataFolderLocation = storeLocation + File.separator + CarbonCommonConstants.SORT_TEMP_FILE_LOCATION;
    finalMerger = new SingleThreadFinalSortFilesMerger(dataFolderLocation, sortParameters.getTableName(), sortParameters.getDimColCount(), sortParameters.getComplexDimColCount(), sortParameters.getMeasureColCount(), sortParameters.getNoDictionaryCount(), sortParameters.getMeasureDataType(), sortParameters.getNoDictionaryDimnesionColumn(), sortParameters.getNoDictionarySortColumn());
}