Search in sources :

Example 1 with UnsafeSingleThreadFinalSortFilesMerger

use of org.apache.carbondata.processing.newflow.sort.unsafe.merger.UnsafeSingleThreadFinalSortFilesMerger in project carbondata by apache.

the class UnsafeParallelReadMergeSorterImpl method initialize.

@Override
public void initialize(SortParameters sortParameters) {
    this.sortParameters = sortParameters;
    unsafeIntermediateFileMerger = new UnsafeIntermediateMerger(sortParameters);
    String storeLocation = CarbonDataProcessorUtil.getLocalDataFolderLocation(sortParameters.getDatabaseName(), sortParameters.getTableName(), String.valueOf(sortParameters.getTaskNo()), sortParameters.getPartitionID(), sortParameters.getSegmentId() + "", false);
    // Set the data file location
    String dataFolderLocation = storeLocation + File.separator + CarbonCommonConstants.SORT_TEMP_FILE_LOCATION;
    finalMerger = new UnsafeSingleThreadFinalSortFilesMerger(sortParameters, sortParameters.getTempFileLocation());
}
Also used : UnsafeSingleThreadFinalSortFilesMerger(org.apache.carbondata.processing.newflow.sort.unsafe.merger.UnsafeSingleThreadFinalSortFilesMerger) UnsafeIntermediateMerger(org.apache.carbondata.processing.newflow.sort.unsafe.merger.UnsafeIntermediateMerger)

Aggregations

UnsafeIntermediateMerger (org.apache.carbondata.processing.newflow.sort.unsafe.merger.UnsafeIntermediateMerger)1 UnsafeSingleThreadFinalSortFilesMerger (org.apache.carbondata.processing.newflow.sort.unsafe.merger.UnsafeSingleThreadFinalSortFilesMerger)1