Search in sources :

Example 1 with UnsafeSingleThreadFinalSortFilesMerger

use of org.apache.carbondata.processing.loading.sort.unsafe.merger.UnsafeSingleThreadFinalSortFilesMerger in project carbondata by apache.

the class UnsafeParallelReadMergeSorterImpl method initialize.

@Override
public void initialize(SortParameters sortParameters) {
    this.sortParameters = sortParameters;
    unsafeIntermediateFileMerger = new UnsafeIntermediateMerger(sortParameters);
    finalMerger = new UnsafeSingleThreadFinalSortFilesMerger(sortParameters, sortParameters.getTempFileLocation());
    // Delete if any older file exists in sort temp folder
    CarbonDataProcessorUtil.deleteSortLocationIfExists(sortParameters.getTempFileLocation());
    // create new sort temp directory
    CarbonDataProcessorUtil.createLocations(sortParameters.getTempFileLocation());
}
Also used : UnsafeSingleThreadFinalSortFilesMerger(org.apache.carbondata.processing.loading.sort.unsafe.merger.UnsafeSingleThreadFinalSortFilesMerger) UnsafeIntermediateMerger(org.apache.carbondata.processing.loading.sort.unsafe.merger.UnsafeIntermediateMerger)

Aggregations

UnsafeIntermediateMerger (org.apache.carbondata.processing.loading.sort.unsafe.merger.UnsafeIntermediateMerger)1 UnsafeSingleThreadFinalSortFilesMerger (org.apache.carbondata.processing.loading.sort.unsafe.merger.UnsafeSingleThreadFinalSortFilesMerger)1