Search in sources :

Example 6 with MemoryException

use of org.apache.carbondata.core.memory.MemoryException in project carbondata by apache.

the class LuceneFineGrainDataMapFactory method getDataMaps.

/**
 * Get the datamap for segmentid
 */
@Override
public List<FineGrainDataMap> getDataMaps(Segment segment) throws IOException {
    List<FineGrainDataMap> lstDataMap = new ArrayList<>();
    FineGrainDataMap dataMap = new LuceneFineGrainDataMap(analyzer);
    try {
        dataMap.init(new DataMapModel(LuceneDataMapWriter.genDataMapStorePath(tableIdentifier.getTablePath(), segment.getSegmentNo(), dataMapName)));
    } catch (MemoryException e) {
        LOGGER.error("failed to get lucene datamap , detail is {}" + e.getMessage());
        return lstDataMap;
    }
    lstDataMap.add(dataMap);
    return lstDataMap;
}
Also used : FineGrainDataMap(org.apache.carbondata.core.datamap.dev.fgdatamap.FineGrainDataMap) MemoryException(org.apache.carbondata.core.memory.MemoryException) DataMapModel(org.apache.carbondata.core.datamap.dev.DataMapModel) ArrayList(java.util.ArrayList)

Aggregations

MemoryException (org.apache.carbondata.core.memory.MemoryException)6 ArrayList (java.util.ArrayList)3 DataMapModel (org.apache.carbondata.core.datamap.dev.DataMapModel)3 Iterator (java.util.Iterator)2 CarbonIterator (org.apache.carbondata.common.CarbonIterator)2 CoarseGrainDataMap (org.apache.carbondata.core.datamap.dev.cgdatamap.CoarseGrainDataMap)2 CarbonDataLoadingException (org.apache.carbondata.processing.loading.exception.CarbonDataLoadingException)2 UnsafeSortDataRows (org.apache.carbondata.processing.loading.sort.unsafe.UnsafeSortDataRows)2 IOException (java.io.IOException)1 HashSet (java.util.HashSet)1 ExecutorService (java.util.concurrent.ExecutorService)1 FineGrainDataMap (org.apache.carbondata.core.datamap.dev.fgdatamap.FineGrainDataMap)1 CarbonDataWriterException (org.apache.carbondata.core.datastore.exception.CarbonDataWriterException)1 CarbonRow (org.apache.carbondata.core.datastore.row.CarbonRow)1 BlockletDataMap (org.apache.carbondata.core.indexstore.blockletindex.BlockletDataMap)1 SegmentIndexFileStore (org.apache.carbondata.core.indexstore.blockletindex.SegmentIndexFileStore)1 CarbonThreadFactory (org.apache.carbondata.core.util.CarbonThreadFactory)1 CarbonRowBatch (org.apache.carbondata.processing.loading.row.CarbonRowBatch)1 UnsafeCarbonRowPage (org.apache.carbondata.processing.loading.sort.unsafe.UnsafeCarbonRowPage)1 UnsafeIntermediateMerger (org.apache.carbondata.processing.loading.sort.unsafe.merger.UnsafeIntermediateMerger)1