Search in sources :

Example 1 with BlockBTreeBuilder

use of org.apache.carbondata.core.datastore.impl.btree.BlockBTreeBuilder in project carbondata by apache.

the class SegmentTaskIndex method buildIndex.

/**
   * Below method is store the blocks in some data structure
   *
   */
public void buildIndex(List<DataFileFooter> footerList) {
    // create a segment builder info
    // in case of segment create we do not need any file path and each column value size
    // as Btree will be build as per min max and start key
    BTreeBuilderInfo btreeBuilderInfo = new BTreeBuilderInfo(footerList, null);
    BtreeBuilder blocksBuilder = new BlockBTreeBuilder();
    // load the metadata
    blocksBuilder.build(btreeBuilderInfo);
    dataRefNode = blocksBuilder.get();
    for (DataFileFooter footer : footerList) {
        totalNumberOfRows += footer.getNumberOfRows();
    }
}
Also used : DataFileFooter(org.apache.carbondata.core.metadata.blocklet.DataFileFooter) BTreeBuilderInfo(org.apache.carbondata.core.datastore.BTreeBuilderInfo) BlockBTreeBuilder(org.apache.carbondata.core.datastore.impl.btree.BlockBTreeBuilder) BtreeBuilder(org.apache.carbondata.core.datastore.BtreeBuilder)

Aggregations

BTreeBuilderInfo (org.apache.carbondata.core.datastore.BTreeBuilderInfo)1 BtreeBuilder (org.apache.carbondata.core.datastore.BtreeBuilder)1 BlockBTreeBuilder (org.apache.carbondata.core.datastore.impl.btree.BlockBTreeBuilder)1 DataFileFooter (org.apache.carbondata.core.metadata.blocklet.DataFileFooter)1