Examples with PartitionedInvertedIndexTokenizingTupleIterator org.apache.hyracks.storage.am.lsm.invertedindex.util.PartitionedInvertedIndexTokenizingTupleIterator used on opensource projects

Example 1 with PartitionedInvertedIndexTokenizingTupleIterator

use of org.apache.hyracks.storage.am.lsm.invertedindex.util.PartitionedInvertedIndexTokenizingTupleIterator in project asterixdb by apache.

the class PartitionedInMemoryInvertedIndex method insert.

@Override
public void insert(ITupleReference tuple, BTreeAccessor btreeAccessor, IIndexOperationContext ictx) throws HyracksDataException {
    super.insert(tuple, btreeAccessor, ictx);
    PartitionedInMemoryInvertedIndexOpContext ctx = (PartitionedInMemoryInvertedIndexOpContext) ictx;
    PartitionedInvertedIndexTokenizingTupleIterator tupleIter = (PartitionedInvertedIndexTokenizingTupleIterator) ctx.getTupleIter();
    updatePartitionIndexes(tupleIter.getNumTokens());
}

Example 2 with PartitionedInvertedIndexTokenizingTupleIterator

use of org.apache.hyracks.storage.am.lsm.invertedindex.util.PartitionedInvertedIndexTokenizingTupleIterator in project asterixdb by apache.

the class PartitionedInMemoryInvertedIndexOpContext method setTokenizingTupleIterator.

protected void setTokenizingTupleIterator() {
    IBinaryTokenizer tokenizer = getTokenizerFactory().createTokenizer();
    setTupleIter(new PartitionedInvertedIndexTokenizingTupleIterator(tokenCmpFactories.length, btree.getFieldCount() - tokenCmpFactories.length, tokenizer));
}