Examples with TupleGenerator org.apache.hyracks.storage.am.common.datagen.TupleGenerator used on opensource projects

Example 1 with TupleGenerator

use of org.apache.hyracks.storage.am.common.datagen.TupleGenerator in project asterixdb by apache.

the class AbstractInvertedIndexLoadTest method hashedWordTokensInvIndexTest.

@Test
public void hashedWordTokensInvIndexTest() throws IOException {
    LSMInvertedIndexTestContext testCtx = LSMInvertedIndexTestUtils.createHashedWordInvIndexTestContext(harness, invIndexType);
    TupleGenerator tupleGen = LSMInvertedIndexTestUtils.createStringDocumentTupleGen(harness.getRandom());
    runTest(testCtx, tupleGen);
}

Example 2 with TupleGenerator

use of org.apache.hyracks.storage.am.common.datagen.TupleGenerator in project asterixdb by apache.

the class AbstractInvertedIndexLoadTest method ngramTokensInvIndexTest.

@Test
public void ngramTokensInvIndexTest() throws IOException {
    LSMInvertedIndexTestContext testCtx = LSMInvertedIndexTestUtils.createNGramInvIndexTestContext(harness, invIndexType);
    TupleGenerator tupleGen = LSMInvertedIndexTestUtils.createPersonNamesTupleGen(harness.getRandom());
    runTest(testCtx, tupleGen);
}

Example 3 with TupleGenerator

use of org.apache.hyracks.storage.am.common.datagen.TupleGenerator in project asterixdb by apache.

the class AbstractInvertedIndexSearchTest method testNGramInvIndexIndex.

private void testNGramInvIndexIndex(LSMInvertedIndexTestContext testCtx) throws IOException {
    TupleGenerator tupleGen = LSMInvertedIndexTestUtils.createPersonNamesTupleGen(harness.getRandom());
    List<IInvertedIndexSearchModifier> searchModifiers = new ArrayList<>();
    searchModifiers.add(new ConjunctiveSearchModifier());
    searchModifiers.add(new JaccardSearchModifier(1.0f));
    searchModifiers.add(new JaccardSearchModifier(0.8f));
    searchModifiers.add(new JaccardSearchModifier(0.5f));
    searchModifiers.add(new EditDistanceSearchModifier(LSMInvertedIndexTestUtils.TEST_GRAM_LENGTH, 0));
    searchModifiers.add(new EditDistanceSearchModifier(LSMInvertedIndexTestUtils.TEST_GRAM_LENGTH, 1));
    searchModifiers.add(new EditDistanceSearchModifier(LSMInvertedIndexTestUtils.TEST_GRAM_LENGTH, 2));
    searchModifiers.add(new EditDistanceSearchModifier(LSMInvertedIndexTestUtils.TEST_GRAM_LENGTH, 3));
    runTest(testCtx, tupleGen, searchModifiers);
}

Example 4 with TupleGenerator

use of org.apache.hyracks.storage.am.common.datagen.TupleGenerator in project asterixdb by apache.

the class AbstractInvertedIndexDeleteTest method hashedWordTokensInvIndexTest.

@Test
public void hashedWordTokensInvIndexTest() throws IOException {
    LSMInvertedIndexTestContext testCtx = LSMInvertedIndexTestUtils.createHashedWordInvIndexTestContext(harness, invIndexType);
    TupleGenerator tupleGen = LSMInvertedIndexTestUtils.createStringDocumentTupleGen(harness.getRandom());
    runTest(testCtx, tupleGen);
}

Example 5 with TupleGenerator

use of org.apache.hyracks.storage.am.common.datagen.TupleGenerator in project asterixdb by apache.

the class AbstractInvertedIndexLoadTest method hashedNGramTokensInvIndexTest.

@Test
public void hashedNGramTokensInvIndexTest() throws IOException {
    LSMInvertedIndexTestContext testCtx = LSMInvertedIndexTestUtils.createHashedNGramInvIndexTestContext(harness, invIndexType);
    TupleGenerator tupleGen = LSMInvertedIndexTestUtils.createPersonNamesTupleGen(harness.getRandom());
    runTest(testCtx, tupleGen);
}