Search in sources :

Example 1 with MatchDocumentSummary

use of com.marklogic.client.query.MatchDocumentSummary in project components by Talend.

the class MarkLogicDatasetRuntimeTest method testWorkflow.

@SuppressWarnings("unchecked")
@Test
public void testWorkflow() {
    RuntimeContainer container = Mockito.mock(RuntimeContainer.class);
    MarkLogicConnectionProperties connection = new MarkLogicConnectionProperties("datastore");
    connection.referencedComponent.componentInstanceId.setValue("reference");
    DatabaseClient connectionClient = Mockito.mock(DatabaseClient.class);
    GenericDocumentManager docManager = Mockito.mock(GenericDocumentManager.class);
    Mockito.when(connectionClient.newDocumentManager()).thenReturn(docManager);
    QueryManager queryManager = Mockito.mock(QueryManager.class);
    Mockito.when(connectionClient.newQueryManager()).thenReturn(queryManager);
    StringQueryDefinition stringQueryDefinition = Mockito.mock(StringQueryDefinition.class);
    Mockito.when(queryManager.newStringDefinition()).thenReturn(stringQueryDefinition);
    SearchHandle searchHandle = Mockito.mock(SearchHandle.class);
    Mockito.when(queryManager.search(Mockito.eq(stringQueryDefinition), Mockito.any(SearchHandle.class))).thenReturn(searchHandle);
    MatchDocumentSummary[] results = new MatchDocumentSummary[2];
    MatchDocumentSummary firstRecord = Mockito.mock(MatchDocumentSummary.class);
    MatchDocumentSummary secondRecord = Mockito.mock(MatchDocumentSummary.class);
    results[0] = firstRecord;
    results[1] = secondRecord;
    Mockito.when(container.getComponentData("reference", MarkLogicConnection.CONNECTION)).thenReturn(connectionClient);
    MarkLogicDatasetProperties properties = new MarkLogicDatasetProperties("dataset");
    connection.init();
    properties.setDatastoreProperties(connection);
    properties.init();
    datasetRuntime.initialize(container, properties);
    Assert.assertEquals(2, datasetRuntime.getSchema().getFields().size());
    Assert.assertEquals("docId", datasetRuntime.getSchema().getFields().get(0).name());
    Assert.assertEquals("docContent", datasetRuntime.getSchema().getFields().get(1).name());
    Mockito.when(searchHandle.getMatchResults()).thenReturn(results);
    Mockito.when(searchHandle.getTotalResults()).thenReturn(2l);
    Mockito.when(docManager.readAs(Mockito.anyString(), Mockito.any(Class.class))).thenReturn(new Object());
    Consumer<IndexedRecord> consumer = Mockito.mock(Consumer.class);
    datasetRuntime.getSample(2, consumer);
    Mockito.verify(consumer, Mockito.times(2)).accept(Mockito.any(IndexedRecord.class));
}
Also used : GenericDocumentManager(com.marklogic.client.document.GenericDocumentManager) IndexedRecord(org.apache.avro.generic.IndexedRecord) MatchDocumentSummary(com.marklogic.client.query.MatchDocumentSummary) StringQueryDefinition(com.marklogic.client.query.StringQueryDefinition) DatabaseClient(com.marklogic.client.DatabaseClient) SearchHandle(com.marklogic.client.io.SearchHandle) MarkLogicConnectionProperties(org.talend.components.marklogic.tmarklogicconnection.MarkLogicConnectionProperties) QueryManager(com.marklogic.client.query.QueryManager) RuntimeContainer(org.talend.components.api.container.RuntimeContainer) Test(org.junit.Test)

Example 2 with MatchDocumentSummary

use of com.marklogic.client.query.MatchDocumentSummary in project components by Talend.

the class MarkLogicCriteriaReader method getCurrent.

@Override
public IndexedRecord getCurrent() throws NoSuchElementException {
    ++documentCounter;
    MatchDocumentSummary currentSummary = currentPage[pageCounter];
    current = new GenericData.Record(settings.outputSchema);
    try {
        String docId = currentSummary.getUri();
        current = docContentReader.readDocument(docId);
        result.totalCountLong++;
        result.successCountLong++;
        pageCounter++;
        return current;
    } catch (Exception e) {
        throw new MarkLogicException(new MarkLogicErrorCode("Can't read document from MarkLogic database"), e);
    }
}
Also used : MarkLogicException(org.talend.components.marklogic.exceptions.MarkLogicException) MatchDocumentSummary(com.marklogic.client.query.MatchDocumentSummary) MarkLogicErrorCode(org.talend.components.marklogic.exceptions.MarkLogicErrorCode) GenericData(org.apache.avro.generic.GenericData) NoSuchElementException(java.util.NoSuchElementException) MarkLogicException(org.talend.components.marklogic.exceptions.MarkLogicException) IOException(java.io.IOException)

Aggregations

MatchDocumentSummary (com.marklogic.client.query.MatchDocumentSummary)2 DatabaseClient (com.marklogic.client.DatabaseClient)1 GenericDocumentManager (com.marklogic.client.document.GenericDocumentManager)1 SearchHandle (com.marklogic.client.io.SearchHandle)1 QueryManager (com.marklogic.client.query.QueryManager)1 StringQueryDefinition (com.marklogic.client.query.StringQueryDefinition)1 IOException (java.io.IOException)1 NoSuchElementException (java.util.NoSuchElementException)1 GenericData (org.apache.avro.generic.GenericData)1 IndexedRecord (org.apache.avro.generic.IndexedRecord)1 Test (org.junit.Test)1 RuntimeContainer (org.talend.components.api.container.RuntimeContainer)1 MarkLogicErrorCode (org.talend.components.marklogic.exceptions.MarkLogicErrorCode)1 MarkLogicException (org.talend.components.marklogic.exceptions.MarkLogicException)1 MarkLogicConnectionProperties (org.talend.components.marklogic.tmarklogicconnection.MarkLogicConnectionProperties)1