Search in sources :

Example 1 with UnknownIndexException

use of org.molgenis.data.index.exception.UnknownIndexException in project molgenis by molgenis.

the class ClientFacade method getCount.

private long getCount(QueryBuilder query, List<Index> indexes) {
    if (LOG.isTraceEnabled()) {
        if (query != null) {
            LOG.trace("Counting docs in index(es) '{}' with query '{}' ...", toString(indexes), query);
        } else {
            LOG.trace("Counting docs in index(es) '{}' ...", toString(indexes));
        }
    }
    SearchRequestBuilder searchRequest = createSearchRequest(query, null, 0, null, null, indexes);
    SearchResponse searchResponse;
    try {
        searchResponse = searchRequest.get();
    } catch (ResourceNotFoundException e) {
        LOG.error("", e);
        throw new UnknownIndexException(toIndexNames(indexes));
    } catch (ElasticsearchException e) {
        LOG.error("", e);
        throw new IndexException(format("Error counting docs in index(es) '%s'.", toString(indexes)));
    }
    if (searchResponse.getFailedShards() > 0) {
        LOG.error(stream(searchResponse.getShardFailures()).map(ShardSearchFailure::toString).collect(joining("\n")));
        throw new IndexException(format("Error counting docs in index(es) '%s'.", toString(indexes)));
    }
    if (searchResponse.isTimedOut()) {
        throw new IndexException(format("Timeout while counting docs in index(es) '%s'.", toString(indexes)));
    }
    long totalHits = searchResponse.getHits().getTotalHits();
    if (LOG.isDebugEnabled()) {
        if (query != null) {
            LOG.debug("Counted {} docs in index(es) '{}' with query '{}' in {}ms.", totalHits, toString(indexes), query, searchResponse.getTookInMillis());
        } else {
            LOG.debug("Counted {} docs in index(es) '{}' in {}ms.", totalHits, toString(indexes), searchResponse.getTookInMillis());
        }
    }
    return totalHits;
}
Also used : SearchRequestBuilder(org.elasticsearch.action.search.SearchRequestBuilder) IndexException(org.molgenis.data.index.exception.IndexException) UnknownIndexException(org.molgenis.data.index.exception.UnknownIndexException) UnknownIndexException(org.molgenis.data.index.exception.UnknownIndexException) ElasticsearchException(org.elasticsearch.ElasticsearchException) ShardSearchFailure(org.elasticsearch.action.search.ShardSearchFailure) ResourceNotFoundException(org.elasticsearch.ResourceNotFoundException) SearchResponse(org.elasticsearch.action.search.SearchResponse)

Example 2 with UnknownIndexException

use of org.molgenis.data.index.exception.UnknownIndexException in project molgenis by molgenis.

the class ClientFacade method aggregate.

private Aggregations aggregate(List<AggregationBuilder> aggregations, QueryBuilder query, List<Index> indexes) {
    if (LOG.isTraceEnabled()) {
        if (query != null) {
            LOG.trace("Aggregating docs in index(es) '{}' with aggregations '{}' and query '{}' ...", toString(indexes), aggregations, query);
        } else {
            LOG.trace("Aggregating docs in index(es) '{}' with aggregations '{}' ...", toString(indexes), aggregations);
        }
    }
    SearchRequestBuilder searchRequest = createSearchRequest(query, null, 0, null, aggregations, indexes);
    SearchResponse searchResponse;
    try {
        searchResponse = searchRequest.get();
    } catch (ResourceNotFoundException e) {
        LOG.error("", e);
        throw new UnknownIndexException(toIndexNames(indexes));
    } catch (ElasticsearchException e) {
        LOG.error("", e);
        throw new IndexException(format("Error aggregating docs in index(es) '%s'.", toString(indexes)));
    }
    if (searchResponse.getFailedShards() > 0) {
        LOG.error(stream(searchResponse.getShardFailures()).map(ShardSearchFailure::toString).collect(joining("\n")));
        throw new IndexException(format("Error aggregating docs in index(es) '%s'.", toString(indexes)));
    }
    if (searchResponse.isTimedOut()) {
        throw new IndexException(format("Timeout aggregating docs in index(es) '%s'.", toString(indexes)));
    }
    if (LOG.isDebugEnabled()) {
        if (query != null) {
            LOG.debug("Aggregated docs in index(es) '{}' with aggregations '{}' and query '{}' in {}ms.", toString(indexes), aggregations, query, searchResponse.getTookInMillis());
        } else {
            LOG.debug("Aggregated docs in index(es) '{}' with aggregations '{}' in {}ms.", toString(indexes), aggregations, searchResponse.getTookInMillis());
        }
    }
    return searchResponse.getAggregations();
}
Also used : SearchRequestBuilder(org.elasticsearch.action.search.SearchRequestBuilder) IndexException(org.molgenis.data.index.exception.IndexException) UnknownIndexException(org.molgenis.data.index.exception.UnknownIndexException) UnknownIndexException(org.molgenis.data.index.exception.UnknownIndexException) ElasticsearchException(org.elasticsearch.ElasticsearchException) ShardSearchFailure(org.elasticsearch.action.search.ShardSearchFailure) ResourceNotFoundException(org.elasticsearch.ResourceNotFoundException) SearchResponse(org.elasticsearch.action.search.SearchResponse)

Example 3 with UnknownIndexException

use of org.molgenis.data.index.exception.UnknownIndexException in project molgenis by molgenis.

the class ClientFacade method index.

public void index(Index index, Document document) {
    if (LOG.isTraceEnabled()) {
        LOG.trace("Indexing doc with id '{}' in index '{}' ...", document.getId(), index.getName());
    }
    String indexName = index.getName();
    String documentId = document.getId();
    XContentBuilder source = document.getContent();
    IndexRequestBuilder indexRequest = client.prepareIndex().setIndex(indexName).setType(indexName).setId(documentId).setSource(source);
    IndexResponse indexResponse;
    try {
        indexResponse = indexRequest.get();
    } catch (ResourceNotFoundException e) {
        LOG.error("", e);
        throw new UnknownIndexException(index.getName());
    } catch (ElasticsearchException e) {
        LOG.debug("", e);
        throw new IndexException(format("Error indexing doc with id '%s' in index '%s'.", documentId, indexName));
    }
    // TODO: Is it good enough if at least one shard succeeds? Shouldn't we at least log something if failures > 0?
    if (indexResponse.getShardInfo().getSuccessful() == 0) {
        LOG.error(Arrays.stream(indexResponse.getShardInfo().getFailures()).map(ReplicationResponse.ShardInfo.Failure::toString).collect(joining("\n")));
        throw new IndexException(format("Error indexing doc with id '%s' in index '%s'.", documentId, indexName));
    }
    if (LOG.isDebugEnabled()) {
        LOG.debug("Indexed doc with id '{}' in index '{}'.", documentId, indexName);
    }
}
Also used : CreateIndexRequestBuilder(org.elasticsearch.action.admin.indices.create.CreateIndexRequestBuilder) IndexRequestBuilder(org.elasticsearch.action.index.IndexRequestBuilder) DeleteIndexRequestBuilder(org.elasticsearch.action.admin.indices.delete.DeleteIndexRequestBuilder) IndexException(org.molgenis.data.index.exception.IndexException) UnknownIndexException(org.molgenis.data.index.exception.UnknownIndexException) CreateIndexResponse(org.elasticsearch.action.admin.indices.create.CreateIndexResponse) IndexResponse(org.elasticsearch.action.index.IndexResponse) DeleteIndexResponse(org.elasticsearch.action.admin.indices.delete.DeleteIndexResponse) UnknownIndexException(org.molgenis.data.index.exception.UnknownIndexException) ElasticsearchException(org.elasticsearch.ElasticsearchException) ResourceNotFoundException(org.elasticsearch.ResourceNotFoundException) XContentBuilder(org.elasticsearch.common.xcontent.XContentBuilder) ShardSearchFailure(org.elasticsearch.action.search.ShardSearchFailure) ReplicationResponse(org.elasticsearch.action.support.replication.ReplicationResponse)

Example 4 with UnknownIndexException

use of org.molgenis.data.index.exception.UnknownIndexException in project molgenis by molgenis.

the class IndexedRepositoryDecoratorTest method countUnknownIndexExceptionUnrecoverable.

@Test(expectedExceptions = MolgenisDataException.class, expectedExceptionsMessageRegExp = "Error executing query, index for entity type 'My entity type' with id 'entity' does not exist")
public void countUnknownIndexExceptionUnrecoverable() {
    when(searchService.count(repositoryEntityType, unsupportedQuery)).thenThrow(new UnknownIndexException("msg"));
    indexedRepositoryDecorator.count(unsupportedQuery);
}
Also used : UnknownIndexException(org.molgenis.data.index.exception.UnknownIndexException) Test(org.testng.annotations.Test)

Example 5 with UnknownIndexException

use of org.molgenis.data.index.exception.UnknownIndexException in project molgenis by molgenis.

the class IndexedRepositoryDecoratorTest method findOneUnknownIndexExceptionUnrecoverable.

@Test(expectedExceptions = MolgenisDataException.class, expectedExceptionsMessageRegExp = "Error executing query, index for entity type 'My entity type' with id 'entity' does not exist")
public void findOneUnknownIndexExceptionUnrecoverable() {
    when(searchService.searchOne(repositoryEntityType, unsupportedQuery)).thenThrow(new UnknownIndexException("msg"));
    indexedRepositoryDecorator.findOne(unsupportedQuery);
}
Also used : UnknownIndexException(org.molgenis.data.index.exception.UnknownIndexException) Test(org.testng.annotations.Test)

Aggregations

UnknownIndexException (org.molgenis.data.index.exception.UnknownIndexException)12 ElasticsearchException (org.elasticsearch.ElasticsearchException)7 ResourceNotFoundException (org.elasticsearch.ResourceNotFoundException)7 IndexException (org.molgenis.data.index.exception.IndexException)7 Test (org.testng.annotations.Test)5 ShardSearchFailure (org.elasticsearch.action.search.ShardSearchFailure)4 SearchRequestBuilder (org.elasticsearch.action.search.SearchRequestBuilder)3 SearchResponse (org.elasticsearch.action.search.SearchResponse)3 DeleteIndexRequestBuilder (org.elasticsearch.action.admin.indices.delete.DeleteIndexRequestBuilder)2 DeleteIndexResponse (org.elasticsearch.action.admin.indices.delete.DeleteIndexResponse)2 AggregateQuery (org.molgenis.data.aggregation.AggregateQuery)2 ShardOperationFailedException (org.elasticsearch.action.ShardOperationFailedException)1 CreateIndexRequestBuilder (org.elasticsearch.action.admin.indices.create.CreateIndexRequestBuilder)1 CreateIndexResponse (org.elasticsearch.action.admin.indices.create.CreateIndexResponse)1 RefreshRequestBuilder (org.elasticsearch.action.admin.indices.refresh.RefreshRequestBuilder)1 RefreshResponse (org.elasticsearch.action.admin.indices.refresh.RefreshResponse)1 DeleteRequestBuilder (org.elasticsearch.action.delete.DeleteRequestBuilder)1 DeleteResponse (org.elasticsearch.action.delete.DeleteResponse)1 IndexRequestBuilder (org.elasticsearch.action.index.IndexRequestBuilder)1 IndexResponse (org.elasticsearch.action.index.IndexResponse)1