Search in sources :

Example 6 with AuthorisationException

use of com.atlassian.stash.exception.AuthorisationException in project stashbot by palantir.

the class RepoConfigurationServletTest method postTestWhenLockedDst.

@Test
public void postTestWhenLockedDst() throws Exception {
    when(jsc.getLocked()).thenReturn(false);
    when(jsc2.getLocked()).thenReturn(true);
    Exception permissionException = new AuthorisationException(new KeyedMessage("permission exceptionz", null, null));
    Mockito.doThrow(permissionException).when(pvs).validateForGlobal(Permission.SYS_ADMIN);
    when(req.getParameter("jenkinsServerName")).thenReturn("default2");
    when(cpm.getRepositoryConfigurationForRepository(mockRepo)).thenReturn(rc);
    rcs.doPost(req, res);
    verify(res).sendError(Mockito.anyInt(), Mockito.anyString());
}
Also used : AuthorisationException(com.atlassian.stash.exception.AuthorisationException) KeyedMessage(com.atlassian.stash.i18n.KeyedMessage) AuthorisationException(com.atlassian.stash.exception.AuthorisationException) Test(org.junit.Test)

Example 7 with AuthorisationException

use of com.atlassian.stash.exception.AuthorisationException in project stash-codesearch-plugin by palantir.

the class GlobalSettingsServletTest method getTestWhenNotLoggedIn.

@Test
public void getTestWhenNotLoggedIn() throws Exception {
    Mockito.doThrow(new AuthorisationException(new KeyedMessage("testException", "testException", "testException"))).when(pvs).validateAuthenticated();
    servlet.doGet(req, res);
    Mockito.verify(res).sendRedirect(Mockito.anyString());
    Mockito.verify(res, Mockito.never()).getWriter();
}
Also used : AuthorisationException(com.atlassian.stash.exception.AuthorisationException) KeyedMessage(com.atlassian.stash.i18n.KeyedMessage) Test(org.junit.Test)

Example 8 with AuthorisationException

use of com.atlassian.stash.exception.AuthorisationException in project stash-codesearch-plugin by palantir.

the class RepositoryServiceManagerImpl method getRepositoryMap.

@Override
public ImmutableMap<String, Repository> getRepositoryMap(PermissionValidationService validationService) {
    PageRequest req = new PageRequestImpl(0, PAGE_SIZE);
    Map<String, Repository> repoMap = new HashMap<String, Repository>();
    while (true) {
        Page<? extends Repository> repoPage = repositoryService.findAll(req);
        for (Repository r : repoPage.getValues()) {
            try {
                if (validationService != null) {
                    validationService.validateForRepository(r, Permission.REPO_READ);
                }
                final String key = r.getProject().getKey() + "^" + r.getSlug();
                if (repoMap.containsKey(key)) {
                    // ITOOLS-13350
                    log.error("Trying to insert existing key '" + key + "' intp repoMap with value " + r.toString());
                    continue;
                }
                repoMap.put(key, r);
            } catch (AuthorisationException e) {
            // User doesn't have permission to access the repo
            }
        }
        if (repoPage.getIsLastPage()) {
            break;
        }
        req = repoPage.getNextPageRequest();
    }
    return ImmutableMap.copyOf(repoMap);
}
Also used : PageRequest(com.atlassian.stash.util.PageRequest) Repository(com.atlassian.stash.repository.Repository) HashMap(java.util.HashMap) PageRequestImpl(com.atlassian.stash.util.PageRequestImpl) AuthorisationException(com.atlassian.stash.exception.AuthorisationException)

Example 9 with AuthorisationException

use of com.atlassian.stash.exception.AuthorisationException in project stash-codesearch-plugin by palantir.

the class SearchServlet method doGet.

@Override
protected void doGet(HttpServletRequest req, HttpServletResponse resp) throws ServletException, IOException {
    // Make sure user is logged in
    try {
        validationService.validateAuthenticated();
    } catch (AuthorisationException notLoggedInException) {
        try {
            resp.sendRedirect(propertiesService.getLoginUri(URI.create(req.getRequestURL() + (req.getQueryString() == null ? "" : "?" + req.getQueryString()))).toASCIIString());
        } catch (Exception e) {
            log.error("Unable to redirect unauthenticated user to login page", e);
        }
        return;
    }
    // Query and parse settings
    SearchParams params = SearchParams.getParams(req, DateTimeZone.forTimeZone(propertiesService.getDefaultTimeZone()));
    GlobalSettings globalSettings = settingsManager.getGlobalSettings();
    ImmutableSet.Builder<String> noHighlightBuilder = new ImmutableSet.Builder<String>();
    for (String extension : globalSettings.getNoHighlightExtensions().split(",")) {
        extension = extension.trim().toLowerCase();
        if (!extension.isEmpty()) {
            noHighlightBuilder.add(extension);
        }
    }
    ImmutableSet<String> noHighlight = noHighlightBuilder.build();
    int maxPreviewLines = globalSettings.getMaxPreviewLines();
    int maxMatchLines = globalSettings.getMaxMatchLines();
    int maxFragments = globalSettings.getMaxFragments();
    int pageSize = globalSettings.getPageSize();
    TimeValue searchTimeout = new TimeValue(globalSettings.getSearchTimeout());
    float commitHashBoost = (float) globalSettings.getCommitHashBoost();
    float commitSubjectBoost = (float) globalSettings.getCommitBodyBoost();
    float commitBodyBoost = (float) globalSettings.getCommitBodyBoost();
    float fileNameBoost = (float) globalSettings.getFileNameBoost();
    // Execute ES query
    int pages = 0;
    long totalHits = 0;
    long searchTime = 0;
    SearchHit[] currentHits = {};
    String error = "";
    ArrayList<ImmutableMap<String, Object>> hitArray = new ArrayList<ImmutableMap<String, Object>>(currentHits.length);
    ImmutableMap<String, Object> statistics = ImmutableMap.of();
    if (params.doSearch) {
        // Repo map is null iff user is a system administrator (don't need to validate permissions).
        ImmutableMap<String, Repository> repoMap;
        try {
            validationService.validateForGlobal(Permission.SYS_ADMIN);
            repoMap = null;
        } catch (AuthorisationException e) {
            repoMap = repositoryServiceManager.getRepositoryMap(validationService);
            if (repoMap.isEmpty()) {
                error = "You do not have permissions to access any repositories";
            }
        }
        int startIndex = params.page * pageSize;
        SearchRequestBuilder esReq = es.getClient().prepareSearch(ES_SEARCHALIAS).setFrom(startIndex).setSize(pageSize).setTimeout(searchTimeout).setFetchSource(true);
        if (error != null && !error.isEmpty()) {
            log.warn("Not performing search due to error {}", error);
        } else {
            // Build query source and perform query
            QueryBuilder query = matchAllQuery();
            if (params.searchString != null && !params.searchString.isEmpty()) {
                QueryStringQueryBuilder queryStringQuery = queryString(params.searchString).analyzeWildcard(true).lenient(true).defaultOperator(QueryStringQueryBuilder.Operator.AND);
                if (params.searchCommits) {
                    queryStringQuery.field("commit.subject", commitSubjectBoost).field("commit.hash", commitHashBoost).field("commit.body", commitBodyBoost);
                }
                if (params.searchFilenames) {
                    queryStringQuery.field("file.path", fileNameBoost);
                }
                if (params.searchCode) {
                    queryStringQuery.field("file.contents", 1);
                }
                query = queryStringQuery;
            }
            FilterBuilder filter = andFilter(boolFilter().must(repoMap == null ? matchAllFilter() : sf.aclFilter(repoMap), sf.refFilter(params.refNames.split(",")), sf.projectFilter(params.projectKeys.split(",")), sf.repositoryFilter(params.repoNames.split(",")), sf.extensionFilter(params.extensions.split(",")), sf.authorFilter(params.authorNames.split(","))), sf.dateRangeFilter(params.committedAfter, params.committedBefore));
            FilteredQueryBuilder finalQuery = filteredQuery(query, filter);
            esReq.setQuery(finalQuery).setHighlighterPreTags("").setHighlighterPostTags("").addHighlightedField("contents", 1, maxFragments);
            String[] typeArray = {};
            if (params.searchCommits) {
                if (params.searchFilenames || params.searchCode) {
                    typeArray = new String[] { "commit", "file" };
                } else {
                    typeArray = new String[] { "commit" };
                }
            } else if (params.searchFilenames || params.searchCode) {
                typeArray = new String[] { "file" };
            }
            esReq.setTypes(typeArray);
            // Build aggregations if statistics were requested
            if (params.showStatistics) {
                esReq.addAggregation(cardinality("authorCardinality").field("authoremail.untouched").precisionThreshold(1000)).addAggregation(terms("authorRanking").field("authoremail.untouched").size(25)).addAggregation(percentiles("charcountPercentiles").field("charcount").percentiles(PERCENTILES)).addAggregation(extendedStats("charcountStats").field("charcount")).addAggregation(filter("commitCount").filter(typeFilter("commit"))).addAggregation(cardinality("extensionCardinality").field("extension").precisionThreshold(1000)).addAggregation(terms("extensionRanking").field("extension").size(25)).addAggregation(percentiles("linecountPercentiles").field("linecount").percentiles(PERCENTILES)).addAggregation(extendedStats("linecountStats").field("linecount"));
            }
            SearchResponse esResp = null;
            try {
                esResp = esReq.get();
            } catch (SearchPhaseExecutionException e) {
                log.warn("Query failure", e);
                error = "Make sure your query conforms to the Lucene/Elasticsearch query string syntax.";
            }
            if (esResp != null) {
                SearchHits esHits = esResp.getHits();
                totalHits = esHits.getTotalHits();
                pages = (int) Math.min(Integer.MAX_VALUE, (totalHits + pageSize - 1) / pageSize);
                currentHits = esHits.getHits();
                searchTime = esResp.getTookInMillis();
                for (ShardSearchFailure failure : esResp.getShardFailures()) {
                    log.warn("Shard failure {}", failure.reason());
                    if (error == null || error.isEmpty()) {
                        error = "Shard failure: " + failure.reason();
                    }
                }
                Aggregations aggs = esResp.getAggregations();
                if (params.showStatistics && aggs != null && !aggs.asList().isEmpty()) {
                    Cardinality authorCardinality = aggs.get("authorCardinality");
                    Terms authorRanking = aggs.get("authorRanking");
                    Percentiles charcountPercentiles = aggs.get("charcountPercentiles");
                    Filter commitCount = aggs.get("commitCount");
                    ExtendedStats charcountStats = aggs.get("charcountStats");
                    Cardinality extensionCardinality = aggs.get("extensionCardinality");
                    Terms extensionRanking = aggs.get("extensionRanking");
                    Percentiles linecountPercentiles = aggs.get("linecountPercentiles");
                    ExtendedStats linecountStats = aggs.get("linecountStats");
                    statistics = new ImmutableMap.Builder<String, Object>().put("authorCardinality", authorCardinality.getValue()).put("authorRanking", getSoyRankingList(authorRanking, commitCount.getDocCount())).put("charcount", new ImmutableMap.Builder<String, Object>().put("average", charcountStats.getAvg()).put("max", Math.round(charcountStats.getMax())).put("min", Math.round(charcountStats.getMin())).put("percentiles", getSoyPercentileList(charcountPercentiles, PERCENTILES)).put("sum", Math.round(charcountStats.getSum())).build()).put("commitcount", commitCount.getDocCount()).put("extensionCardinality", extensionCardinality.getValue()).put("extensionRanking", getSoyRankingList(extensionRanking, charcountStats.getCount())).put("filecount", charcountStats.getCount()).put("linecount", new ImmutableMap.Builder<String, Object>().put("average", linecountStats.getAvg()).put("max", Math.round(linecountStats.getMax())).put("min", Math.round(linecountStats.getMin())).put("percentiles", getSoyPercentileList(linecountPercentiles, PERCENTILES)).put("sum", Math.round(linecountStats.getSum())).build()).build();
                }
            }
        }
        // Iterate through current page of search hits
        for (SearchHit hit : currentHits) {
            ImmutableMap<String, Object> hitData = searchHitToDataMap(hit, repoMap, maxPreviewLines, maxMatchLines, noHighlight);
            if (hitData != null) {
                hitArray.add(hitData);
            }
        }
    }
    // Render page
    pbs.assembler().resources().requireContext("com.atlassian.auiplugin:aui-date-picker");
    pbs.assembler().resources().requireContext("com.atlassian.auiplugin:aui-experimental-tooltips");
    pbs.assembler().resources().requireWebResource("com.palantir.stash.stash-code-search:scs-resources");
    resp.setContentType("text/html");
    try {
        String queryString = req.getQueryString();
        String fullUri = req.getRequestURI() + "?" + (queryString == null ? "" : queryString.replaceAll("&?page=\\d*", ""));
        ImmutableMap<String, Object> data = new ImmutableMap.Builder<String, Object>().put("pages", pages).put("currentPage", params.page).put("prevParams", params.soyParams).put("doSearch", params.doSearch).put("totalHits", totalHits).put("hitArray", hitArray).put("statistics", statistics).put("error", error).put("fullUri", fullUri).put("baseUrl", propertiesService.getBaseUrl().toASCIIString()).put("resultFrom", Math.min(totalHits, params.page * pageSize + 1)).put("resultTo", Math.min(totalHits, (params.page + 1) * pageSize)).put("searchTime", searchTime).build();
        soyTemplateRenderer.render(resp.getWriter(), "com.palantir.stash.stash-code-search:codesearch-soy", "plugin.page.codesearch.searchPage", data);
    } catch (Exception e) {
        log.error("Error rendering Soy template", e);
    }
}
Also used : SearchHit(org.elasticsearch.search.SearchHit) Aggregations(org.elasticsearch.search.aggregations.Aggregations) FilterBuilder(org.elasticsearch.index.query.FilterBuilder) QueryStringQueryBuilder(org.elasticsearch.index.query.QueryStringQueryBuilder) QueryBuilder(org.elasticsearch.index.query.QueryBuilder) FilteredQueryBuilder(org.elasticsearch.index.query.FilteredQueryBuilder) SearchRequestBuilder(org.elasticsearch.action.search.SearchRequestBuilder) SearchPhaseExecutionException(org.elasticsearch.action.search.SearchPhaseExecutionException) ArrayList(java.util.ArrayList) ExtendedStats(org.elasticsearch.search.aggregations.metrics.stats.extended.ExtendedStats) QueryBuilders.queryString(org.elasticsearch.index.query.QueryBuilders.queryString) QueryStringQueryBuilder(org.elasticsearch.index.query.QueryStringQueryBuilder) QueryBuilder(org.elasticsearch.index.query.QueryBuilder) FilteredQueryBuilder(org.elasticsearch.index.query.FilteredQueryBuilder) ImmutableSet(com.google.common.collect.ImmutableSet) FilterBuilder(org.elasticsearch.index.query.FilterBuilder) SearchHits(org.elasticsearch.search.SearchHits) ShardSearchFailure(org.elasticsearch.action.search.ShardSearchFailure) AuthorisationException(com.atlassian.stash.exception.AuthorisationException) TimeValue(org.elasticsearch.common.unit.TimeValue) SearchRequestBuilder(org.elasticsearch.action.search.SearchRequestBuilder) Cardinality(org.elasticsearch.search.aggregations.metrics.cardinality.Cardinality) Terms(org.elasticsearch.search.aggregations.bucket.terms.Terms) GlobalSettings(com.palantir.stash.codesearch.admin.GlobalSettings) Percentiles(org.elasticsearch.search.aggregations.metrics.percentiles.Percentiles) ServletException(javax.servlet.ServletException) AuthorisationException(com.atlassian.stash.exception.AuthorisationException) SearchPhaseExecutionException(org.elasticsearch.action.search.SearchPhaseExecutionException) IOException(java.io.IOException) ImmutableMap(com.google.common.collect.ImmutableMap) SearchResponse(org.elasticsearch.action.search.SearchResponse) Repository(com.atlassian.stash.repository.Repository) FilterBuilders.matchAllFilter(org.elasticsearch.index.query.FilterBuilders.matchAllFilter) FilterBuilders.boolFilter(org.elasticsearch.index.query.FilterBuilders.boolFilter) Filter(org.elasticsearch.search.aggregations.bucket.filter.Filter) FilterBuilders.andFilter(org.elasticsearch.index.query.FilterBuilders.andFilter) FilterBuilders.typeFilter(org.elasticsearch.index.query.FilterBuilders.typeFilter) FilteredQueryBuilder(org.elasticsearch.index.query.FilteredQueryBuilder) QueryStringQueryBuilder(org.elasticsearch.index.query.QueryStringQueryBuilder)

Example 10 with AuthorisationException

use of com.atlassian.stash.exception.AuthorisationException in project stashbot by palantir.

the class JenkinsConfigurationServletTest method getTestWhenNotLoggedIn.

@Test
public void getTestWhenNotLoggedIn() throws Exception {
    when(req.getRemoteUser()).thenReturn(null);
    doThrow(new AuthorisationException(new KeyedMessage("testException", "testException", "testException"))).when(pvs).validateAuthenticated();
    jcs.doGet(req, res);
    verify(res).sendRedirect(Mockito.anyString());
    verify(res, Mockito.never()).getWriter();
}
Also used : AuthorisationException(com.atlassian.stash.exception.AuthorisationException) KeyedMessage(com.atlassian.stash.i18n.KeyedMessage) Test(org.junit.Test)

Aggregations

AuthorisationException (com.atlassian.stash.exception.AuthorisationException)12 KeyedMessage (com.atlassian.stash.i18n.KeyedMessage)7 Test (org.junit.Test)7 Repository (com.atlassian.stash.repository.Repository)5 ImmutableMap (com.google.common.collect.ImmutableMap)3 JenkinsServerConfiguration (com.palantir.stash.stashbot.persistence.JenkinsServerConfiguration)3 IOException (java.io.IOException)3 SQLException (java.sql.SQLException)3 ServletException (javax.servlet.ServletException)3 SoyException (com.atlassian.soy.renderer.SoyException)2 PageRequest (com.atlassian.stash.util.PageRequest)2 PageRequestImpl (com.atlassian.stash.util.PageRequestImpl)2 RepositoryConfiguration (com.palantir.stash.stashbot.persistence.RepositoryConfiguration)2 ArrayList (java.util.ArrayList)2 HashMap (java.util.HashMap)2 PullRequest (com.atlassian.stash.pull.PullRequest)1 PullRequestSearchRequest (com.atlassian.stash.pull.PullRequestSearchRequest)1 ImmutableList (com.google.common.collect.ImmutableList)1 ImmutableSet (com.google.common.collect.ImmutableSet)1 GlobalSettings (com.palantir.stash.codesearch.admin.GlobalSettings)1