Search in sources :

Example 1 with ChainingHttpRequestInitializer

use of com.google.cloud.hadoop.util.ChainingHttpRequestInitializer in project beam by apache.

the class BigQueryServicesImpl method newBigQueryClient.

/**
 * Returns a BigQuery client builder using the specified {@link BigQueryOptions}.
 */
private static Bigquery.Builder newBigQueryClient(BigQueryOptions options) {
    // Do not log 404. It clutters the output and is possibly even required by the
    // caller.
    RetryHttpRequestInitializer httpRequestInitializer = new RetryHttpRequestInitializer(ImmutableList.of(404));
    httpRequestInitializer.setCustomErrors(createBigQueryClientCustomErrors());
    httpRequestInitializer.setWriteTimeout(options.getHTTPWriteTimeout());
    ImmutableList.Builder<HttpRequestInitializer> initBuilder = ImmutableList.builder();
    Credentials credential = options.getGcpCredential();
    initBuilder.add(credential == null ? new NullCredentialInitializer() : new HttpCredentialsAdapter(credential));
    initBuilder.add(new LatencyRecordingHttpRequestInitializer(API_METRIC_LABEL));
    initBuilder.add(httpRequestInitializer);
    HttpRequestInitializer chainInitializer = new ChainingHttpRequestInitializer(Iterables.toArray(initBuilder.build(), HttpRequestInitializer.class));
    return new Bigquery.Builder(Transport.getTransport(), Transport.getJsonFactory(), chainInitializer).setApplicationName(options.getAppName()).setGoogleClientRequestInitializer(options.getGoogleApiTrace());
}
Also used : RetryHttpRequestInitializer(org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer) HttpCredentialsAdapter(com.google.auth.http.HttpCredentialsAdapter) ImmutableList(org.apache.beam.vendor.guava.v26_0_jre.com.google.common.collect.ImmutableList) LatencyRecordingHttpRequestInitializer(org.apache.beam.sdk.extensions.gcp.util.LatencyRecordingHttpRequestInitializer) ChainingHttpRequestInitializer(com.google.cloud.hadoop.util.ChainingHttpRequestInitializer) RetryHttpRequestInitializer(org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer) LatencyRecordingHttpRequestInitializer(org.apache.beam.sdk.extensions.gcp.util.LatencyRecordingHttpRequestInitializer) HttpRequestInitializer(com.google.api.client.http.HttpRequestInitializer) NullCredentialInitializer(org.apache.beam.sdk.extensions.gcp.auth.NullCredentialInitializer) Credentials(com.google.auth.Credentials) ChainingHttpRequestInitializer(com.google.cloud.hadoop.util.ChainingHttpRequestInitializer)

Example 2 with ChainingHttpRequestInitializer

use of com.google.cloud.hadoop.util.ChainingHttpRequestInitializer in project beam by apache.

the class V1TestUtil method getDatastore.

/**
 * Build a new datastore client.
 */
static Datastore getDatastore(PipelineOptions pipelineOptions, String projectId) {
    Credentials credential = pipelineOptions.as(GcpOptions.class).getGcpCredential();
    HttpRequestInitializer initializer;
    if (credential != null) {
        initializer = new ChainingHttpRequestInitializer(new HttpCredentialsAdapter(credential), new RetryHttpRequestInitializer());
    } else {
        initializer = new RetryHttpRequestInitializer();
    }
    DatastoreOptions.Builder builder = new DatastoreOptions.Builder().projectId(projectId).initializer(initializer);
    return DatastoreFactory.get().create(builder.build());
}
Also used : RetryHttpRequestInitializer(org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer) GcpOptions(org.apache.beam.sdk.extensions.gcp.options.GcpOptions) HttpCredentialsAdapter(com.google.auth.http.HttpCredentialsAdapter) DatastoreOptions(com.google.datastore.v1.client.DatastoreOptions) HttpRequestInitializer(com.google.api.client.http.HttpRequestInitializer) RetryHttpRequestInitializer(org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer) ChainingHttpRequestInitializer(com.google.cloud.hadoop.util.ChainingHttpRequestInitializer) Credentials(com.google.auth.Credentials) ChainingHttpRequestInitializer(com.google.cloud.hadoop.util.ChainingHttpRequestInitializer)

Aggregations

HttpRequestInitializer (com.google.api.client.http.HttpRequestInitializer)2 Credentials (com.google.auth.Credentials)2 HttpCredentialsAdapter (com.google.auth.http.HttpCredentialsAdapter)2 ChainingHttpRequestInitializer (com.google.cloud.hadoop.util.ChainingHttpRequestInitializer)2 RetryHttpRequestInitializer (org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer)2 DatastoreOptions (com.google.datastore.v1.client.DatastoreOptions)1 NullCredentialInitializer (org.apache.beam.sdk.extensions.gcp.auth.NullCredentialInitializer)1 GcpOptions (org.apache.beam.sdk.extensions.gcp.options.GcpOptions)1 LatencyRecordingHttpRequestInitializer (org.apache.beam.sdk.extensions.gcp.util.LatencyRecordingHttpRequestInitializer)1 ImmutableList (org.apache.beam.vendor.guava.v26_0_jre.com.google.common.collect.ImmutableList)1