Search in sources :

Example 1 with InfluxDBSettings

use of org.apache.beam.sdk.testutils.publishing.InfluxDBSettings in project beam by apache.

the class Main method savePerfsToInfluxDB.

private static void savePerfsToInfluxDB(final NexmarkOptions options, final Map<String, String> schema, final Map<NexmarkConfiguration, NexmarkPerf> results, final long timestamp) {
    final InfluxDBSettings settings = getInfluxSettings(options);
    final Map<String, String> tags = options.getInfluxTags();
    final String runner = options.getRunner().getSimpleName();
    final List<Map<String, Object>> schemaResults = results.entrySet().stream().map(entry -> getResultsFromSchema(entry.getValue(), schema, timestamp, runner, produceMeasurement(options, entry))).collect(toList());
    InfluxDBPublisher.publishNexmarkResults(schemaResults, settings, tags);
}
Also used : Bid(org.apache.beam.sdk.nexmark.model.Bid) Duration(org.joda.time.Duration) Callable(java.util.concurrent.Callable) ImmutableMap(org.apache.beam.vendor.guava.v26_0_jre.com.google.common.collect.ImmutableMap) Auction(org.apache.beam.sdk.nexmark.model.Auction) PipelineOptionsFactory(org.apache.beam.sdk.options.PipelineOptionsFactory) CompletionService(java.util.concurrent.CompletionService) ArrayList(java.util.ArrayList) LinkedHashMap(java.util.LinkedHashMap) Collectors.toMap(java.util.stream.Collectors.toMap) InfluxDBSettings(org.apache.beam.sdk.testutils.publishing.InfluxDBSettings) Map(java.util.Map) NexmarkUtils.processingMode(org.apache.beam.sdk.nexmark.NexmarkUtils.processingMode) ExecutorService(java.util.concurrent.ExecutorService) Nullable(org.checkerframework.checker.nullness.qual.Nullable) Person(org.apache.beam.sdk.nexmark.model.Person) InfluxDBPublisher(org.apache.beam.sdk.testutils.publishing.InfluxDBPublisher) Files(java.nio.file.Files) StandardOpenOption(java.nio.file.StandardOpenOption) Set(java.util.Set) IOException(java.io.IOException) StandardCharsets(java.nio.charset.StandardCharsets) Executors(java.util.concurrent.Executors) ExecutionException(java.util.concurrent.ExecutionException) Collectors.toList(java.util.stream.Collectors.toList) List(java.util.List) Paths(java.nio.file.Paths) Instant(org.joda.time.Instant) ExecutorCompletionService(java.util.concurrent.ExecutorCompletionService) InfluxDBSettings(org.apache.beam.sdk.testutils.publishing.InfluxDBSettings) ImmutableMap(org.apache.beam.vendor.guava.v26_0_jre.com.google.common.collect.ImmutableMap) LinkedHashMap(java.util.LinkedHashMap) Collectors.toMap(java.util.stream.Collectors.toMap) Map(java.util.Map)

Aggregations

IOException (java.io.IOException)1 StandardCharsets (java.nio.charset.StandardCharsets)1 Files (java.nio.file.Files)1 Paths (java.nio.file.Paths)1 StandardOpenOption (java.nio.file.StandardOpenOption)1 ArrayList (java.util.ArrayList)1 LinkedHashMap (java.util.LinkedHashMap)1 List (java.util.List)1 Map (java.util.Map)1 Set (java.util.Set)1 Callable (java.util.concurrent.Callable)1 CompletionService (java.util.concurrent.CompletionService)1 ExecutionException (java.util.concurrent.ExecutionException)1 ExecutorCompletionService (java.util.concurrent.ExecutorCompletionService)1 ExecutorService (java.util.concurrent.ExecutorService)1 Executors (java.util.concurrent.Executors)1 Collectors.toList (java.util.stream.Collectors.toList)1 Collectors.toMap (java.util.stream.Collectors.toMap)1 NexmarkUtils.processingMode (org.apache.beam.sdk.nexmark.NexmarkUtils.processingMode)1 Auction (org.apache.beam.sdk.nexmark.model.Auction)1