Examples with IOITMetrics org.apache.beam.sdk.testutils.metrics.IOITMetrics used on opensource projects

Example 1 with IOITMetrics

use of org.apache.beam.sdk.testutils.metrics.IOITMetrics in project beam by apache.

the class TextIOIT method collectAndPublishMetrics.

private void collectAndPublishMetrics(PipelineResult result) {
    String uuid = UUID.randomUUID().toString();
    Timestamp timestamp = Timestamp.now();
    Set<Function<MetricsReader, NamedTestResult>> metricSuppliers = fillMetricSuppliers(uuid, timestamp.toString());
    final IOITMetrics metrics = new IOITMetrics(metricSuppliers, result, FILEIOIT_NAMESPACE, uuid, timestamp.toString());
    metrics.publishToInflux(settings);
}

Example 2 with IOITMetrics

use of org.apache.beam.sdk.testutils.metrics.IOITMetrics in project beam by apache.

the class XmlIOIT method collectAndPublishResults.

private void collectAndPublishResults(PipelineResult result) {
    String uuid = UUID.randomUUID().toString();
    String timestamp = Timestamp.now().toString();
    Set<Function<MetricsReader, NamedTestResult>> metricSuppliers = fillMetricSuppliers(uuid, timestamp);
    final IOITMetrics metrics = new IOITMetrics(metricSuppliers, result, XMLIOIT_NAMESPACE, uuid, timestamp);
    metrics.publishToInflux(settings);
}

Example 3 with IOITMetrics

use of org.apache.beam.sdk.testutils.metrics.IOITMetrics in project beam by apache.

the class HadoopFormatIOIT method collectAndPublishMetrics.

private void collectAndPublishMetrics(PipelineResult writeResult, PipelineResult readResult) {
    String uuid = UUID.randomUUID().toString();
    String timestamp = Timestamp.now().toString();
    Set<Function<MetricsReader, NamedTestResult>> readSuppliers = getReadSuppliers(uuid, timestamp);
    Set<Function<MetricsReader, NamedTestResult>> writeSuppliers = getWriteSuppliers(uuid, timestamp);
    IOITMetrics readMetrics = new IOITMetrics(readSuppliers, readResult, NAMESPACE, uuid, timestamp);
    IOITMetrics writeMetrics = new IOITMetrics(writeSuppliers, writeResult, NAMESPACE, uuid, timestamp);
    readMetrics.publishToInflux(settings);
    writeMetrics.publishToInflux(settings);
}

Example 4 with IOITMetrics

use of org.apache.beam.sdk.testutils.metrics.IOITMetrics in project beam by apache.

the class MongoDBIOIT method collectAndPublishMetrics.

private void collectAndPublishMetrics(PipelineResult writeResult, PipelineResult readResult) {
    String uuid = UUID.randomUUID().toString();
    String timestamp = Timestamp.now().toString();
    Set<Function<MetricsReader, NamedTestResult>> readSuppliers = getReadSuppliers(uuid, timestamp);
    Set<Function<MetricsReader, NamedTestResult>> writeSuppliers = getWriteSuppliers(uuid, timestamp);
    IOITMetrics readMetrics = new IOITMetrics(readSuppliers, readResult, NAMESPACE, uuid, timestamp);
    IOITMetrics writeMetrics = new IOITMetrics(writeSuppliers, writeResult, NAMESPACE, uuid, timestamp);
    readMetrics.publishToInflux(settings);
    writeMetrics.publishToInflux(settings);
}

Example 5 with IOITMetrics

use of org.apache.beam.sdk.testutils.metrics.IOITMetrics in project beam by apache.

the class BigQueryIOPushDownIT method collectAndPublishMetrics.

private void collectAndPublishMetrics(PipelineResult readResult, String postfix) {
    String uuid = UUID.randomUUID().toString();
    String timestamp = Timestamp.now().toString();
    Set<Function<MetricsReader, NamedTestResult>> readSuppliers = getReadSuppliers(uuid, timestamp);
    IOITMetrics readMetrics = new IOITMetrics(readSuppliers, readResult, NAMESPACE, uuid, timestamp);
    readMetrics.publishToInflux(settings.copyWithMeasurement(settings.measurement + postfix));
}