Examples with RowFormatter com.datastax.oss.dsbulk.format.row.RowFormatter used on opensource projects

Example 1 with RowFormatter

use of com.datastax.oss.dsbulk.format.row.RowFormatter in project dsbulk by datastax.

the class LogManagerTest method should_stop_when_sample_size_is_met_and_percentage_exceeded.

@Test
void should_stop_when_sample_size_is_met_and_percentage_exceeded() throws Exception {
    Path outputDir = Files.createTempDirectory("test");
    LogManager logManager = new LogManager(session, outputDir, ErrorThreshold.forRatio(0.01f, 100), ErrorThreshold.forAbsoluteValue(0), true, statementFormatter, EXTENDED, rowFormatter);
    logManager.init();
    Flux<ReadResult> stmts = Flux.just(failedReadResult1);
    try {
        stmts.repeat(101).transform(logManager.newTotalItemsCounter()).transform(logManager.newFailedReadsHandler()).blockLast();
        fail("Expecting TooManyErrorsException to be thrown");
    } catch (TooManyErrorsException e) {
        assertThat(e).hasMessage("Too many errors, the maximum allowed is 1%.");
        Assertions.assertThat(((RatioErrorThreshold) e.getThreshold()).getMaxErrorRatio()).isEqualTo(0.01f);
    }
    logManager.close();
    Path errors = logManager.getOperationDirectory().resolve("unload-errors.log");
    assertThat(errors.toFile()).exists();
    assertThat(FileUtils.listAllFilesInDirectory(logManager.getOperationDirectory())).containsOnly(errors);
    List<String> lines = Files.readAllLines(errors, UTF_8);
    assertThat(lines.stream().filter(l -> l.contains("BulkExecutionException")).count()).isEqualTo(100);
}

Example 2 with RowFormatter

use of com.datastax.oss.dsbulk.format.row.RowFormatter in project dsbulk by datastax.

the class LogSettings method newLogManager.

public LogManager newLogManager(CqlSession session, boolean trackPositions) {
    StatementFormatter statementFormatter = StatementFormatter.builder().withMaxQueryStringLength(maxQueryStringLength).withMaxBoundValueLength(maxBoundValueLength).withMaxBoundValues(maxBoundValues).withMaxInnerStatements(maxInnerStatements).addStatementPrinters(new MappedBoundStatementPrinter()).build();
    RowFormatter rowFormatter = new RowFormatter(maxResultSetValueLength, maxResultSetValues);
    return new LogManager(session, operationDirectory, errorThreshold, queryWarningsThreshold, trackPositions, statementFormatter, level, rowFormatter);
}