Examples with DataSet org.apache.flink.api.java.DataSet used on opensource projects

Example 41 with DataSet

use of org.apache.flink.api.java.DataSet in project camel by apache.

the class DataSetFlinkProducer method collectResults.

protected void collectResults(Exchange exchange, Object result) throws Exception {
    if (result instanceof DataSet) {
        DataSet dsResults = (DataSet) result;
        if (getEndpoint().isCollect()) {
            exchange.getIn().setBody(dsResults.collect());
        } else {
            exchange.getIn().setBody(result);
            exchange.getIn().setHeader(FlinkConstants.FLINK_DATASET_HEADER, result);
        }
    } else {
        exchange.getIn().setBody(result);
    }
}

Example 42 with DataSet

use of org.apache.flink.api.java.DataSet in project camel by apache.

the class FlinkProducerTest method shouldExecuteDataSetCallbackWithSinglePayload.

@Test
public void shouldExecuteDataSetCallbackWithSinglePayload() {
    Long linesCount = template.requestBodyAndHeader(flinkDataSetUri, 10, FlinkConstants.FLINK_DATASET_CALLBACK_HEADER, new DataSetCallback() {

        @Override
        public Object onDataSet(DataSet ds, Object... payloads) {
            try {
                return ds.count() * (int) payloads[0];
            } catch (Exception e) {
                return null;
            }
        }
    }, Long.class);
    Truth.assertThat(linesCount).isEqualTo(numberOfLinesInTestFile * 10);
}

Example 43 with DataSet

use of org.apache.flink.api.java.DataSet in project camel by apache.

the class FlinkProducerTest method shouldExecuteDataSetCallbackWithPayloads.

@Test
public void shouldExecuteDataSetCallbackWithPayloads() {
    Long linesCount = template.requestBodyAndHeader(flinkDataSetUri, Arrays.<Integer>asList(10, 10), FlinkConstants.FLINK_DATASET_CALLBACK_HEADER, new DataSetCallback() {

        @Override
        public Object onDataSet(DataSet ds, Object... payloads) {
            try {
                return ds.count() * (int) payloads[0] * (int) payloads[1];
            } catch (Exception e) {
                return null;
            }
        }
    }, Long.class);
    Truth.assertThat(linesCount).isEqualTo(numberOfLinesInTestFile * 10 * 10);
}