Search in sources :

Example 1 with Stream

use of co.cask.cdap.api.data.stream.Stream in project cdap by caskdata.

the class DefaultDatasetConfigurer method addStream.

@Override
public void addStream(String streamName) {
    checkArgument(streamName != null && !streamName.isEmpty(), "Stream Name cannot be null or empty");
    addStream(new Stream(streamName));
}
Also used : Stream(co.cask.cdap.api.data.stream.Stream)

Example 2 with Stream

use of co.cask.cdap.api.data.stream.Stream in project cdap by caskdata.

the class AllProgramsApp method configure.

@Override
public void configure() {
    setName(NAME);
    setDescription("Application which has everything");
    addStream(new Stream(STREAM_NAME, "test stream"));
    createDataset(DATASET_NAME, KeyValueTable.class, DatasetProperties.builder().setDescription("test dataset").build());
    createDataset(DATASET_NAME2, KeyValueTable.class);
    createDataset(DATASET_NAME3, KeyValueTable.class);
    addFlow(new NoOpFlow());
    addMapReduce(new NoOpMR());
    addMapReduce(new NoOpMR2());
    addWorkflow(new NoOpWorkflow());
    addWorker(new NoOpWorker());
    addSpark(new NoOpSpark());
    addService(new NoOpService());
    schedule(buildSchedule(SCHEDULE_NAME, ProgramType.WORKFLOW, NoOpWorkflow.NAME).setDescription(SCHEDULE_DESCRIPTION).triggerByTime("* * * * *"));
    try {
        createDataset(DS_WITH_SCHEMA_NAME, ObjectMappedTable.class, ObjectMappedTableProperties.builder().setType(DsSchema.class).setDescription("test object mapped table").build());
    } catch (UnsupportedTypeException e) {
    // ignore for test
    }
}
Also used : UnsupportedTypeException(co.cask.cdap.api.data.schema.UnsupportedTypeException) Stream(co.cask.cdap.api.data.stream.Stream) InputStream(java.io.InputStream)

Example 3 with Stream

use of co.cask.cdap.api.data.stream.Stream in project cdap by caskdata.

the class AppWithDataset method configure.

@Override
public void configure() {
    setDescription("Application with Dataset");
    addStream(new Stream("mystream"));
    createDataset("myds", KeyValueTable.class);
    addService(new BasicService("PingService", new PingHandler()));
}
Also used : BasicService(co.cask.cdap.api.service.BasicService) Stream(co.cask.cdap.api.data.stream.Stream)

Example 4 with Stream

use of co.cask.cdap.api.data.stream.Stream in project cdap by caskdata.

the class DummyAppWithTrackingTable method configure.

@Override
public void configure() {
    setName("dummy");
    setDescription("dummy app with a dataset that tracks open and close");
    addStream(new Stream("xx"));
    createDataset("foo", TrackingTable.class);
    createDataset("bar", TrackingTable.class);
    addFlow(new DummyFlow());
    addMapReduce(new DummyBatch());
    addService(new BasicService("DummyService", new DummyHandler()));
}
Also used : BasicService(co.cask.cdap.api.service.BasicService) Stream(co.cask.cdap.api.data.stream.Stream)

Example 5 with Stream

use of co.cask.cdap.api.data.stream.Stream in project cdap by caskdata.

the class FlowMapReduceApp method configure.

@Override
public void configure() {
    setName("App");
    setDescription("Application which has everything");
    addStream(new Stream("stream"));
    createDataset("kvt", KeyValueTable.class);
    addFlow(new AllProgramsApp.NoOpFlow());
    addMapReduce(new AllProgramsApp.NoOpMR());
    addService(new AllProgramsApp.NoOpService());
    addWorker(new AllProgramsApp.NoOpWorker());
    addSpark(new AllProgramsApp.NoOpSpark());
}
Also used : Stream(co.cask.cdap.api.data.stream.Stream)

Aggregations

Stream (co.cask.cdap.api.data.stream.Stream)48 UnsupportedTypeException (co.cask.cdap.api.data.schema.UnsupportedTypeException)10 BasicService (co.cask.cdap.api.service.BasicService)6 InputStream (java.io.InputStream)2 Schema (co.cask.cdap.api.data.schema.Schema)1 KeyValueTable (co.cask.cdap.api.dataset.lib.KeyValueTable)1 Table (co.cask.cdap.api.dataset.table.Table)1 AvroKeyOutputFormat (org.apache.avro.mapreduce.AvroKeyOutputFormat)1 TextOutputFormat (org.apache.hadoop.mapreduce.lib.output.TextOutputFormat)1