Search in sources :

Example 1 with KafkaDatastoreProperties

use of org.talend.components.kafka.datastore.KafkaDatastoreProperties in project components by Talend.

the class KafkaDatastoreTestIT method init.

@Before
public void init() throws TimeoutException {
    datastoreProperties = new KafkaDatastoreProperties("datastoreProperties");
    datastoreProperties.init();
    runtime = new KafkaDatastoreRuntime();
    runtime.initialize(null, datastoreProperties);
}
Also used : KafkaDatastoreProperties(org.talend.components.kafka.datastore.KafkaDatastoreProperties) Before(org.junit.Before)

Example 2 with KafkaDatastoreProperties

use of org.talend.components.kafka.datastore.KafkaDatastoreProperties in project components by Talend.

the class KafkaTestConstants method createDatastore.

public static KafkaDatastoreProperties createDatastore() {
    KafkaDatastoreProperties datastore = new KafkaDatastoreProperties("datastore");
    datastore.init();
    datastore.brokers.setValue(KafkaTestConstants.BOOTSTRAP_HOST);
    return datastore;
}
Also used : KafkaDatastoreProperties(org.talend.components.kafka.datastore.KafkaDatastoreProperties)

Example 3 with KafkaDatastoreProperties

use of org.talend.components.kafka.datastore.KafkaDatastoreProperties in project components by Talend.

the class KafkaConnection method createConnProps.

private static Properties createConnProps(KafkaDatastoreProperties datastore) {
    Properties props = new Properties();
    Map<String, String> consumerMaps = createConnMaps(datastore, false);
    for (String key : consumerMaps.keySet()) {
        props.setProperty(key, consumerMaps.get(key));
    }
    return props;
}
Also used : Properties(java.util.Properties) KafkaInputProperties(org.talend.components.kafka.input.KafkaInputProperties) KafkaDatastoreProperties(org.talend.components.kafka.datastore.KafkaDatastoreProperties) KafkaOutputProperties(org.talend.components.kafka.output.KafkaOutputProperties) KafkaConfTableProperties(org.talend.components.kafka.KafkaConfTableProperties)

Example 4 with KafkaDatastoreProperties

use of org.talend.components.kafka.datastore.KafkaDatastoreProperties in project components by Talend.

the class KafkaCsvBeamRuntimeTestIT method init.

@Before
public void init() {
    datastoreProperties = new KafkaDatastoreProperties("datastore");
    datastoreProperties.init();
    datastoreProperties.brokers.setValue(BOOTSTRAP_HOST);
    inputDatasetProperties = new KafkaDatasetProperties("inputDataset");
    inputDatasetProperties.init();
    inputDatasetProperties.setDatastoreProperties(datastoreProperties);
    inputDatasetProperties.topic.setValue(TOPIC_IN);
    inputDatasetProperties.valueFormat.setValue(KafkaDatasetProperties.ValueFormat.CSV);
    // no schema defined
    outputDatasetProperties = new KafkaDatasetProperties("outputDataset");
    outputDatasetProperties.init();
    outputDatasetProperties.setDatastoreProperties(datastoreProperties);
    outputDatasetProperties.topic.setValue(TOPIC_OUT);
    outputDatasetProperties.valueFormat.setValue(KafkaDatasetProperties.ValueFormat.CSV);
// no schema defined
}
Also used : KafkaDatastoreProperties(org.talend.components.kafka.datastore.KafkaDatastoreProperties) KafkaDatasetProperties(org.talend.components.kafka.dataset.KafkaDatasetProperties) Before(org.junit.Before)

Example 5 with KafkaDatastoreProperties

use of org.talend.components.kafka.datastore.KafkaDatastoreProperties in project components by Talend.

the class KafkaDatasetTestIT method createDatasetProperties.

/**
 * @return the properties for this dataset, fully initialized with the default values and the datastore credentials
 * from the System environment.
 */
public static KafkaDatasetProperties createDatasetProperties() {
    // Configure the dataset.
    String systemPropertyHost = System.getProperty("kafka.bootstrap");
    String broker = systemPropertyHost != null ? systemPropertyHost : "localhost:9092";
    KafkaDatastoreProperties datastoreProps = new KafkaDatastoreProperties(null);
    datastoreProps.init();
    datastoreProps.brokers.setValue(broker);
    KafkaDatasetProperties datasetProps = new KafkaDatasetProperties(null);
    datasetProps.init();
    datasetProps.topic.setValue("test_in");
    datasetProps.setDatastoreProperties(datastoreProps);
    return datasetProps;
}
Also used : KafkaDatastoreProperties(org.talend.components.kafka.datastore.KafkaDatastoreProperties) KafkaDatasetProperties(org.talend.components.kafka.dataset.KafkaDatasetProperties)

Aggregations

KafkaDatastoreProperties (org.talend.components.kafka.datastore.KafkaDatastoreProperties)6 Before (org.junit.Before)3 KafkaDatasetProperties (org.talend.components.kafka.dataset.KafkaDatasetProperties)3 Properties (java.util.Properties)1 KafkaConfTableProperties (org.talend.components.kafka.KafkaConfTableProperties)1 KafkaInputProperties (org.talend.components.kafka.input.KafkaInputProperties)1 KafkaOutputProperties (org.talend.components.kafka.output.KafkaOutputProperties)1