Search in sources :

Example 1 with ByteArrayKafkaRecord

use of org.apache.beam.sdk.io.kafka.KafkaIO.ByteArrayKafkaRecord in project beam by apache.

the class KafkaIOExternalTest method testKafkaRecordToExternalKafkaRecord.

@Test
public void testKafkaRecordToExternalKafkaRecord() throws Exception {
    RecordHeaders headers = new RecordHeaders();
    headers.add("dummyHeaderKey", "dummyHeaderVal".getBytes(StandardCharsets.UTF_8));
    KafkaRecord<byte[], byte[]> kafkaRecord = new KafkaRecord("dummyTopic", 111, 222, 12345, KafkaTimestampType.LOG_APPEND_TIME, headers, "dummyKey".getBytes(StandardCharsets.UTF_8), "dummyValue".getBytes(StandardCharsets.UTF_8));
    ByteArrayKafkaRecord byteArrayKafkaRecord = RowsWithMetadata.toExternalKafkaRecord(kafkaRecord);
    assertEquals("dummyTopic", byteArrayKafkaRecord.topic);
    assertEquals(111, byteArrayKafkaRecord.partition);
    assertEquals(222, byteArrayKafkaRecord.offset);
    assertEquals(12345, byteArrayKafkaRecord.timestamp);
    assertEquals(KafkaTimestampType.LOG_APPEND_TIME.id, byteArrayKafkaRecord.timestampTypeId);
    assertEquals(KafkaTimestampType.LOG_APPEND_TIME.name, byteArrayKafkaRecord.timestampTypeName);
    assertEquals("dummyKey", new String(byteArrayKafkaRecord.key, "UTF-8"));
    assertEquals("dummyValue", new String(byteArrayKafkaRecord.value, "UTF-8"));
    assertEquals(1, byteArrayKafkaRecord.headers.size());
    assertEquals("dummyHeaderKey", byteArrayKafkaRecord.headers.get(0).key);
    assertEquals("dummyHeaderVal", new String(byteArrayKafkaRecord.headers.get(0).value, "UTF-8"));
}
Also used : RecordHeaders(org.apache.kafka.common.header.internals.RecordHeaders) ByteArrayKafkaRecord(org.apache.beam.sdk.io.kafka.KafkaIO.ByteArrayKafkaRecord) ByteArrayKafkaRecord(org.apache.beam.sdk.io.kafka.KafkaIO.ByteArrayKafkaRecord) ByteString(org.apache.beam.vendor.grpc.v1p43p2.com.google.protobuf.ByteString) Test(org.junit.Test)

Aggregations

ByteArrayKafkaRecord (org.apache.beam.sdk.io.kafka.KafkaIO.ByteArrayKafkaRecord)1 ByteString (org.apache.beam.vendor.grpc.v1p43p2.com.google.protobuf.ByteString)1 RecordHeaders (org.apache.kafka.common.header.internals.RecordHeaders)1 Test (org.junit.Test)1