Search in sources :

Example 1 with PartitionTopicInfo

use of kafka.consumer.PartitionTopicInfo in project incubator-gobblin by apache.

the class MockKafkaStream method pushToStream.

public void pushToStream(String message) {
    int streamNo = (int) this.nextStream.incrementAndGet() % this.queues.size();
    AtomicLong offset = this.offsets.get(streamNo);
    BlockingQueue<FetchedDataChunk> queue = this.queues.get(streamNo);
    AtomicLong thisOffset = new AtomicLong(offset.incrementAndGet());
    List<Message> seq = Lists.newArrayList();
    seq.add(new Message(message.getBytes(Charsets.UTF_8)));
    ByteBufferMessageSet messageSet = new ByteBufferMessageSet(NoCompressionCodec$.MODULE$, offset, JavaConversions.asScalaBuffer(seq));
    FetchedDataChunk chunk = new FetchedDataChunk(messageSet, new PartitionTopicInfo("topic", streamNo, queue, thisOffset, thisOffset, new AtomicInteger(1), "clientId"), thisOffset.get());
    queue.add(chunk);
}
Also used : PartitionTopicInfo(kafka.consumer.PartitionTopicInfo) AtomicLong(java.util.concurrent.atomic.AtomicLong) Message(kafka.message.Message) AtomicInteger(java.util.concurrent.atomic.AtomicInteger) FetchedDataChunk(kafka.consumer.FetchedDataChunk) ByteBufferMessageSet(kafka.message.ByteBufferMessageSet)

Aggregations

AtomicInteger (java.util.concurrent.atomic.AtomicInteger)1 AtomicLong (java.util.concurrent.atomic.AtomicLong)1 FetchedDataChunk (kafka.consumer.FetchedDataChunk)1 PartitionTopicInfo (kafka.consumer.PartitionTopicInfo)1 ByteBufferMessageSet (kafka.message.ByteBufferMessageSet)1 Message (kafka.message.Message)1