Search in sources :

Example 1 with Entry

use of org.apache.hadoop.io.file.tfile.TFile.Reader.Scanner.Entry in project apex-malhar by apache.

the class TFileReader method readFully.

@Override
public void readFully(TreeMap<Slice, Slice> data) throws IOException {
    scanner.rewind();
    for (; !scanner.atEnd(); scanner.advance()) {
        Entry en = scanner.entry();
        int klen = en.getKeyLength();
        int vlen = en.getValueLength();
        byte[] key = new byte[klen];
        byte[] value = new byte[vlen];
        en.getKey(key);
        en.getValue(value);
        data.put(new Slice(key, 0, key.length), new Slice(value, 0, value.length));
    }
}
Also used : Entry(org.apache.hadoop.io.file.tfile.TFile.Reader.Scanner.Entry) Slice(com.datatorrent.netlet.util.Slice)

Example 2 with Entry

use of org.apache.hadoop.io.file.tfile.TFile.Reader.Scanner.Entry in project apex-malhar by apache.

the class TFileReader method peek.

@Override
public boolean peek(Slice key, Slice value) throws IOException {
    if (scanner.atEnd()) {
        return false;
    }
    Entry en = scanner.entry();
    byte[] rkey = new byte[en.getKeyLength()];
    byte[] rval = new byte[en.getValueLength()];
    en.getKey(rkey);
    en.getValue(rval);
    key.buffer = rkey;
    key.offset = 0;
    key.length = en.getKeyLength();
    value.buffer = rval;
    value.offset = 0;
    value.length = en.getValueLength();
    return true;
}
Also used : Entry(org.apache.hadoop.io.file.tfile.TFile.Reader.Scanner.Entry)

Aggregations

Entry (org.apache.hadoop.io.file.tfile.TFile.Reader.Scanner.Entry)2 Slice (com.datatorrent.netlet.util.Slice)1