Search in sources :

Example 1 with KeyValueInputMerger

use of org.apache.hadoop.hive.ql.exec.tez.tools.KeyValueInputMerger in project hive by apache.

the class MapRecordProcessor method getKeyValueReader.

@SuppressWarnings("deprecation")
private KeyValueReader getKeyValueReader(Collection<KeyValueReader> keyValueReaders, AbstractMapOperator mapOp) throws Exception {
    List<KeyValueReader> kvReaderList = new ArrayList<KeyValueReader>(keyValueReaders);
    // this sets up the map operator contexts correctly
    mapOp.initializeContexts();
    Deserializer deserializer = mapOp.getCurrentDeserializer();
    // deserializer is null in case of VectorMapOperator
    KeyValueReader reader = new KeyValueInputMerger(kvReaderList, deserializer, new ObjectInspector[] { deserializer == null ? null : deserializer.getObjectInspector() }, mapOp.getConf().getSortCols());
    return reader;
}
Also used : Deserializer(org.apache.hadoop.hive.serde2.Deserializer) KeyValueReader(org.apache.tez.runtime.library.api.KeyValueReader) ArrayList(java.util.ArrayList) KeyValueInputMerger(org.apache.hadoop.hive.ql.exec.tez.tools.KeyValueInputMerger)

Aggregations

ArrayList (java.util.ArrayList)1 KeyValueInputMerger (org.apache.hadoop.hive.ql.exec.tez.tools.KeyValueInputMerger)1 Deserializer (org.apache.hadoop.hive.serde2.Deserializer)1 KeyValueReader (org.apache.tez.runtime.library.api.KeyValueReader)1