Examples with InputFormat org.apache.hadoop.mapreduce.InputFormat used on opensource projects

Example 21 with InputFormat

use of org.apache.hadoop.mapreduce.InputFormat in project druid by druid-io.

the class BaseParquetInputTest method getFirstRow.

static Object getFirstRow(Job job, String parserType, String parquetPath) throws IOException, InterruptedException {
    File testFile = new File(parquetPath);
    Path path = new Path(testFile.getAbsoluteFile().toURI());
    FileSplit split = new FileSplit(path, 0, testFile.length(), null);
    InputFormat inputFormat = ReflectionUtils.newInstance(INPUT_FORMAT_CLASSES.get(parserType), job.getConfiguration());
    TaskAttemptContext context = new TaskAttemptContextImpl(job.getConfiguration(), new TaskAttemptID());
    try (RecordReader reader = inputFormat.createRecordReader(split, context)) {
        reader.initialize(split, context);
        reader.nextKeyValue();
        return reader.getCurrentValue();
    }
}