Search in sources :

Example 1 with DBInputSplit

use of org.apache.hadoop.mapred.lib.db.DBInputFormat.DBInputSplit in project hadoop by apache.

the class TestDBInputFormat method testDBRecordReader.

/**
   * 
   * test DBRecordReader. This reader should creates keys, values, know about position.. 
   */
@SuppressWarnings("unchecked")
@Test(timeout = 5000)
public void testDBRecordReader() throws Exception {
    JobConf job = mock(JobConf.class);
    DBConfiguration dbConfig = mock(DBConfiguration.class);
    String[] fields = { "field1", "filed2" };
    @SuppressWarnings("rawtypes") DBRecordReader reader = new DBInputFormat<NullDBWritable>().new DBRecordReader(new DBInputSplit(), NullDBWritable.class, job, DriverForTest.getConnection(), dbConfig, "condition", fields, "table");
    LongWritable key = reader.createKey();
    assertEquals(0, key.get());
    DBWritable value = reader.createValue();
    assertEquals("org.apache.hadoop.mapred.lib.db.DBInputFormat$NullDBWritable", value.getClass().getName());
    assertEquals(0, reader.getPos());
    assertFalse(reader.next(key, value));
}
Also used : DBConfiguration(org.apache.hadoop.mapred.lib.db.DBConfiguration) DBRecordReader(org.apache.hadoop.mapred.lib.db.DBInputFormat.DBRecordReader) NullDBWritable(org.apache.hadoop.mapred.lib.db.DBInputFormat.NullDBWritable) DBInputSplit(org.apache.hadoop.mapred.lib.db.DBInputFormat.DBInputSplit) LongWritable(org.apache.hadoop.io.LongWritable) JobConf(org.apache.hadoop.mapred.JobConf) NullDBWritable(org.apache.hadoop.mapred.lib.db.DBInputFormat.NullDBWritable) DriverForTest(org.apache.hadoop.mapreduce.lib.db.DriverForTest) Test(org.junit.Test)

Aggregations

LongWritable (org.apache.hadoop.io.LongWritable)1 JobConf (org.apache.hadoop.mapred.JobConf)1 DBConfiguration (org.apache.hadoop.mapred.lib.db.DBConfiguration)1 DBInputSplit (org.apache.hadoop.mapred.lib.db.DBInputFormat.DBInputSplit)1 DBRecordReader (org.apache.hadoop.mapred.lib.db.DBInputFormat.DBRecordReader)1 NullDBWritable (org.apache.hadoop.mapred.lib.db.DBInputFormat.NullDBWritable)1 DriverForTest (org.apache.hadoop.mapreduce.lib.db.DriverForTest)1 Test (org.junit.Test)1