Search in sources :

Example 1 with DummyGridmixJob

use of org.apache.hadoop.mapred.gridmix.TestHighRamJob.DummyGridmixJob in project hadoop by apache.

the class TestGridmixMemoryEmulation method testJavaHeapOptionsDisabled.

/**
   * Test disabled task heap options configuration in {@link GridmixJob}.
   */
@Test
@SuppressWarnings("deprecation")
public void testJavaHeapOptionsDisabled() throws Exception {
    Configuration gridmixConf = new Configuration();
    gridmixConf.setBoolean(GridmixJob.GRIDMIX_TASK_JVM_OPTIONS_ENABLE, false);
    // set the default values of simulated job
    gridmixConf.set(MRJobConfig.MAP_JAVA_OPTS, "-Xmx1m");
    gridmixConf.set(MRJobConfig.REDUCE_JAVA_OPTS, "-Xmx2m");
    gridmixConf.set(JobConf.MAPRED_TASK_JAVA_OPTS, "-Xmx3m");
    // set the default map and reduce task options for original job
    final JobConf originalConf = new JobConf();
    originalConf.set(MRJobConfig.MAP_JAVA_OPTS, "-Xmx10m");
    originalConf.set(MRJobConfig.REDUCE_JAVA_OPTS, "-Xmx20m");
    originalConf.set(JobConf.MAPRED_TASK_JAVA_OPTS, "-Xmx30m");
    // define a mock job
    MockJob story = new MockJob(originalConf) {

        public JobConf getJobConf() {
            return originalConf;
        }
    };
    GridmixJob job = new DummyGridmixJob(gridmixConf, story);
    Job simulatedJob = job.getJob();
    Configuration simulatedConf = simulatedJob.getConfiguration();
    assertEquals("Map heap options works when disabled!", "-Xmx1m", simulatedConf.get(MRJobConfig.MAP_JAVA_OPTS));
    assertEquals("Reduce heap options works when disabled!", "-Xmx2m", simulatedConf.get(MRJobConfig.REDUCE_JAVA_OPTS));
    assertEquals("Task heap options works when disabled!", "-Xmx3m", simulatedConf.get(JobConf.MAPRED_TASK_JAVA_OPTS));
}
Also used : DummyGridmixJob(org.apache.hadoop.mapred.gridmix.TestHighRamJob.DummyGridmixJob) Configuration(org.apache.hadoop.conf.Configuration) DummyGridmixJob(org.apache.hadoop.mapred.gridmix.TestHighRamJob.DummyGridmixJob) DummyGridmixJob(org.apache.hadoop.mapred.gridmix.TestHighRamJob.DummyGridmixJob) Job(org.apache.hadoop.mapreduce.Job) MockJob(org.apache.hadoop.mapred.gridmix.DebugJobProducer.MockJob) JobConf(org.apache.hadoop.mapred.JobConf) MockJob(org.apache.hadoop.mapred.gridmix.DebugJobProducer.MockJob) Test(org.junit.Test)

Aggregations

Configuration (org.apache.hadoop.conf.Configuration)1 JobConf (org.apache.hadoop.mapred.JobConf)1 MockJob (org.apache.hadoop.mapred.gridmix.DebugJobProducer.MockJob)1 DummyGridmixJob (org.apache.hadoop.mapred.gridmix.TestHighRamJob.DummyGridmixJob)1 Job (org.apache.hadoop.mapreduce.Job)1 Test (org.junit.Test)1