Search in sources :

Example 11 with DAG

use of org.apache.tez.dag.api.DAG in project hive by apache.

the class TestTezTask method testBuildDag.

@Test
public void testBuildDag() throws IllegalArgumentException, IOException, Exception {
    DAG dag = task.build(conf, work, path, new Context(conf), DagUtils.createTezLrMap(appLr, null));
    for (BaseWork w : work.getAllWork()) {
        Vertex v = dag.getVertex(w.getName());
        assertNotNull(v);
        List<Vertex> outs = v.getOutputVertices();
        for (BaseWork x : work.getChildren(w)) {
            boolean found = false;
            for (Vertex u : outs) {
                if (u.getName().equals(x.getName())) {
                    found = true;
                    break;
                }
            }
            assertTrue(found);
        }
    }
}
Also used : Context(org.apache.hadoop.hive.ql.Context) Vertex(org.apache.tez.dag.api.Vertex) DAG(org.apache.tez.dag.api.DAG) BaseWork(org.apache.hadoop.hive.ql.plan.BaseWork) Test(org.junit.Test)

Aggregations

DAG (org.apache.tez.dag.api.DAG)11 Context (org.apache.hadoop.hive.ql.Context)6 BaseWork (org.apache.hadoop.hive.ql.plan.BaseWork)6 JobConf (org.apache.hadoop.mapred.JobConf)5 Vertex (org.apache.tez.dag.api.Vertex)5 Test (org.junit.Test)5 IOException (java.io.IOException)4 FileSystem (org.apache.hadoop.fs.FileSystem)4 LocalResource (org.apache.hadoop.yarn.api.records.LocalResource)4 Path (org.apache.hadoop.fs.Path)3 HiveException (org.apache.hadoop.hive.ql.metadata.HiveException)3 FileNotFoundException (java.io.FileNotFoundException)2 URISyntaxException (java.net.URISyntaxException)2 HashMap (java.util.HashMap)2 LinkedHashMap (java.util.LinkedHashMap)2 LinkedList (java.util.LinkedList)2 LoginException (javax.security.auth.login.LoginException)2 LlapInputSplit (org.apache.hadoop.hive.llap.LlapInputSplit)2 SubmitWorkInfo (org.apache.hadoop.hive.llap.SubmitWorkInfo)2 LlapCoordinator (org.apache.hadoop.hive.llap.coordinator.LlapCoordinator)2