Search in sources :

Example 1 with HadoopFileSystem

use of org.talend.webhcat.launcher.fs.HadoopFileSystem in project tdi-studio-se by Talend.

the class MapReduceJob method main.

public static void main(String[] args) throws Exception {
    Configuration conf = new Configuration();
    conf.set("fs.default.name", "hdfs://hdp21:8020/");
    FileSystem fs = new HadoopFileSystem(conf);
    Job J = new MapReduceJob(fs);
    J.parseArg(args);
    J.callWS(J.sendFiles(), false);
    J.execute();
}
Also used : Configuration(org.apache.hadoop.conf.Configuration) FileSystem(org.talend.webhcat.launcher.fs.FileSystem) HadoopFileSystem(org.talend.webhcat.launcher.fs.HadoopFileSystem) Job(org.talend.webhcat.launcher.common.Job) HadoopFileSystem(org.talend.webhcat.launcher.fs.HadoopFileSystem)

Aggregations

Configuration (org.apache.hadoop.conf.Configuration)1 Job (org.talend.webhcat.launcher.common.Job)1 FileSystem (org.talend.webhcat.launcher.fs.FileSystem)1 HadoopFileSystem (org.talend.webhcat.launcher.fs.HadoopFileSystem)1