Examples with HdfsSourceDTO com.dtstack.dtcenter.loader.dto.source.HdfsSourceDTO used on opensource projects

Example 26 with HdfsSourceDTO

use of com.dtstack.dtcenter.loader.dto.source.HdfsSourceDTO in project Taier by DTStack.

the class HdfsOperator method listFiles.

public static List<FileStatus> listFiles(Map<String, Object> conf, Map<String, Object> kerberos, String parentSrc, boolean isIterate) {
    HdfsSourceDTO sourceDTO = getSourceDTO(conf, kerberos);
    IHdfsFile hdfsClient = ClientCache.getHdfs(DataSourceType.HDFS.getVal());
    return hdfsClient.listAllFiles(sourceDTO, parentSrc, isIterate);
}

Example 27 with HdfsSourceDTO

use of com.dtstack.dtcenter.loader.dto.source.HdfsSourceDTO in project Taier by DTStack.

the class HdfsOperator method uploadLocalFileToHdfs.

public static void uploadLocalFileToHdfs(Map<String, Object> conf, Map<String, Object> kerberos, String localFilePath, String hdfsDir) {
    HdfsSourceDTO sourceDTO = getSourceDTO(conf, kerberos);
    IHdfsFile hdfsClient = ClientCache.getHdfs(DataSourceType.HDFS.getVal());
    hdfsClient.uploadLocalFileToHdfs(sourceDTO, localFilePath, hdfsDir);
}

Example 28 with HdfsSourceDTO

use of com.dtstack.dtcenter.loader.dto.source.HdfsSourceDTO in project Taier by DTStack.

the class HdfsOperator method rename.

public static boolean rename(Map<String, Object> conf, Map<String, Object> kerberos, String src, String dist) {
    HdfsSourceDTO sourceDTO = getSourceDTO(conf, kerberos);
    IHdfsFile hdfsClient = ClientCache.getHdfs(DataSourceType.HDFS.getVal());
    return hdfsClient.rename(sourceDTO, src, dist);
}