Examples with HdfsInputSourceConfig org.apache.druid.inputsource.hdfs.HdfsInputSourceConfig used on opensource projects

Example 1 with HdfsInputSourceConfig

use of org.apache.druid.inputsource.hdfs.HdfsInputSourceConfig in project druid by druid-io.

the class HdfsStorageDruidModuleTest method testHdfsInputSourceConfigDefaultAllowedProtocols.

@Test
public void testHdfsInputSourceConfigDefaultAllowedProtocols() {
    Properties props = new Properties();
    Injector injector = makeInjectorWithProperties(props);
    HdfsInputSourceConfig instance = injector.getInstance(HdfsInputSourceConfig.class);
    Assert.assertEquals(ImmutableSet.of("hdfs"), instance.getAllowedProtocols());
}

Example 2 with HdfsInputSourceConfig

use of org.apache.druid.inputsource.hdfs.HdfsInputSourceConfig in project druid by druid-io.

the class HdfsFirehoseFactoryTest method testConstructorAllowsOnlyCustomProtocol.

@Test
public void testConstructorAllowsOnlyCustomProtocol() {
    final Configuration conf = new Configuration();
    conf.set("fs.ftp.impl", "org.apache.hadoop.fs.ftp.FTPFileSystem");
    new HdfsFirehoseFactory("ftp://localhost:21/foo/bar", null, null, null, null, null, DEFAULT_CONFIGURATION, new HdfsInputSourceConfig(ImmutableSet.of("ftp")));
    expectedException.expect(IllegalArgumentException.class);
    expectedException.expectMessage("Only [druid] protocols are allowed");
    new HdfsFirehoseFactory("hdfs://localhost:7020/foo/bar", null, null, null, null, null, DEFAULT_CONFIGURATION, new HdfsInputSourceConfig(ImmutableSet.of("druid")));
}

Example 3 with HdfsInputSourceConfig

use of org.apache.druid.inputsource.hdfs.HdfsInputSourceConfig in project druid by druid-io.

the class HdfsStorageDruidModuleTest method testHdfsInputSourceConfigCustomAllowedProtocols.

@Test
public void testHdfsInputSourceConfigCustomAllowedProtocols() {
    Properties props = new Properties();
    props.setProperty("druid.ingestion.hdfs.allowedProtocols", "[\"webhdfs\"]");
    Injector injector = makeInjectorWithProperties(props);
    HdfsInputSourceConfig instance = injector.getInstance(HdfsInputSourceConfig.class);
    Assert.assertEquals(ImmutableSet.of("webhdfs"), instance.getAllowedProtocols());
}