Search in sources :

Example 6 with StorageLocation

use of com.sequenceiq.cloudbreak.domain.StorageLocation in project cloudbreak by hortonworks.

the class DataDiscoveryServiceCloudStorageRoleConfigProviderTest method getDataDiscoveryServiceFileSystemUri.

private StorageLocation getDataDiscoveryServiceFileSystemUri() {
    StorageLocation dataDiscoveryServiceFileSystemUri = new StorageLocation();
    dataDiscoveryServiceFileSystemUri.setProperty("file_system_uri");
    dataDiscoveryServiceFileSystemUri.setValue("s3a://bucket/dpprofiler");
    return dataDiscoveryServiceFileSystemUri;
}
Also used : StorageLocation(com.sequenceiq.cloudbreak.domain.StorageLocation)

Example 7 with StorageLocation

use of com.sequenceiq.cloudbreak.domain.StorageLocation in project cloudbreak by hortonworks.

the class ImpalaCloudStorageServiceConfigProviderTest method getHiveWarehouseExternalStorageLocation.

private StorageLocation getHiveWarehouseExternalStorageLocation() {
    StorageLocation external = new StorageLocation();
    external.setProperty("hive.metastore.warehouse.external.dir");
    external.setValue("s3a://bucket/warehouse/tablespace/external/hive");
    return external;
}
Also used : StorageLocation(com.sequenceiq.cloudbreak.domain.StorageLocation)

Example 8 with StorageLocation

use of com.sequenceiq.cloudbreak.domain.StorageLocation in project cloudbreak by hortonworks.

the class ImpalaCloudStorageServiceConfigProviderTest method getHiveWarehouseStorageLocation.

private StorageLocation getHiveWarehouseStorageLocation() {
    StorageLocation managed = new StorageLocation();
    managed.setProperty("hive.metastore.warehouse.dir");
    managed.setValue("s3a://bucket/warehouse/tablespace/managed/hive");
    return managed;
}
Also used : StorageLocation(com.sequenceiq.cloudbreak.domain.StorageLocation)

Example 9 with StorageLocation

use of com.sequenceiq.cloudbreak.domain.StorageLocation in project cloudbreak by hortonworks.

the class SparkOnYarnRoleConfigProviderTest method getTemplatePreparationObject.

private TemplatePreparationObject getTemplatePreparationObject(String... locations) {
    HostgroupView master = new HostgroupView("master", 1, InstanceGroupType.GATEWAY, 1);
    HostgroupView worker = new HostgroupView("worker", 2, InstanceGroupType.CORE, 2);
    List<StorageLocationView> storageLocations = new ArrayList<>();
    if (locations.length >= 1) {
        StorageLocation hmsExternalWarehouseDir = new StorageLocation();
        hmsExternalWarehouseDir.setProperty("hive.metastore.warehouse.external.dir");
        hmsExternalWarehouseDir.setValue(locations[0]);
        storageLocations.add(new StorageLocationView(hmsExternalWarehouseDir));
    }
    S3FileSystemConfigurationsView fileSystemConfigurationsView = new S3FileSystemConfigurationsView(new S3FileSystem(), storageLocations, false);
    return Builder.builder().withFileSystemConfigurationView(fileSystemConfigurationsView).withHostgroupViews(Set.of(master, worker)).build();
}
Also used : StorageLocationView(com.sequenceiq.cloudbreak.template.filesystem.StorageLocationView) ArrayList(java.util.ArrayList) HostgroupView(com.sequenceiq.cloudbreak.template.views.HostgroupView) StorageLocation(com.sequenceiq.cloudbreak.domain.StorageLocation) S3FileSystemConfigurationsView(com.sequenceiq.cloudbreak.template.filesystem.s3.S3FileSystemConfigurationsView) S3FileSystem(com.sequenceiq.common.api.filesystem.S3FileSystem)

Example 10 with StorageLocation

use of com.sequenceiq.cloudbreak.domain.StorageLocation in project cloudbreak by hortonworks.

the class YarnCloudStorageRoleConfigProviderTest method getYarnRemoteAppLogDir.

protected StorageLocation getYarnRemoteAppLogDir() {
    StorageLocation yarnRemoteAppLogDir = new StorageLocation();
    yarnRemoteAppLogDir.setProperty("yarn.nodemanager.remote-app-log-dir");
    yarnRemoteAppLogDir.setValue("s3a://bucket/yarn/logs");
    return yarnRemoteAppLogDir;
}
Also used : StorageLocation(com.sequenceiq.cloudbreak.domain.StorageLocation)

Aggregations

StorageLocation (com.sequenceiq.cloudbreak.domain.StorageLocation)40 StorageLocationView (com.sequenceiq.cloudbreak.template.filesystem.StorageLocationView)16 ArrayList (java.util.ArrayList)13 S3FileSystemConfigurationsView (com.sequenceiq.cloudbreak.template.filesystem.s3.S3FileSystemConfigurationsView)11 S3FileSystem (com.sequenceiq.common.api.filesystem.S3FileSystem)11 HostgroupView (com.sequenceiq.cloudbreak.template.views.HostgroupView)7 Test (org.junit.Test)6 TemplatePreparationObject (com.sequenceiq.cloudbreak.template.TemplatePreparationObject)5 BaseFileSystemConfigurationsView (com.sequenceiq.cloudbreak.template.filesystem.BaseFileSystemConfigurationsView)5 CmTemplateProcessor (com.sequenceiq.cloudbreak.cmtemplate.CmTemplateProcessor)4 ApiClusterTemplate (com.cloudera.api.swagger.model.ApiClusterTemplate)2 BackupResponse (com.sequenceiq.common.api.backup.response.BackupResponse)2 HashSet (java.util.HashSet)2 ArgumentMatchers.anyString (org.mockito.ArgumentMatchers.anyString)2 ApiClusterTemplateConfig (com.cloudera.api.swagger.model.ApiClusterTemplateConfig)1 ClouderaManagerRepo (com.sequenceiq.cloudbreak.cloud.model.ClouderaManagerRepo)1 CoreConfigProvider (com.sequenceiq.cloudbreak.cmtemplate.configproviders.core.CoreConfigProvider)1 HiveMetastoreConfigProvider (com.sequenceiq.cloudbreak.cmtemplate.configproviders.hive.HiveMetastoreConfigProvider)1 Json (com.sequenceiq.cloudbreak.common.json.Json)1 FileSystem (com.sequenceiq.cloudbreak.domain.FileSystem)1