Examples with DataSetSparkParameters com.thinkbiganalytics.metadata.api.catalog.DataSetSparkParameters used on opensource projects

Example 6 with DataSetSparkParameters

use of com.thinkbiganalytics.metadata.api.catalog.DataSetSparkParameters in project kylo by Teradata.

the class DatasourceModelTransform method findDomainDatasource.

public com.thinkbiganalytics.metadata.api.datasource.Datasource findDomainDatasource(DataSet domainDataSet) {
    DataSetSparkParameters params = domainDataSet.getEffectiveSparkParameters();
    String derivedDatasourceType = getDerivedDataSourceType(domainDataSet);
    String derivedDataSourceName = domainDataSet.getTitle();
    if (StringUtils.isBlank(derivedDataSourceName) && params.getPaths() != null && !params.getPaths().isEmpty()) {
        derivedDataSourceName = params.getPaths().stream().collect(Collectors.joining(","));
    }
    DerivedDatasource ds = null;
    com.thinkbiganalytics.metadata.api.datasource.DerivedDatasource derivedDatasource = datasourceProvider.findDerivedDatasource(derivedDatasourceType, derivedDataSourceName);
    return derivedDatasource;
}