Search in sources :

Example 6 with DatasetName

use of com.google.cloud.automl.v1beta1.DatasetName in project java-automl by googleapis.

the class DatasetApi method importData.

// [START automl_translate_import_data]
/**
 * Import sentence pairs to the dataset.
 *
 * @param projectId the Google Cloud Project ID.
 * @param computeRegion the Region name. (e.g., "us-central1").
 * @param datasetId the Id of the dataset.
 * @param path the remote Path of the training data csv file.
 */
public static void importData(String projectId, String computeRegion, String datasetId, String path) throws IOException, InterruptedException, ExecutionException {
    // Instantiates a client
    try (AutoMlClient client = AutoMlClient.create()) {
        // Get the complete path of the dataset.
        DatasetName datasetFullId = DatasetName.of(projectId, computeRegion, datasetId);
        GcsSource.Builder gcsSource = GcsSource.newBuilder();
        // Get multiple Google Cloud Storage URIs to import data from
        String[] inputUris = path.split(",");
        for (String inputUri : inputUris) {
            gcsSource.addInputUris(inputUri);
        }
        // Import data from the input URI
        InputConfig inputConfig = InputConfig.newBuilder().setGcsSource(gcsSource).build();
        System.out.println("Processing import...");
        Empty response = client.importDataAsync(datasetFullId, inputConfig).get();
        System.out.println(String.format("Dataset imported. %s", response));
    }
}
Also used : Empty(com.google.protobuf.Empty) GcsSource(com.google.cloud.automl.v1.GcsSource) DatasetName(com.google.cloud.automl.v1.DatasetName) InputConfig(com.google.cloud.automl.v1.InputConfig) AutoMlClient(com.google.cloud.automl.v1.AutoMlClient)

Example 7 with DatasetName

use of com.google.cloud.automl.v1beta1.DatasetName in project java-automl by googleapis.

the class GetDataset method getDataset.

// Get a dataset
static void getDataset(String projectId, String datasetId) throws IOException {
    // the "close" method on the client to safely clean up any remaining background resources.
    try (AutoMlClient client = AutoMlClient.create()) {
        // Get the complete path of the dataset.
        DatasetName datasetFullId = DatasetName.of(projectId, "us-central1", datasetId);
        Dataset dataset = client.getDataset(datasetFullId);
        // Display the dataset information
        System.out.format("Dataset name: %s\n", dataset.getName());
        // To get the dataset id, you have to parse it out of the `name` field. As dataset Ids are
        // required for other methods.
        // Name Form: `projects/{project_id}/locations/{location_id}/datasets/{dataset_id}`
        String[] names = dataset.getName().split("/");
        String retrievedDatasetId = names[names.length - 1];
        System.out.format("Dataset id: %s\n", retrievedDatasetId);
        System.out.format("Dataset display name: %s\n", dataset.getDisplayName());
        System.out.println("Dataset create time:");
        System.out.format("\tseconds: %s\n", dataset.getCreateTime().getSeconds());
        System.out.format("\tnanos: %s\n", dataset.getCreateTime().getNanos());
        // [END automl_language_sentiment_analysis_get_dataset]
        // [END automl_language_text_classification_get_dataset]
        // [END automl_translate_get_dataset]
        // [END automl_vision_classification_get_dataset]
        // [END automl_vision_object_detection_get_dataset]
        System.out.format("Text extraction dataset metadata: %s\n", dataset.getTextExtractionDatasetMetadata());
        // [END automl_language_entity_extraction_get_dataset]
        // [START automl_language_sentiment_analysis_get_dataset]
        System.out.format("Text sentiment dataset metadata: %s\n", dataset.getTextSentimentDatasetMetadata());
        // [END automl_language_sentiment_analysis_get_dataset]
        // [START automl_language_text_classification_get_dataset]
        System.out.format("Text classification dataset metadata: %s\n", dataset.getTextClassificationDatasetMetadata());
        // [END automl_language_text_classification_get_dataset]
        // [START automl_translate_get_dataset]
        System.out.println("Translation dataset metadata:");
        System.out.format("\tSource language code: %s\n", dataset.getTranslationDatasetMetadata().getSourceLanguageCode());
        System.out.format("\tTarget language code: %s\n", dataset.getTranslationDatasetMetadata().getTargetLanguageCode());
        // [END automl_translate_get_dataset]
        // [START automl_vision_classification_get_dataset]
        System.out.format("Image classification dataset metadata: %s\n", dataset.getImageClassificationDatasetMetadata());
        // [END automl_vision_classification_get_dataset]
        // [START automl_vision_object_detection_get_dataset]
        System.out.format("Image object detection dataset metadata: %s\n", dataset.getImageObjectDetectionDatasetMetadata());
    // [START automl_language_entity_extraction_get_dataset]
    // [START automl_language_sentiment_analysis_get_dataset]
    // [START automl_language_text_classification_get_dataset]
    // [START automl_translate_get_dataset]
    // [START automl_vision_classification_get_dataset]
    }
}
Also used : DatasetName(com.google.cloud.automl.v1.DatasetName) Dataset(com.google.cloud.automl.v1.Dataset) AutoMlClient(com.google.cloud.automl.v1.AutoMlClient)

Example 8 with DatasetName

use of com.google.cloud.automl.v1beta1.DatasetName in project java-automl by googleapis.

the class ExportDataset method exportDataset.

// Export a dataset to a GCS bucket
static void exportDataset(String projectId, String datasetId, String gcsUri) throws IOException, ExecutionException, InterruptedException {
    // the "close" method on the client to safely clean up any remaining background resources.
    try (AutoMlClient client = AutoMlClient.create()) {
        // Get the complete path of the dataset.
        DatasetName datasetFullId = DatasetName.of(projectId, "us-central1", datasetId);
        GcsDestination gcsDestination = GcsDestination.newBuilder().setOutputUriPrefix(gcsUri).build();
        // Export the dataset to the output URI.
        OutputConfig outputConfig = OutputConfig.newBuilder().setGcsDestination(gcsDestination).build();
        System.out.println("Processing export...");
        Empty response = client.exportDataAsync(datasetFullId, outputConfig).get();
        System.out.format("Dataset exported. %s\n", response);
    }
}
Also used : Empty(com.google.protobuf.Empty) OutputConfig(com.google.cloud.automl.v1.OutputConfig) DatasetName(com.google.cloud.automl.v1.DatasetName) GcsDestination(com.google.cloud.automl.v1.GcsDestination) AutoMlClient(com.google.cloud.automl.v1.AutoMlClient)

Example 9 with DatasetName

use of com.google.cloud.automl.v1beta1.DatasetName in project java-automl by googleapis.

the class VideoClassificationCreateDatasetTest method tearDown.

@After
public void tearDown() throws InterruptedException, ExecutionException, IOException {
    // Delete the created dataset
    try (AutoMlClient client = AutoMlClient.create()) {
        // Get the full path of the dataset.
        DatasetName datasetFullId = DatasetName.of(PROJECT_ID, "us-central1", datasetId);
        client.deleteDatasetAsync(datasetFullId).get();
    }
    System.setOut(originalPrintStream);
}
Also used : DatasetName(com.google.cloud.automl.v1beta1.DatasetName) AutoMlClient(com.google.cloud.automl.v1beta1.AutoMlClient) After(org.junit.After)

Example 10 with DatasetName

use of com.google.cloud.automl.v1beta1.DatasetName in project java-automl by googleapis.

the class VideoObjectTrackingCreateDatasetTest method tearDown.

@After
public void tearDown() throws InterruptedException, ExecutionException, IOException {
    // Delete the created dataset
    try (AutoMlClient client = AutoMlClient.create()) {
        // Get the full path of the dataset.
        DatasetName datasetFullId = DatasetName.of(PROJECT_ID, "us-central1", datasetId);
        client.deleteDatasetAsync(datasetFullId).get();
    }
    System.setOut(originalPrintStream);
}
Also used : DatasetName(com.google.cloud.automl.v1beta1.DatasetName) AutoMlClient(com.google.cloud.automl.v1beta1.AutoMlClient) After(org.junit.After)

Aggregations

Empty (com.google.protobuf.Empty)7 AutoMlClient (com.google.cloud.automl.v1beta1.AutoMlClient)6 AutoMlClient (com.google.cloud.automl.v1.AutoMlClient)5 DatasetName (com.google.cloud.automl.v1.DatasetName)5 DatasetName (com.google.cloud.automl.v1beta1.DatasetName)5 GcsSource (com.google.cloud.automl.v1.GcsSource)2 InputConfig (com.google.cloud.automl.v1.InputConfig)2 GcsSource (com.google.cloud.automl.v1beta1.GcsSource)2 InputConfig (com.google.cloud.automl.v1beta1.InputConfig)2 TimeoutException (java.util.concurrent.TimeoutException)2 After (org.junit.After)2 RetrySettings (com.google.api.gax.retrying.RetrySettings)1 Dataset (com.google.cloud.automl.v1.Dataset)1 GcsDestination (com.google.cloud.automl.v1.GcsDestination)1 OperationMetadata (com.google.cloud.automl.v1.OperationMetadata)1 OutputConfig (com.google.cloud.automl.v1.OutputConfig)1 ListTableSpecsPagedResponse (com.google.cloud.automl.v1beta1.AutoMlClient.ListTableSpecsPagedResponse)1 AutoMlSettings (com.google.cloud.automl.v1beta1.AutoMlSettings)1 BigQuerySource (com.google.cloud.automl.v1beta1.BigQuerySource)1 Dataset (com.google.cloud.automl.v1beta1.Dataset)1