Search in sources :

Example 6 with VideoModel

use of org.datatransferproject.types.common.models.videos.VideoModel in project data-transfer-project by google.

the class KoofrVideosImporter method importItem.

@Override
public ImportResult importItem(UUID jobId, IdempotentImportExecutor idempotentImportExecutor, TokensAndUrlAuthData authData, VideosContainerResource resource) throws Exception {
    KoofrClient koofrClient = koofrClientFactory.create(authData);
    monitor.debug(() -> String.format("%s: Importing %s albums and %s videos", jobId, resource.getAlbums().size(), resource.getVideos().size()));
    for (VideoAlbum album : resource.getAlbums()) {
        // Create a Koofr folder and then save the id with the mapping data
        idempotentImportExecutor.executeAndSwallowIOExceptions(album.getId(), album.getName(), () -> createAlbumFolder(album, koofrClient));
    }
    for (VideoModel videoModel : resource.getVideos()) {
        String id;
        if (videoModel.getAlbumId() == null) {
            id = videoModel.getDataId();
        } else {
            id = videoModel.getAlbumId() + "-" + videoModel.getDataId();
        }
        idempotentImportExecutor.executeAndSwallowIOExceptions(id, videoModel.getName(), () -> importSingleVideo(videoModel, jobId, idempotentImportExecutor, koofrClient));
    }
    return ImportResult.OK;
}
Also used : KoofrClient(org.datatransferproject.transfer.koofr.common.KoofrClient) VideoAlbum(org.datatransferproject.types.common.models.videos.VideoAlbum) VideoModel(org.datatransferproject.types.common.models.videos.VideoModel)

Example 7 with VideoModel

use of org.datatransferproject.types.common.models.videos.VideoModel in project data-transfer-project by google.

the class KoofrVideosExporterTest method testExport.

@Test
public void testExport() throws Exception {
    when(client.getRootPath()).thenReturn("/Data transfer");
    when(client.listRecursive("/Data transfer")).thenReturn(Fixtures.listRecursiveItems);
    when(client.fileLink("/Data transfer/Album 2 :heart:/Video 1.mp4")).thenReturn("https://app-1.koofr.net/content/files/get/Video+1.mp4?base=TESTBASE");
    when(client.fileLink("/Data transfer/Videos/Video 2.mp4")).thenReturn("https://app-1.koofr.net/content/files/get/Video+2.mp4?base=TESTBASE");
    UUID jobId = UUID.randomUUID();
    ExportResult<VideosContainerResource> result = exporter.export(jobId, authData, Optional.empty());
    assertEquals(ExportResult.ResultType.END, result.getType());
    assertNull(result.getContinuationData());
    VideosContainerResource exportedData = result.getExportedData();
    List<VideoAlbum> expectedAlbums = ImmutableList.of(new VideoAlbum("/Album 2 :heart:", "Album 2 ❤️", "Album 2 description ❤️"), new VideoAlbum("/Videos", "Videos", null));
    assertEquals(expectedAlbums, exportedData.getAlbums());
    List<VideoModel> expectedVideos = ImmutableList.of(new VideoModel("Video 1.mp4", "https://app-1.koofr.net/content/files/get/Video+1.mp4?base=TESTBASE", null, "video/mp4", "/Album 2 :heart:/Video 1.mp4", "/Album 2 :heart:", false), new VideoModel("Video 2.mp4", "https://app-1.koofr.net/content/files/get/Video+2.mp4?base=TESTBASE", "Video 3 description", "video/mp4", "/Videos/Video 2.mp4", "/Videos", false));
    assertEquals(expectedVideos, exportedData.getVideos());
}
Also used : VideosContainerResource(org.datatransferproject.types.common.models.videos.VideosContainerResource) UUID(java.util.UUID) VideoAlbum(org.datatransferproject.types.common.models.videos.VideoAlbum) VideoModel(org.datatransferproject.types.common.models.videos.VideoModel) Test(org.junit.Test)

Example 8 with VideoModel

use of org.datatransferproject.types.common.models.videos.VideoModel in project data-transfer-project by google.

the class GoogleVideosExporterTest method exportSingleVideo.

@Test
public void exportSingleVideo() throws IOException {
    when(albumListResponse.getNextPageToken()).thenReturn(null);
    GoogleMediaItem mediaItem = setUpSingleVideo(VIDEO_URI, VIDEO_ID);
    when(mediaItemSearchResponse.getMediaItems()).thenReturn(new GoogleMediaItem[] { mediaItem });
    when(mediaItemSearchResponse.getNextPageToken()).thenReturn(VIDEO_TOKEN);
    // Run test
    ExportResult<VideosContainerResource> result = googleVideosExporter.exportVideos(null, Optional.empty());
    // Verify correct methods were called
    verify(videosInterface).listVideoItems(Optional.empty());
    verify(mediaItemSearchResponse).getMediaItems();
    // Check pagination
    ContinuationData continuationData = result.getContinuationData();
    StringPaginationToken paginationToken = (StringPaginationToken) continuationData.getPaginationData();
    assertThat(paginationToken.getToken()).isEqualTo(VIDEO_TOKEN);
    // Check videos field of container
    Collection<VideoModel> actualVideos = result.getExportedData().getVideos();
    URI video_uri_object = null;
    try {
        video_uri_object = new URI(VIDEO_URI + "=dv");
    } catch (URISyntaxException e) {
        e.printStackTrace();
    }
    assertThat(actualVideos.stream().map(VideoModel::getContentUrl).collect(Collectors.toList())).containsExactly(video_uri_object);
    // Since albums are not supported atm, this should be null
    assertThat(actualVideos.stream().map(VideoModel::getAlbumId).collect(Collectors.toList())).containsExactly((Object) null);
}
Also used : VideosContainerResource(org.datatransferproject.types.common.models.videos.VideosContainerResource) ContinuationData(org.datatransferproject.spi.transfer.types.ContinuationData) GoogleMediaItem(org.datatransferproject.datatransfer.google.mediaModels.GoogleMediaItem) URISyntaxException(java.net.URISyntaxException) VideoModel(org.datatransferproject.types.common.models.videos.VideoModel) URI(java.net.URI) StringPaginationToken(org.datatransferproject.types.common.StringPaginationToken) Test(org.junit.Test)

Example 9 with VideoModel

use of org.datatransferproject.types.common.models.videos.VideoModel in project data-transfer-project by google.

the class MediaContainerResource method ensureRootAlbum.

// Ensures that the model obeys the restrictions of the destination service, grouping all
// un-nested photos into their own root album if allowRootPhotos is true, noop otherwise
void ensureRootAlbum(boolean allowRootPhotos) {
    if (allowRootPhotos) {
        return;
    }
    MediaAlbum rootAlbum = new MediaAlbum(ROOT_ALBUM, ROOT_ALBUM, "A copy of your transferred media that were not in any album");
    boolean usedRootAlbum = false;
    for (PhotoModel photo : photos) {
        if (photo.getAlbumId() == null) {
            photo.reassignToAlbum(rootAlbum.getId());
            usedRootAlbum = true;
        }
    }
    for (VideoModel video : videos) {
        if (video.getAlbumId() == null) {
            video.reassignToAlbum(rootAlbum.getId());
            usedRootAlbum = true;
        }
    }
    if (usedRootAlbum) {
        albums.add(rootAlbum);
    }
}
Also used : PhotoModel(org.datatransferproject.types.common.models.photos.PhotoModel) VideoModel(org.datatransferproject.types.common.models.videos.VideoModel)

Example 10 with VideoModel

use of org.datatransferproject.types.common.models.videos.VideoModel in project data-transfer-project by google.

the class KoofrVideosImporterTest method testImportItemFromURLWithAlbum.

@Test
public void testImportItemFromURLWithAlbum() throws Exception {
    server.enqueue(new MockResponse().setResponseCode(200).setBody("123"));
    server.enqueue(new MockResponse().setResponseCode(200).setBody("4567"));
    server.enqueue(new MockResponse().setResponseCode(200).setBody("89"));
    when(client.ensureRootFolder()).thenReturn("/root");
    when(executor.getCachedValue(eq("id1"))).thenReturn("/root/Album 1");
    when(executor.getCachedValue(eq("id2"))).thenReturn("/root/Album");
    when(client.fileExists("/root/Album 1/video1.mp4")).thenReturn(false);
    when(client.fileExists("/root/Album 1/video2.mp4")).thenReturn(true);
    when(client.fileExists("/root/Album/video3.mp4")).thenReturn(false);
    String description1000 = new String(new char[1000]).replace("\0", "a");
    String description1001 = new String(new char[1001]).replace("\0", "a");
    UUID jobId = UUID.randomUUID();
    Collection<VideoAlbum> albums = ImmutableList.of(new VideoAlbum("id1", "Album 1", "This is a fake album"), new VideoAlbum("id2", "", description1001));
    Collection<VideoModel> videos = ImmutableList.of(new VideoModel("video1.mp4", server.url("/1.mp4").toString(), "A video 1", "video/mp4", "video1", "id1", false), new VideoModel("video2.mp4", server.url("/2.mp4").toString(), "A video 2", "video/mp4", "video2", "id1", false), new VideoModel("video3.mp4", server.url("/3.mp4").toString(), description1001, "video/mp4", "video3", "id2", false));
    VideosContainerResource resource = spy(new VideosContainerResource(albums, videos));
    importer.importItem(jobId, executor, authData, resource);
    InOrder clientInOrder = Mockito.inOrder(client);
    clientInOrder.verify(client).ensureRootFolder();
    clientInOrder.verify(client).ensureFolder("/root", "Album 1");
    clientInOrder.verify(client).addDescription("/root/Album 1", "This is a fake album");
    clientInOrder.verify(client).ensureFolder("/root", "Album");
    clientInOrder.verify(client).addDescription("/root/Album", description1000);
    clientInOrder.verify(client).fileExists(eq("/root/Album 1/video1.mp4"));
    clientInOrder.verify(client).uploadFile(eq("/root/Album 1"), eq("video1.mp4"), any(), eq("video/mp4"), isNull(), eq("A video 1"));
    clientInOrder.verify(client).fileExists(eq("/root/Album 1/video2.mp4"));
    clientInOrder.verify(client).fileExists(eq("/root/Album/video3.mp4"));
    clientInOrder.verify(client).uploadFile(eq("/root/Album"), eq("video3.mp4"), any(), eq("video/mp4"), isNull(), eq(description1000));
    clientInOrder.verifyNoMoreInteractions();
}
Also used : MockResponse(okhttp3.mockwebserver.MockResponse) InOrder(org.mockito.InOrder) VideosContainerResource(org.datatransferproject.types.common.models.videos.VideosContainerResource) UUID(java.util.UUID) VideoAlbum(org.datatransferproject.types.common.models.videos.VideoAlbum) VideoModel(org.datatransferproject.types.common.models.videos.VideoModel) Test(org.junit.Test)

Aggregations

VideoModel (org.datatransferproject.types.common.models.videos.VideoModel)21 Test (org.junit.Test)12 VideosContainerResource (org.datatransferproject.types.common.models.videos.VideosContainerResource)11 UUID (java.util.UUID)6 VideoAlbum (org.datatransferproject.types.common.models.videos.VideoAlbum)6 ArrayList (java.util.ArrayList)5 PhotosLibraryClient (com.google.photos.library.v1.PhotosLibraryClient)4 BatchCreateMediaItemsResponse (com.google.photos.library.v1.proto.BatchCreateMediaItemsResponse)4 NewMediaItemResult (com.google.photos.library.v1.proto.NewMediaItemResult)4 Monitor (org.datatransferproject.api.launcher.Monitor)4 NewMediaItem (com.google.photos.library.v1.proto.NewMediaItem)3 FileNotFoundException (java.io.FileNotFoundException)3 IOException (java.io.IOException)3 MockResponse (okhttp3.mockwebserver.MockResponse)3 ExportResult (org.datatransferproject.spi.transfer.provider.ExportResult)3 InOrder (org.mockito.InOrder)3 InvalidArgumentException (com.google.api.gax.rpc.InvalidArgumentException)2 VisibleForTesting (com.google.common.annotations.VisibleForTesting)2 Status (com.google.rpc.Status)2 HttpURLConnection (java.net.HttpURLConnection)2