Search in sources :

Example 1 with ReadRequest

use of com.google.bytestream.ByteStreamProto.ReadRequest in project tools_remote by bazelbuild.

the class GrpcRemoteCacheTest method testDownloadBlobSingleChunk.

@Test
public void testDownloadBlobSingleChunk() throws Exception {
    final GrpcRemoteCache client = newClient();
    final Digest digest = DIGEST_UTIL.computeAsUtf8("abcdefg");
    serviceRegistry.addService(new ByteStreamImplBase() {

        @Override
        public void read(ReadRequest request, StreamObserver<ReadResponse> responseObserver) {
            assertThat(request.getResourceName().contains(digest.getHash())).isTrue();
            responseObserver.onNext(ReadResponse.newBuilder().setData(ByteString.copyFromUtf8("abcdefg")).build());
            responseObserver.onCompleted();
        }
    });
    assertThat(new String(client.downloadBlob(digest), UTF_8)).isEqualTo("abcdefg");
}
Also used : Digest(build.bazel.remote.execution.v2.Digest) ReadResponse(com.google.bytestream.ByteStreamProto.ReadResponse) ByteStreamImplBase(com.google.bytestream.ByteStreamGrpc.ByteStreamImplBase) ByteString(com.google.protobuf.ByteString) ReadRequest(com.google.bytestream.ByteStreamProto.ReadRequest) Test(org.junit.Test)

Example 2 with ReadRequest

use of com.google.bytestream.ByteStreamProto.ReadRequest in project bazel-buildfarm by bazelbuild.

the class GrpcCASTest method onExpirationCalledWhenNotFound.

@Test
public void onExpirationCalledWhenNotFound() {
    Digest digest = DIGEST_UTIL.compute(ByteString.copyFromUtf8("nonexistent"));
    String instanceName = "test";
    final AtomicReference<Boolean> readCalled = new AtomicReference<>(false);
    serviceRegistry.addService(new ByteStreamImplBase() {

        @Override
        public void read(ReadRequest request, StreamObserver<ReadResponse> responseObserver) {
            assertThat(request.getResourceName()).isEqualTo(String.format("%s/blobs/%s", instanceName, DigestUtil.toString(digest)));
            readCalled.compareAndSet(false, true);
            responseObserver.onError(Status.NOT_FOUND.asException());
        }
    });
    Runnable onExpiration = mock(Runnable.class);
    onExpirations.put(digest, onExpiration);
    GrpcCAS cas = new GrpcCAS(instanceName, InProcessChannelBuilder.forName(fakeServerName).directExecutor().build(), mock(ByteStreamUploader.class), onExpirations);
    assertThat(cas.get(digest)).isNull();
    assertThat(readCalled.get()).isTrue();
    verify(onExpiration, times(1)).run();
}
Also used : ByteStreamUploader(build.buildfarm.instance.stub.ByteStreamUploader) Digest(build.bazel.remote.execution.v2.Digest) ByteStreamImplBase(com.google.bytestream.ByteStreamGrpc.ByteStreamImplBase) AtomicReference(java.util.concurrent.atomic.AtomicReference) ByteString(com.google.protobuf.ByteString) ReadResponse(com.google.bytestream.ByteStreamProto.ReadResponse) ReadRequest(com.google.bytestream.ByteStreamProto.ReadRequest) Test(org.junit.Test)

Example 3 with ReadRequest

use of com.google.bytestream.ByteStreamProto.ReadRequest in project bazel-buildfarm by bazelbuild.

the class StubInstanceTest method inputStreamRetriesOnDeadlineExceededWithProgress.

@Test
public void inputStreamRetriesOnDeadlineExceededWithProgress() throws IOException, InterruptedException {
    ByteString content = ByteString.copyFromUtf8("1");
    serviceRegistry.addService(new ByteStreamImplBase() {

        boolean first = true;

        @Override
        public void read(ReadRequest request, StreamObserver<ReadResponse> responseObserver) {
            if (first && request.getReadOffset() == 0) {
                first = false;
                responseObserver.onNext(ReadResponse.newBuilder().setData(content).build());
                responseObserver.onError(Status.DEADLINE_EXCEEDED.asException());
            } else if (request.getReadOffset() == 1) {
                responseObserver.onCompleted();
            } else {
                // all others fail with unimplemented
                responseObserver.onError(Status.UNIMPLEMENTED.asException());
            }
        }
    });
    Instance instance = newStubInstance("input-stream-stalled");
    ByteArrayOutputStream out = new ByteArrayOutputStream();
    Digest delayedDigest = Digest.newBuilder().setHash("delayed-blob-name").setSizeBytes(1).build();
    try (InputStream in = instance.newBlobInput(delayedDigest, 0, 1, SECONDS, RequestMetadata.getDefaultInstance())) {
        ByteStreams.copy(in, out);
    }
    assertThat(ByteString.copyFrom(out.toByteArray())).isEqualTo(content);
    instance.stop();
}
Also used : ReadResponse(com.google.bytestream.ByteStreamProto.ReadResponse) Instance(build.buildfarm.instance.Instance) Digest(build.bazel.remote.execution.v2.Digest) ByteString(com.google.protobuf.ByteString) InputStream(java.io.InputStream) ByteStreamImplBase(com.google.bytestream.ByteStreamGrpc.ByteStreamImplBase) ByteArrayOutputStream(java.io.ByteArrayOutputStream) ReadRequest(com.google.bytestream.ByteStreamProto.ReadRequest) Test(org.junit.Test)

Example 4 with ReadRequest

use of com.google.bytestream.ByteStreamProto.ReadRequest in project bazel-buildfarm by bazelbuild.

the class StubInstanceTest method readBlobInterchangeDoesNotRequestUntilStarted.

@SuppressWarnings("unchecked")
@Test
public void readBlobInterchangeDoesNotRequestUntilStarted() {
    ServerCallStreamObserver<ByteString> mockBlobObserver = mock(ServerCallStreamObserver.class);
    ReadBlobInterchange interchange = new ReadBlobInterchange(mockBlobObserver);
    ClientCallStreamObserver<ReadRequest> mockRequestStream = mock(ClientCallStreamObserver.class);
    interchange.beforeStart(mockRequestStream);
    // verify our flow control call so that we can verify no further interactions
    verify(mockRequestStream, times(1)).disableAutoInboundFlowControl();
    // capture onReady from mockBlobObserver
    ArgumentCaptor<Runnable> onReadyCaptor = ArgumentCaptor.forClass(Runnable.class);
    verify(mockBlobObserver, times(1)).setOnReadyHandler(onReadyCaptor.capture());
    // call it
    onReadyCaptor.getValue().run();
    // verify zero interactions with mockRequestStream
    verifyZeroInteractions(mockRequestStream);
}
Also used : ReadBlobInterchange(build.buildfarm.instance.stub.StubInstance.ReadBlobInterchange) ByteString(com.google.protobuf.ByteString) ReadRequest(com.google.bytestream.ByteStreamProto.ReadRequest) Test(org.junit.Test)

Example 5 with ReadRequest

use of com.google.bytestream.ByteStreamProto.ReadRequest in project bazel-buildfarm by bazelbuild.

the class StubInstanceTest method inputStreamThrowsNonDeadlineExceededCausal.

@Test
public void inputStreamThrowsNonDeadlineExceededCausal() throws IOException, InterruptedException {
    serviceRegistry.addService(new ByteStreamImplBase() {

        @Override
        public void read(ReadRequest request, StreamObserver<ReadResponse> responseObserver) {
            responseObserver.onError(Status.UNAVAILABLE.asException());
        }
    });
    OutputStream out = mock(OutputStream.class);
    IOException ioException = null;
    Instance instance = newStubInstance("input-stream-non-deadline-exceeded");
    Digest unavailableDigest = Digest.newBuilder().setHash("unavailable-blob-name").setSizeBytes(1).build();
    try (InputStream in = instance.newBlobInput(unavailableDigest, 0, 1, SECONDS, RequestMetadata.getDefaultInstance())) {
        ByteStreams.copy(in, out);
    } catch (IOException e) {
        ioException = e;
    }
    assertThat(ioException).isNotNull();
    Status status = Status.fromThrowable(ioException);
    assertThat(status.getCode()).isEqualTo(Code.UNAVAILABLE);
    verifyZeroInteractions(out);
    instance.stop();
}
Also used : Status(io.grpc.Status) ReadResponse(com.google.bytestream.ByteStreamProto.ReadResponse) Instance(build.buildfarm.instance.Instance) Digest(build.bazel.remote.execution.v2.Digest) InputStream(java.io.InputStream) ByteArrayOutputStream(java.io.ByteArrayOutputStream) OutputStream(java.io.OutputStream) ByteStreamImplBase(com.google.bytestream.ByteStreamGrpc.ByteStreamImplBase) IOException(java.io.IOException) ReadRequest(com.google.bytestream.ByteStreamProto.ReadRequest) Test(org.junit.Test)

Aggregations

ReadRequest (com.google.bytestream.ByteStreamProto.ReadRequest)14 ReadResponse (com.google.bytestream.ByteStreamProto.ReadResponse)12 Test (org.junit.Test)12 ByteString (com.google.protobuf.ByteString)11 Digest (build.bazel.remote.execution.v2.Digest)10 ByteStreamImplBase (com.google.bytestream.ByteStreamGrpc.ByteStreamImplBase)7 IOException (java.io.IOException)5 InputStream (java.io.InputStream)5 Instance (build.buildfarm.instance.Instance)4 Status (io.grpc.Status)4 OutputStream (java.io.OutputStream)4 ByteStreamUploader (build.buildfarm.instance.stub.ByteStreamUploader)3 Channel (io.grpc.Channel)3 StreamObserver (io.grpc.stub.StreamObserver)3 ByteArrayOutputStream (java.io.ByteArrayOutputStream)3 ByteStreamStub (com.google.bytestream.ByteStreamGrpc.ByteStreamStub)2 NoSuchFileException (java.nio.file.NoSuchFileException)2 RequestMetadata (build.bazel.remote.execution.v2.RequestMetadata)1 DigestUtil (build.buildfarm.common.DigestUtil)1 SHA256 (build.buildfarm.common.DigestUtil.HashFunction.SHA256)1