Examples with NonOffloaded org.apache.flink.runtime.deployment.TaskDeploymentDescriptor.NonOffloaded used on opensource projects

Example 1 with NonOffloaded

use of org.apache.flink.runtime.deployment.TaskDeploymentDescriptor.NonOffloaded in project flink by apache.

the class InputGateDeploymentDescriptor method loadBigData.

public void loadBigData(@Nullable PermanentBlobService blobService, JobID jobId) throws IOException, ClassNotFoundException {
    if (serializedInputChannels instanceof Offloaded) {
        PermanentBlobKey blobKey = ((Offloaded<ShuffleDescriptor[]>) serializedInputChannels).serializedValueKey;
        Preconditions.checkNotNull(blobService);
        // NOTE: Do not delete the ShuffleDescriptor BLOBs since it may be needed again during
        // recovery. (it is deleted automatically on the BLOB server and cache when its
        // partition is no longer available or the job enters a terminal state)
        CompressedSerializedValue<ShuffleDescriptor[]> serializedValue = CompressedSerializedValue.fromBytes(blobService.readFile(jobId, blobKey));
        serializedInputChannels = new NonOffloaded<>(serializedValue);
        Preconditions.checkNotNull(serializedInputChannels);
    }
}