Examples with HoodieException org.apache.hudi.exception.HoodieException used on opensource projects

Example 71 with HoodieException

use of org.apache.hudi.exception.HoodieException in project hudi by apache.

the class StreamerUtil method medianInstantTime.

/**
 * Returns the median instant time between the given two instant time.
 */
public static Option<String> medianInstantTime(String highVal, String lowVal) {
    try {
        long high = HoodieActiveTimeline.parseDateFromInstantTime(highVal).getTime();
        long low = HoodieActiveTimeline.parseDateFromInstantTime(lowVal).getTime();
        ValidationUtils.checkArgument(high > low, "Instant [" + highVal + "] should have newer timestamp than instant [" + lowVal + "]");
        long median = low + (high - low) / 2;
        final String instantTime = HoodieActiveTimeline.formatDate(new Date(median));
        if (HoodieTimeline.compareTimestamps(lowVal, HoodieTimeline.GREATER_THAN_OR_EQUALS, instantTime) || HoodieTimeline.compareTimestamps(highVal, HoodieTimeline.LESSER_THAN_OR_EQUALS, instantTime)) {
            return Option.empty();
        }
        return Option.of(instantTime);
    } catch (ParseException e) {
        throw new HoodieException("Get median instant time with interval [" + lowVal + ", " + highVal + "] error", e);
    }
}

Example 72 with HoodieException

use of org.apache.hudi.exception.HoodieException in project hudi by apache.

the class StreamerUtil method instantTimeDiffSeconds.

/**
 * Returns the time interval in seconds between the given instant time.
 */
public static long instantTimeDiffSeconds(String newInstantTime, String oldInstantTime) {
    try {
        long newTimestamp = HoodieActiveTimeline.parseDateFromInstantTime(newInstantTime).getTime();
        long oldTimestamp = HoodieActiveTimeline.parseDateFromInstantTime(oldInstantTime).getTime();
        return (newTimestamp - oldTimestamp) / 1000;
    } catch (ParseException e) {
        throw new HoodieException("Get instant time diff with interval [" + oldInstantTime + ", " + newInstantTime + "] error", e);
    }
}

Example 73 with HoodieException

use of org.apache.hudi.exception.HoodieException in project hudi by apache.

the class StreamWriteFunctionWrapper method checkpointComplete.

public void checkpointComplete(long checkpointId) {
    stateInitializationContext.getOperatorStateStore().checkpointSuccess(checkpointId);
    coordinator.notifyCheckpointComplete(checkpointId);
    this.bucketAssignerFunction.notifyCheckpointComplete(checkpointId);
    if (asyncCompaction) {
        try {
            compactFunctionWrapper.compact(checkpointId);
        } catch (Exception e) {
            throw new HoodieException(e);
        }
    }
}

Example 74 with HoodieException

use of org.apache.hudi.exception.HoodieException in project hudi by apache.

the class RecordReaderValueIterator method hasNext.

@Override
public boolean hasNext() {
    if (nextVal == null) {
        K key = reader.createKey();
        V val = reader.createValue();
        try {
            boolean notDone = reader.next(key, val);
            if (!notDone) {
                return false;
            }
            this.nextVal = val;
        } catch (IOException e) {
            LOG.error("Got error reading next record from record reader");
            throw new HoodieException(e);
        }
    }
    return true;
}

Example 75 with HoodieException

use of org.apache.hudi.exception.HoodieException in project hudi by apache.

the class TestJdbcbasedSchemaProvider method testJdbcbasedSchemaProvider.

@Test
public void testJdbcbasedSchemaProvider() throws Exception {
    try {
        initH2Database();
        Schema sourceSchema = UtilHelpers.createSchemaProvider(JdbcbasedSchemaProvider.class.getName(), PROPS, jsc()).getSourceSchema();
        assertEquals(sourceSchema.toString().toUpperCase(), new Schema.Parser().parse(UtilitiesTestBase.Helpers.readFile("delta-streamer-config/source-jdbc.avsc")).toString().toUpperCase());
    } catch (HoodieException e) {
        LOG.error("Failed to get connection through jdbc. ", e);
    }
}