Examples with HyperLogLog io.airlift.stats.cardinality.HyperLogLog used on opensource projects

Example 11 with HyperLogLog

use of io.airlift.stats.cardinality.HyperLogLog in project presto by prestodb.

the class ApproximateCountDistinctAggregations method inputBinary.

@InputFunction
public static void inputBinary(@AggregationState HyperLogLogState state, @SqlType(StandardTypes.VARBINARY) Slice value, @SqlType(StandardTypes.DOUBLE) double maxStandardError) {
    HyperLogLog hll = getOrCreateHyperLogLog(state, maxStandardError);
    state.addMemoryUsage(-hll.estimatedInMemorySize());
    hll.add(value);
    state.addMemoryUsage(hll.estimatedInMemorySize());
}

Example 12 with HyperLogLog

use of io.airlift.stats.cardinality.HyperLogLog in project presto by prestodb.

the class ApproximateCountDistinctAggregations method getOrCreateHyperLogLog.

private static HyperLogLog getOrCreateHyperLogLog(HyperLogLogState state, double maxStandardError) {
    HyperLogLog hll = state.getHyperLogLog();
    if (hll == null) {
        hll = HyperLogLog.newInstance(standardErrorToBuckets(maxStandardError));
        state.setHyperLogLog(hll);
        state.addMemoryUsage(hll.estimatedInMemorySize());
    }
    return hll;
}

Example 13 with HyperLogLog

use of io.airlift.stats.cardinality.HyperLogLog in project presto by prestodb.

the class ApproximateCountDistinctAggregations method combineState.

@CombineFunction
public static void combineState(@AggregationState HyperLogLogState state, @AggregationState HyperLogLogState otherState) {
    HyperLogLog input = otherState.getHyperLogLog();
    HyperLogLog previous = state.getHyperLogLog();
    if (previous == null) {
        state.setHyperLogLog(input);
        state.addMemoryUsage(input.estimatedInMemorySize());
    } else {
        state.addMemoryUsage(-previous.estimatedInMemorySize());
        previous.mergeWith(input);
        state.addMemoryUsage(previous.estimatedInMemorySize());
    }
}

Example 14 with HyperLogLog

use of io.airlift.stats.cardinality.HyperLogLog in project presto by prestodb.

the class ApproximateCountDistinctAggregations method input.

@InputFunction
public static void input(@AggregationState HyperLogLogState state, @SqlType(StandardTypes.BIGINT) long value, @SqlType(StandardTypes.DOUBLE) double maxStandardError) {
    HyperLogLog hll = getOrCreateHyperLogLog(state, maxStandardError);
    state.addMemoryUsage(-hll.estimatedInMemorySize());
    hll.add(value);
    state.addMemoryUsage(hll.estimatedInMemorySize());
}