Search in sources :

Example 11 with StormMetricRegistry

use of org.apache.storm.metrics2.StormMetricRegistry in project storm by apache.

the class BackPressureTrackerTest method testRefreshBackPressureWithNonEmptyOverflow.

@Test
public void testRefreshBackPressureWithNonEmptyOverflow() {
    int taskId = 1;
    JCQueue queue = mock(JCQueue.class);
    when(queue.isEmptyOverflow()).thenReturn(false);
    BackPressureTracker tracker = new BackPressureTracker(WORKER_ID, ImmutableMap.of(taskId, queue), new StormMetricRegistry(), ImmutableMap.of(taskId, "component-1"));
    BackpressureState state = tracker.getBackpressureState(taskId);
    tracker.recordBackPressure(state);
    boolean backpressureChanged = tracker.refreshBpTaskList();
    BackPressureStatus status = tracker.getCurrStatus();
    assertThat(backpressureChanged, is(false));
    assertThat(status.workerId, is(WORKER_ID));
    assertThat(status.bpTasks, contains(taskId));
}
Also used : JCQueue(org.apache.storm.utils.JCQueue) BackpressureState(org.apache.storm.daemon.worker.BackPressureTracker.BackpressureState) BackPressureStatus(org.apache.storm.messaging.netty.BackPressureStatus) StormMetricRegistry(org.apache.storm.metrics2.StormMetricRegistry) Test(org.junit.Test)

Example 12 with StormMetricRegistry

use of org.apache.storm.metrics2.StormMetricRegistry in project storm by apache.

the class BackPressureTrackerTest method testSetBackpressure.

@Test
public void testSetBackpressure() {
    int taskIdNoBackPressure = 1;
    JCQueue noBackPressureQueue = mock(JCQueue.class);
    int taskIdBackPressure = 2;
    JCQueue backPressureQueue = mock(JCQueue.class);
    BackPressureTracker tracker = new BackPressureTracker(WORKER_ID, ImmutableMap.of(taskIdNoBackPressure, noBackPressureQueue, taskIdBackPressure, backPressureQueue), new StormMetricRegistry(), ImmutableMap.of(taskIdNoBackPressure, "NoBackPressureComponent", taskIdBackPressure, "BackPressureComponent"));
    BackpressureState state = tracker.getBackpressureState(taskIdBackPressure);
    boolean backpressureChanged = tracker.recordBackPressure(state);
    BackPressureStatus status = tracker.getCurrStatus();
    assertThat(backpressureChanged, is(true));
    assertThat(status.workerId, is(WORKER_ID));
    assertThat(status.nonBpTasks, contains(taskIdNoBackPressure));
    assertThat(status.bpTasks, contains(taskIdBackPressure));
}
Also used : JCQueue(org.apache.storm.utils.JCQueue) BackpressureState(org.apache.storm.daemon.worker.BackPressureTracker.BackpressureState) BackPressureStatus(org.apache.storm.messaging.netty.BackPressureStatus) StormMetricRegistry(org.apache.storm.metrics2.StormMetricRegistry) Test(org.junit.Test)

Example 13 with StormMetricRegistry

use of org.apache.storm.metrics2.StormMetricRegistry in project storm by apache.

the class JCQueuePerfTest method oneProducer2Consumers.

private static void oneProducer2Consumers(int prodBatchSz) {
    WaitStrategyPark ws = new WaitStrategyPark(100);
    StormMetricRegistry registry = new StormMetricRegistry();
    JCQueue q1 = new JCQueue("q1", "q1", 1024, 0, prodBatchSz, ws, "test", "test", Collections.singletonList(1000), 1000, registry);
    JCQueue q2 = new JCQueue("q2", "q2", 1024, 0, prodBatchSz, ws, "test", "test", Collections.singletonList(1000), 1000, registry);
    final Producer2 prod1 = new Producer2(q1, q2);
    final Consumer cons1 = new Consumer(q1);
    final Consumer cons2 = new Consumer(q2);
    runAllThds(prod1, cons1, cons2);
}
Also used : JCQueue(org.apache.storm.utils.JCQueue) WaitStrategyPark(org.apache.storm.policy.WaitStrategyPark) StormMetricRegistry(org.apache.storm.metrics2.StormMetricRegistry)

Aggregations

StormMetricRegistry (org.apache.storm.metrics2.StormMetricRegistry)13 JCQueue (org.apache.storm.utils.JCQueue)13 WaitStrategyPark (org.apache.storm.policy.WaitStrategyPark)7 Test (org.junit.Test)6 BackpressureState (org.apache.storm.daemon.worker.BackPressureTracker.BackpressureState)5 BackPressureStatus (org.apache.storm.messaging.netty.BackPressureStatus)5 HashMap (java.util.HashMap)1 WorkerState (org.apache.storm.daemon.worker.WorkerState)1 WorkerTransfer (org.apache.storm.daemon.worker.WorkerTransfer)1 StormTopology (org.apache.storm.generated.StormTopology)1 GeneralTopologyContext (org.apache.storm.task.GeneralTopologyContext)1 WorkerTopologyContext (org.apache.storm.task.WorkerTopologyContext)1 Before (org.junit.Before)1