Search in sources :

Example 6 with WeaveController

use of com.continuuity.weave.api.WeaveController in project weave by continuuity.

the class ControllerTest method getController.

private WeaveController getController(ZKClient zkClient, RunId runId) {
    WeaveController controller = new AbstractWeaveController(runId, zkClient, ImmutableList.<LogHandler>of()) {

        @Override
        public void kill() {
        // No-op
        }

        @Override
        protected void instanceNodeUpdated(NodeData nodeData) {
        // No-op
        }

        @Override
        protected void stateNodeUpdated(StateNode stateNode) {
        // No-op
        }

        @Override
        public ResourceReport getResourceReport() {
            return null;
        }
    };
    controller.startAndWait();
    return controller;
}
Also used : StateNode(com.continuuity.weave.internal.state.StateNode) WeaveController(com.continuuity.weave.api.WeaveController) NodeData(com.continuuity.weave.zookeeper.NodeData)

Example 7 with WeaveController

use of com.continuuity.weave.api.WeaveController in project weave by continuuity.

the class DistributeShellTestRun method testDistributedShell.

@Ignore
@Test
public void testDistributedShell() throws InterruptedException {
    WeaveRunner weaveRunner = YarnTestSuite.getWeaveRunner();
    WeaveController controller = weaveRunner.prepare(new DistributedShell("pwd", "ls -al")).addLogHandler(new PrinterLogHandler(new PrintWriter(System.out))).start();
    final CountDownLatch stopLatch = new CountDownLatch(1);
    controller.addListener(new ServiceListenerAdapter() {

        @Override
        public void terminated(Service.State from) {
            stopLatch.countDown();
        }

        @Override
        public void failed(Service.State from, Throwable failure) {
            stopLatch.countDown();
        }
    }, Threads.SAME_THREAD_EXECUTOR);
    Assert.assertTrue(stopLatch.await(10, TimeUnit.SECONDS));
}
Also used : WeaveRunner(com.continuuity.weave.api.WeaveRunner) PrinterLogHandler(com.continuuity.weave.api.logging.PrinterLogHandler) Service(com.google.common.util.concurrent.Service) WeaveController(com.continuuity.weave.api.WeaveController) ServiceListenerAdapter(com.continuuity.weave.common.ServiceListenerAdapter) CountDownLatch(java.util.concurrent.CountDownLatch) PrintWriter(java.io.PrintWriter) Ignore(org.junit.Ignore) Test(org.junit.Test)

Example 8 with WeaveController

use of com.continuuity.weave.api.WeaveController in project weave by continuuity.

the class EchoServerTestRun method testEchoServer.

@Test
public void testEchoServer() throws InterruptedException, ExecutionException, IOException, URISyntaxException, TimeoutException {
    WeaveRunner runner = YarnTestSuite.getWeaveRunner();
    WeaveController controller = runner.prepare(new EchoServer(), ResourceSpecification.Builder.with().setVirtualCores(1).setMemory(1, ResourceSpecification.SizeUnit.GIGA).setInstances(2).build()).addLogHandler(new PrinterLogHandler(new PrintWriter(System.out, true))).withApplicationArguments("echo").withArguments("EchoServer", "echo2").start();
    final CountDownLatch running = new CountDownLatch(1);
    controller.addListener(new ServiceListenerAdapter() {

        @Override
        public void running() {
            running.countDown();
        }
    }, Threads.SAME_THREAD_EXECUTOR);
    Assert.assertTrue(running.await(30, TimeUnit.SECONDS));
    Iterable<Discoverable> echoServices = controller.discoverService("echo");
    Assert.assertTrue(YarnTestSuite.waitForSize(echoServices, 2, 60));
    for (Discoverable discoverable : echoServices) {
        String msg = "Hello: " + discoverable.getSocketAddress();
        Socket socket = new Socket(discoverable.getSocketAddress().getAddress(), discoverable.getSocketAddress().getPort());
        try {
            PrintWriter writer = new PrintWriter(new OutputStreamWriter(socket.getOutputStream(), Charsets.UTF_8), true);
            LineReader reader = new LineReader(new InputStreamReader(socket.getInputStream(), Charsets.UTF_8));
            writer.println(msg);
            Assert.assertEquals(msg, reader.readLine());
        } finally {
            socket.close();
        }
    }
    // Increase number of instances
    controller.changeInstances("EchoServer", 3);
    Assert.assertTrue(YarnTestSuite.waitForSize(echoServices, 3, 60));
    echoServices = controller.discoverService("echo2");
    // Decrease number of instances
    controller.changeInstances("EchoServer", 1);
    Assert.assertTrue(YarnTestSuite.waitForSize(echoServices, 1, 60));
    // Increase number of instances again
    controller.changeInstances("EchoServer", 2);
    Assert.assertTrue(YarnTestSuite.waitForSize(echoServices, 2, 60));
    // Make sure still only one app is running
    Iterable<WeaveRunner.LiveInfo> apps = runner.lookupLive();
    Assert.assertTrue(YarnTestSuite.waitForSize(apps, 1, 60));
    // Creates a new runner service to check it can regain control over running app.
    WeaveRunnerService runnerService = YarnTestSuite.createWeaveRunnerService();
    runnerService.startAndWait();
    try {
        Iterable<WeaveController> controllers = runnerService.lookup("EchoServer");
        Assert.assertTrue(YarnTestSuite.waitForSize(controllers, 1, 60));
        for (WeaveController c : controllers) {
            LOG.info("Stopping application: " + c.getRunId());
            c.stop().get(30, TimeUnit.SECONDS);
        }
        Assert.assertTrue(YarnTestSuite.waitForSize(apps, 0, 60));
    } finally {
        runnerService.stopAndWait();
    }
    // Sleep a bit before exiting.
    TimeUnit.SECONDS.sleep(2);
}
Also used : WeaveRunner(com.continuuity.weave.api.WeaveRunner) Discoverable(com.continuuity.weave.discovery.Discoverable) InputStreamReader(java.io.InputStreamReader) ServiceListenerAdapter(com.continuuity.weave.common.ServiceListenerAdapter) CountDownLatch(java.util.concurrent.CountDownLatch) LineReader(com.google.common.io.LineReader) PrinterLogHandler(com.continuuity.weave.api.logging.PrinterLogHandler) WeaveController(com.continuuity.weave.api.WeaveController) OutputStreamWriter(java.io.OutputStreamWriter) WeaveRunnerService(com.continuuity.weave.api.WeaveRunnerService) Socket(java.net.Socket) PrintWriter(java.io.PrintWriter) Test(org.junit.Test)

Example 9 with WeaveController

use of com.continuuity.weave.api.WeaveController in project weave by continuuity.

the class ProvisionTimeoutTestRun method testProvisionTimeout.

@Test
public void testProvisionTimeout() throws InterruptedException, ExecutionException, TimeoutException {
    WeaveRunner runner = YarnTestSuite.getWeaveRunner();
    WeaveController controller = runner.prepare(new TimeoutApplication()).addLogHandler(new PrinterLogHandler(new PrintWriter(System.out, true))).start();
    // Hence we give 90 seconds max time here.
    try {
        Services.getCompletionFuture(controller).get(90, TimeUnit.SECONDS);
    } finally {
        // If it timeout, kill the app as cleanup.
        controller.kill();
    }
}
Also used : WeaveRunner(com.continuuity.weave.api.WeaveRunner) PrinterLogHandler(com.continuuity.weave.api.logging.PrinterLogHandler) WeaveController(com.continuuity.weave.api.WeaveController) PrintWriter(java.io.PrintWriter) Test(org.junit.Test)

Example 10 with WeaveController

use of com.continuuity.weave.api.WeaveController in project weave by continuuity.

the class ResourceReportTestRun method testResourceReportWithFailingContainers.

@Test
public void testResourceReportWithFailingContainers() throws InterruptedException, IOException, TimeoutException, ExecutionException {
    WeaveRunner runner = YarnTestSuite.getWeaveRunner();
    ResourceSpecification resourceSpec = ResourceSpecification.Builder.with().setVirtualCores(1).setMemory(128, ResourceSpecification.SizeUnit.MEGA).setInstances(2).build();
    WeaveController controller = runner.prepare(new BuggyServer(), resourceSpec).addLogHandler(new PrinterLogHandler(new PrintWriter(System.out, true))).withApplicationArguments("echo").withArguments("BuggyServer", "echo2").start();
    final CountDownLatch running = new CountDownLatch(1);
    controller.addListener(new ServiceListenerAdapter() {

        @Override
        public void running() {
            running.countDown();
        }
    }, Threads.SAME_THREAD_EXECUTOR);
    Assert.assertTrue(running.await(30, TimeUnit.SECONDS));
    Iterable<Discoverable> echoServices = controller.discoverService("echo");
    Assert.assertTrue(YarnTestSuite.waitForSize(echoServices, 2, 60));
    // check that we have 2 runnables.
    ResourceReport report = controller.getResourceReport();
    Assert.assertEquals(2, report.getRunnableResources("BuggyServer").size());
    // cause a divide by 0 in one server
    Discoverable discoverable = echoServices.iterator().next();
    Socket socket = new Socket(discoverable.getSocketAddress().getAddress(), discoverable.getSocketAddress().getPort());
    try {
        PrintWriter writer = new PrintWriter(new OutputStreamWriter(socket.getOutputStream(), Charsets.UTF_8), true);
        writer.println("0");
    } finally {
        socket.close();
    }
    // takes some time for app master to find out the container completed...
    TimeUnit.SECONDS.sleep(5);
    // check that we have 1 runnable, not 2.
    report = controller.getResourceReport();
    Assert.assertEquals(1, report.getRunnableResources("BuggyServer").size());
    controller.stop().get(30, TimeUnit.SECONDS);
    // Sleep a bit before exiting.
    TimeUnit.SECONDS.sleep(2);
}
Also used : WeaveRunner(com.continuuity.weave.api.WeaveRunner) Discoverable(com.continuuity.weave.discovery.Discoverable) ServiceListenerAdapter(com.continuuity.weave.common.ServiceListenerAdapter) ResourceSpecification(com.continuuity.weave.api.ResourceSpecification) CountDownLatch(java.util.concurrent.CountDownLatch) PrinterLogHandler(com.continuuity.weave.api.logging.PrinterLogHandler) WeaveController(com.continuuity.weave.api.WeaveController) ResourceReport(com.continuuity.weave.api.ResourceReport) OutputStreamWriter(java.io.OutputStreamWriter) Socket(java.net.Socket) PrintWriter(java.io.PrintWriter) Test(org.junit.Test)

Aggregations

WeaveController (com.continuuity.weave.api.WeaveController)13 Test (org.junit.Test)12 WeaveRunner (com.continuuity.weave.api.WeaveRunner)9 PrinterLogHandler (com.continuuity.weave.api.logging.PrinterLogHandler)9 ServiceListenerAdapter (com.continuuity.weave.common.ServiceListenerAdapter)9 PrintWriter (java.io.PrintWriter)9 CountDownLatch (java.util.concurrent.CountDownLatch)9 Discoverable (com.continuuity.weave.discovery.Discoverable)6 Service (com.google.common.util.concurrent.Service)5 OutputStreamWriter (java.io.OutputStreamWriter)4 Socket (java.net.Socket)4 ResourceSpecification (com.continuuity.weave.api.ResourceSpecification)3 RunId (com.continuuity.weave.api.RunId)3 InMemoryZKServer (com.continuuity.weave.internal.zookeeper.InMemoryZKServer)3 ZKClientService (com.continuuity.weave.zookeeper.ZKClientService)3 LineReader (com.google.common.io.LineReader)3 AbstractIdleService (com.google.common.util.concurrent.AbstractIdleService)3 InputStreamReader (java.io.InputStreamReader)3 ResourceReport (com.continuuity.weave.api.ResourceReport)2 WeaveRunResources (com.continuuity.weave.api.WeaveRunResources)1