Search in sources :

Example 1 with JobControl

use of com.yahoo.vespa.hosted.controller.maintenance.JobControl in project vespa by vespa-engine.

the class DeploymentTriggerTest method testUpgradingButNoJobStarted.

@Test
public void testUpgradingButNoJobStarted() {
    DeploymentTester tester = new DeploymentTester();
    ReadyJobsTrigger readyJobsTrigger = new ReadyJobsTrigger(tester.controller(), Duration.ofHours(1), new JobControl(tester.controllerTester().curator()));
    LockedApplication app = (LockedApplication) tester.createAndDeploy("default0", 3, "default");
    // Store that we are upgrading but don't start the system-tests job
    tester.controller().applications().store(app.withChange(Change.of(Version.fromString("6.2"))));
    assertEquals(0, tester.deploymentQueue().jobs().size());
    readyJobsTrigger.run();
    assertEquals(1, tester.deploymentQueue().jobs().size());
    assertEquals("system-test", tester.deploymentQueue().jobs().get(0).jobName());
}
Also used : LockedApplication(com.yahoo.vespa.hosted.controller.LockedApplication) JobControl(com.yahoo.vespa.hosted.controller.maintenance.JobControl) ReadyJobsTrigger(com.yahoo.vespa.hosted.controller.maintenance.ReadyJobsTrigger) JobType.systemTest(com.yahoo.vespa.hosted.controller.application.DeploymentJobs.JobType.systemTest) Test(org.junit.Test) JobType.stagingTest(com.yahoo.vespa.hosted.controller.application.DeploymentJobs.JobType.stagingTest)

Example 2 with JobControl

use of com.yahoo.vespa.hosted.controller.maintenance.JobControl in project vespa by vespa-engine.

the class DeploymentJobExecutorTest method testMaintenance.

@Test
public void testMaintenance() {
    DeploymentTester tester = new DeploymentTester();
    JobControl jobControl = new JobControl(tester.controller().curator());
    int project1 = 1;
    int project2 = 2;
    int project3 = 3;
    ApplicationId app1 = tester.createApplication("app1", "tenant", project1, null).id();
    ApplicationId app2 = tester.createApplication("app2", "tenant", project2, null).id();
    ApplicationId app3 = tester.createApplication("app3", "tenant", project3, null).id();
    // Create a BuildService which always rejects jobs from project2, but accepts and runs all others.
    ArrayList<BuildJob> buildJobs = new ArrayList<>();
    BuildService buildService = buildJob -> buildJob.projectId() == project2 ? false : buildJobs.add(buildJob);
    DeploymentJobExecutor triggerer = new DeploymentJobExecutor(tester.controller(), Duration.ofDays(1), jobControl, buildService, Runnable::run);
    triggerer.maintain();
    assertEquals("No jobs are triggered initially.", Collections.emptyList(), buildJobs);
    // Trigger jobs in capacity constrained environment
    tester.deploymentQueue().addJob(app1, DeploymentJobs.JobType.systemTest, false);
    tester.deploymentQueue().addJob(app2, DeploymentJobs.JobType.systemTest, false);
    tester.deploymentQueue().addJob(app3, DeploymentJobs.JobType.systemTest, false);
    // Trigger jobs in non-capacity constrained environment
    tester.deploymentQueue().addJob(app1, DeploymentJobs.JobType.productionUsWest1, false);
    tester.deploymentQueue().addJob(app2, DeploymentJobs.JobType.productionUsWest1, false);
    tester.deploymentQueue().addJob(app3, DeploymentJobs.JobType.productionUsWest1, false);
    triggerer.maintain();
    assertEquals("One system test job and all production jobs not for app2 are triggered after one maintenance run.", Arrays.asList(new BuildJob(project1, DeploymentJobs.JobType.systemTest.jobName()), new BuildJob(project1, DeploymentJobs.JobType.productionUsWest1.jobName()), new BuildJob(project3, DeploymentJobs.JobType.productionUsWest1.jobName())), buildJobs);
    buildJobs.clear();
    triggerer.maintain();
    assertEquals("Next job in line fails to trigger in the build service.", Collections.emptyList(), buildJobs);
    buildJobs.clear();
    triggerer.maintain();
    assertEquals("Next job which was waiting for capacity is triggered on next run.", Collections.singletonList(new BuildJob(project3, DeploymentJobs.JobType.systemTest.jobName())), buildJobs);
    buildJobs.clear();
    triggerer.maintain();
    assertEquals("No jobs are left.", Collections.emptyList(), tester.deploymentQueue().takeJobsToRun());
}
Also used : Arrays(java.util.Arrays) ApplicationId(com.yahoo.config.provision.ApplicationId) BuildJob(com.yahoo.vespa.hosted.controller.api.integration.BuildService.BuildJob) Duration(java.time.Duration) BuildService(com.yahoo.vespa.hosted.controller.api.integration.BuildService) Test(org.junit.Test) DeploymentJobs(com.yahoo.vespa.hosted.controller.application.DeploymentJobs) JobControl(com.yahoo.vespa.hosted.controller.maintenance.JobControl) Collections(java.util.Collections) Assert.assertEquals(org.junit.Assert.assertEquals) ArrayList(java.util.ArrayList) BuildService(com.yahoo.vespa.hosted.controller.api.integration.BuildService) ArrayList(java.util.ArrayList) JobControl(com.yahoo.vespa.hosted.controller.maintenance.JobControl) BuildJob(com.yahoo.vespa.hosted.controller.api.integration.BuildService.BuildJob) ApplicationId(com.yahoo.config.provision.ApplicationId) Test(org.junit.Test)

Example 3 with JobControl

use of com.yahoo.vespa.hosted.controller.maintenance.JobControl in project vespa by vespa-engine.

the class DeploymentTriggerTest method testBlockRevisionChange.

@Test
public void testBlockRevisionChange() {
    // Tuesday, 17:30
    ManualClock clock = new ManualClock(Instant.parse("2017-09-26T17:30:00.00Z"));
    DeploymentTester tester = new DeploymentTester(new ControllerTester(clock));
    ReadyJobsTrigger readyJobsTrigger = new ReadyJobsTrigger(tester.controller(), Duration.ofHours(1), new JobControl(tester.controllerTester().curator()));
    Version version = Version.fromString("5.0");
    tester.updateVersionStatus(version);
    ApplicationPackageBuilder applicationPackageBuilder = new ApplicationPackageBuilder().upgradePolicy("canary").blockChange(true, false, "tue", "18-19", "UTC").region("us-west-1").region("us-central-1").region("us-east-3");
    Application app = tester.createAndDeploy("app1", 1, applicationPackageBuilder.build());
    // --------------- Enter block window: 18:30
    tester.clock().advance(Duration.ofHours(1));
    readyJobsTrigger.run();
    assertEquals(0, tester.deploymentQueue().jobs().size());
    String searchDefinition = "search test {\n" + "  document test {\n" + "    field test type string {\n" + "    }\n" + "  }\n" + "}\n";
    ApplicationPackage changedApplication = applicationPackageBuilder.searchDefinition(searchDefinition).build();
    tester.jobCompletion(component).application(app).nextBuildNumber().sourceRevision(new SourceRevision("repository1", "master", "cafed00d")).uploadArtifact(changedApplication).submit();
    assertTrue(tester.applications().require(app.id()).change().isPresent());
    tester.deployAndNotify(app, changedApplication, true, systemTest);
    tester.deployAndNotify(app, changedApplication, true, stagingTest);
    readyJobsTrigger.run();
    assertEquals(0, tester.deploymentQueue().jobs().size());
    // ---------------- Exit block window: 20:30
    tester.clock().advance(Duration.ofHours(2));
    // Schedules the blocked production job(s)
    tester.deploymentTrigger().triggerReadyJobs();
    assertEquals(1, tester.deploymentQueue().jobs().size());
    BuildService.BuildJob productionJob = tester.deploymentQueue().takeJobsToRun().get(0);
    assertEquals("production-us-west-1", productionJob.jobName());
}
Also used : SourceRevision(com.yahoo.vespa.hosted.controller.application.SourceRevision) BuildService(com.yahoo.vespa.hosted.controller.api.integration.BuildService) JobControl(com.yahoo.vespa.hosted.controller.maintenance.JobControl) ReadyJobsTrigger(com.yahoo.vespa.hosted.controller.maintenance.ReadyJobsTrigger) ApplicationPackage(com.yahoo.vespa.hosted.controller.application.ApplicationPackage) ControllerTester(com.yahoo.vespa.hosted.controller.ControllerTester) ManualClock(com.yahoo.test.ManualClock) Version(com.yahoo.component.Version) ApplicationVersion(com.yahoo.vespa.hosted.controller.application.ApplicationVersion) Application(com.yahoo.vespa.hosted.controller.Application) LockedApplication(com.yahoo.vespa.hosted.controller.LockedApplication) JobType.systemTest(com.yahoo.vespa.hosted.controller.application.DeploymentJobs.JobType.systemTest) Test(org.junit.Test) JobType.stagingTest(com.yahoo.vespa.hosted.controller.application.DeploymentJobs.JobType.stagingTest)

Aggregations

JobControl (com.yahoo.vespa.hosted.controller.maintenance.JobControl)3 Test (org.junit.Test)3 LockedApplication (com.yahoo.vespa.hosted.controller.LockedApplication)2 BuildService (com.yahoo.vespa.hosted.controller.api.integration.BuildService)2 JobType.stagingTest (com.yahoo.vespa.hosted.controller.application.DeploymentJobs.JobType.stagingTest)2 JobType.systemTest (com.yahoo.vespa.hosted.controller.application.DeploymentJobs.JobType.systemTest)2 ReadyJobsTrigger (com.yahoo.vespa.hosted.controller.maintenance.ReadyJobsTrigger)2 Version (com.yahoo.component.Version)1 ApplicationId (com.yahoo.config.provision.ApplicationId)1 ManualClock (com.yahoo.test.ManualClock)1 Application (com.yahoo.vespa.hosted.controller.Application)1 ControllerTester (com.yahoo.vespa.hosted.controller.ControllerTester)1 BuildJob (com.yahoo.vespa.hosted.controller.api.integration.BuildService.BuildJob)1 ApplicationPackage (com.yahoo.vespa.hosted.controller.application.ApplicationPackage)1 ApplicationVersion (com.yahoo.vespa.hosted.controller.application.ApplicationVersion)1 DeploymentJobs (com.yahoo.vespa.hosted.controller.application.DeploymentJobs)1 SourceRevision (com.yahoo.vespa.hosted.controller.application.SourceRevision)1 Duration (java.time.Duration)1 ArrayList (java.util.ArrayList)1 Arrays (java.util.Arrays)1