Search in sources :

Example 1 with IsLocalRegionRule

use of com.mesosphere.sdk.offer.evaluate.placement.IsLocalRegionRule in project dcos-commons by mesosphere.

the class FrameworkSchedulerTest method verifyDomainIsSet.

private static void verifyDomainIsSet(Protos.DomainInfo expectedDomain) {
    // Infer the configured domain via a placement rule invocation
    Protos.Offer offerWithExpectedDomain = getOffer().toBuilder().setDomain(expectedDomain).build();
    EvaluationOutcome outcome = new IsLocalRegionRule().filter(offerWithExpectedDomain, null, null);
    Assert.assertTrue(outcome.getReason(), outcome.isPassing());
}
Also used : Protos(org.apache.mesos.Protos) IsLocalRegionRule(com.mesosphere.sdk.offer.evaluate.placement.IsLocalRegionRule) EvaluationOutcome(com.mesosphere.sdk.offer.evaluate.EvaluationOutcome)

Example 2 with IsLocalRegionRule

use of com.mesosphere.sdk.offer.evaluate.placement.IsLocalRegionRule in project dcos-commons by mesosphere.

the class SchedulerBuilder method build.

/**
 * Creates a new Mesos scheduler instance with the provided values or their defaults, or an empty {@link Optional}
 * if no Mesos scheduler should be registered for this run.
 *
 * @return a new Mesos scheduler instance to be registered, or an empty {@link Optional}
 * @throws IllegalArgumentException if validating the provided configuration failed
 */
public AbstractScheduler build() {
    // If region awareness is enabled (via java bit or via env) and the cluster supports it, update the ServiceSpec
    // to include region constraints.
    final ServiceSpec serviceSpec;
    if (Capabilities.getInstance().supportsDomains()) {
        // This cluster supports domains. We need to update pod placement with region configuration, for any pods
        // that weren't already configured by the developer (expected to be rare, but possible).
        // Whether region awareness is enabled for the service (via env or via java).
        boolean regionAwarenessEnabled = isRegionAwarenessEnabled();
        // A region to target, as specified in env, if any.
        Optional<String> schedulerRegion = schedulerConfig.getSchedulerRegion();
        // Target the specified region, or use the local region.
        // Local region is determined at framework registration, see IsLocalRegionRule.setLocalDomain().
        final PlacementRule placementRuleToAdd;
        if (regionAwarenessEnabled && schedulerRegion.isPresent()) {
            logger.info("Updating pods with placement rule for region={}", schedulerRegion.get());
            placementRuleToAdd = RegionRuleFactory.getInstance().require(ExactMatcher.create(schedulerRegion.get()));
        } else {
            logger.info("Updating pods with local region placement rule: region awareness={}, scheduler region={}", regionAwarenessEnabled, schedulerRegion);
            placementRuleToAdd = new IsLocalRegionRule();
        }
        List<PodSpec> updatedPodSpecs = new ArrayList<>();
        for (PodSpec podSpec : originalServiceSpec.getPods()) {
            if (PlacementUtils.placementRuleReferencesRegion(podSpec)) {
                // Pod already has a region constraint (specified by developer?). Leave it as-is.
                logger.info("Pod {} already has a region rule defined, leaving as-is", podSpec.getType());
                updatedPodSpecs.add(podSpec);
            } else {
                // Combine the new rule with any existing rules:
                PlacementRule mergedRule = podSpec.getPlacementRule().isPresent() ? new AndRule(placementRuleToAdd, podSpec.getPlacementRule().get()) : placementRuleToAdd;
                updatedPodSpecs.add(DefaultPodSpec.newBuilder(podSpec).placementRule(mergedRule).build());
            }
        }
        DefaultServiceSpec.Builder builder = DefaultServiceSpec.newBuilder(originalServiceSpec).pods(updatedPodSpecs);
        if (schedulerRegion.isPresent()) {
            builder.region(schedulerRegion.get());
        }
        serviceSpec = builder.build();
    } else {
        serviceSpec = originalServiceSpec;
    }
    // NOTE: we specifically avoid accessing the provided persister before build() is called.
    // This is to ensure that upstream has a chance to e.g. lock it via CuratorLocker.
    // When multi-service is enabled, state/configs are stored within a namespace matching the service name.
    // Otherwise use an empty namespace, which indicates single-service mode.
    String namespaceStr = namespace.orElse("");
    FrameworkStore frameworkStore = new FrameworkStore(persister);
    StateStore stateStore = new StateStore(persister, namespaceStr);
    ConfigStore<ServiceSpec> configStore = new ConfigStore<>(DefaultServiceSpec.getConfigurationFactory(serviceSpec), persister, namespaceStr);
    if (schedulerConfig.isUninstallEnabled()) {
        // uninstall mode. UninstallScheduler will internally flag the stateStore with an uninstall bit if needed.
        return new UninstallScheduler(serviceSpec, frameworkStore, stateStore, configStore, FrameworkConfig.fromServiceSpec(serviceSpec), schedulerConfig, Optional.ofNullable(planCustomizer));
    }
    if (StateStoreUtils.isUninstalling(stateStore)) {
        // SERVICE UNINSTALL: The service has an uninstall bit set in its (potentially namespaced) state store.
        if (namespace.isPresent()) {
            // Launch the service in uninstall mode so that it can continue with whatever may be left.
            return new UninstallScheduler(serviceSpec, frameworkStore, stateStore, configStore, FrameworkConfig.fromServiceSpec(serviceSpec), schedulerConfig, Optional.ofNullable(planCustomizer));
        } else {
            // This is an illegal state for a single-service scheduler. SchedulerConfig's uninstall bit should have
            // also been enabled. If we got here, it means that the user likely tampered with the scheduler env
            // after having previously triggered an uninstall, which had set the bit in stateStore. Just exit,
            // because the service is likely now in an inconsistent state resulting from the incomplete uninstall.
            logger.error("Service has been previously told to uninstall, this cannot be reversed. " + "Reenable the uninstall flag to complete the process.");
            SchedulerUtils.hardExit(SchedulerErrorCode.SCHEDULER_ALREADY_UNINSTALLING);
        }
    }
    try {
        return getDefaultScheduler(serviceSpec, frameworkStore, stateStore, configStore);
    } catch (ConfigStoreException e) {
        logger.error("Failed to construct scheduler.", e);
        SchedulerUtils.hardExit(SchedulerErrorCode.INITIALIZATION_FAILURE);
        // This is so the compiler doesn't complain.  The scheduler is going down anyway.
        return null;
    }
}
Also used : AndRule(com.mesosphere.sdk.offer.evaluate.placement.AndRule) ConfigStoreException(com.mesosphere.sdk.state.ConfigStoreException) PlacementRule(com.mesosphere.sdk.offer.evaluate.placement.PlacementRule) RawServiceSpec(com.mesosphere.sdk.specification.yaml.RawServiceSpec) StateStore(com.mesosphere.sdk.state.StateStore) ConfigStore(com.mesosphere.sdk.state.ConfigStore) IsLocalRegionRule(com.mesosphere.sdk.offer.evaluate.placement.IsLocalRegionRule) UninstallScheduler(com.mesosphere.sdk.scheduler.uninstall.UninstallScheduler) FrameworkStore(com.mesosphere.sdk.state.FrameworkStore)

Aggregations

IsLocalRegionRule (com.mesosphere.sdk.offer.evaluate.placement.IsLocalRegionRule)2 EvaluationOutcome (com.mesosphere.sdk.offer.evaluate.EvaluationOutcome)1 AndRule (com.mesosphere.sdk.offer.evaluate.placement.AndRule)1 PlacementRule (com.mesosphere.sdk.offer.evaluate.placement.PlacementRule)1 UninstallScheduler (com.mesosphere.sdk.scheduler.uninstall.UninstallScheduler)1 RawServiceSpec (com.mesosphere.sdk.specification.yaml.RawServiceSpec)1 ConfigStore (com.mesosphere.sdk.state.ConfigStore)1 ConfigStoreException (com.mesosphere.sdk.state.ConfigStoreException)1 FrameworkStore (com.mesosphere.sdk.state.FrameworkStore)1 StateStore (com.mesosphere.sdk.state.StateStore)1 Protos (org.apache.mesos.Protos)1