Search in sources :

Example 1 with NodeList

use of com.yahoo.vespa.hosted.controller.api.integration.noderepository.NodeList in project vespa by vespa-engine.

the class ClusterInfoMaintainer method getClusterInfo.

private Map<ClusterSpec.Id, ClusterInfo> getClusterInfo(NodeList nodes, ZoneId zone) {
    Map<ClusterSpec.Id, ClusterInfo> infoMap = new HashMap<>();
    // Group nodes by clusterid
    Map<String, List<NodeRepositoryNode>> clusters = nodes.nodes().stream().filter(node -> node.getMembership() != null).collect(Collectors.groupingBy(ClusterInfoMaintainer::clusterid));
    // For each cluster - get info
    for (String id : clusters.keySet()) {
        List<NodeRepositoryNode> clusterNodes = clusters.get(id);
        // Assume they are all equal and use first node as a representative for the cluster
        NodeRepositoryNode node = clusterNodes.get(0);
        // Extract flavor info
        double cpu = 0;
        double mem = 0;
        double disk = 0;
        // TODO: This code was never run. Reenable when flavours are available from a FlavorRegistry or something, or remove.
        /*if (zone.nodeFlavors().isPresent()) {
                Optional<Flavor> flavorOptional = zone.nodeFlavors().get().getFlavor(node.flavor);
                if ((flavorOptional.isPresent())) {
                    Flavor flavor = flavorOptional.get();
                    cpu = flavor.getMinCpuCores();
                    mem = flavor.getMinMainMemoryAvailableGb();
                    disk = flavor.getMinMainMemoryAvailableGb();
                }
            }*/
        // Add to map
        List<String> hostnames = clusterNodes.stream().map(NodeRepositoryNode::getHostname).collect(Collectors.toList());
        ClusterInfo inf = new ClusterInfo(node.getFlavor(), node.getCost(), cpu, mem, disk, ClusterSpec.Type.from(node.getMembership().clustertype), hostnames);
        infoMap.put(new ClusterSpec.Id(id), inf);
    }
    return infoMap;
}
Also used : NodeRepositoryNode(com.yahoo.vespa.hosted.controller.api.integration.noderepository.NodeRepositoryNode) DeploymentId(com.yahoo.vespa.hosted.controller.api.identifiers.DeploymentId) ClusterSpec(com.yahoo.config.provision.ClusterSpec) IOException(java.io.IOException) HashMap(java.util.HashMap) Logger(java.util.logging.Logger) Collectors(java.util.stream.Collectors) Level(java.util.logging.Level) ApplicationList(com.yahoo.vespa.hosted.controller.application.ApplicationList) List(java.util.List) ZoneId(com.yahoo.vespa.hosted.controller.api.integration.zone.ZoneId) Duration(java.time.Duration) Map(java.util.Map) ClusterInfo(com.yahoo.vespa.hosted.controller.application.ClusterInfo) Deployment(com.yahoo.vespa.hosted.controller.application.Deployment) NodeList(com.yahoo.vespa.hosted.controller.api.integration.noderepository.NodeList) Application(com.yahoo.vespa.hosted.controller.Application) Controller(com.yahoo.vespa.hosted.controller.Controller) HashMap(java.util.HashMap) NodeRepositoryNode(com.yahoo.vespa.hosted.controller.api.integration.noderepository.NodeRepositoryNode) ClusterSpec(com.yahoo.config.provision.ClusterSpec) ClusterInfo(com.yahoo.vespa.hosted.controller.application.ClusterInfo) ApplicationList(com.yahoo.vespa.hosted.controller.application.ApplicationList) List(java.util.List) NodeList(com.yahoo.vespa.hosted.controller.api.integration.noderepository.NodeList) DeploymentId(com.yahoo.vespa.hosted.controller.api.identifiers.DeploymentId) ZoneId(com.yahoo.vespa.hosted.controller.api.integration.zone.ZoneId)

Example 2 with NodeList

use of com.yahoo.vespa.hosted.controller.api.integration.noderepository.NodeList in project vespa by vespa-engine.

the class NodeRepositoryClientMock method listNodes.

@Override
public NodeList listNodes(ZoneId zone, String tenant, String applicationId, String instance) throws IOException {
    NodeRepositoryNode nodeA = createNodeA();
    NodeRepositoryNode nodeB = createNodeB();
    return new NodeList(Arrays.asList(nodeA, nodeB));
}
Also used : NodeList(com.yahoo.vespa.hosted.controller.api.integration.noderepository.NodeList) NodeRepositoryNode(com.yahoo.vespa.hosted.controller.api.integration.noderepository.NodeRepositoryNode)

Example 3 with NodeList

use of com.yahoo.vespa.hosted.controller.api.integration.noderepository.NodeList in project vespa by vespa-engine.

the class ClusterInfoMaintainer method maintain.

@Override
protected void maintain() {
    for (Application application : ApplicationList.from(controller().applications().asList()).notPullRequest().asList()) {
        for (Deployment deployment : application.deployments().values()) {
            DeploymentId deploymentId = new DeploymentId(application.id(), deployment.zone());
            try {
                NodeList nodes = controller.nodeRepositoryClient().listNodes(deploymentId.zoneId(), deploymentId.applicationId().tenant().value(), deploymentId.applicationId().application().value(), deploymentId.applicationId().instance().value());
                Map<ClusterSpec.Id, ClusterInfo> clusterInfo = getClusterInfo(nodes, deployment.zone());
                controller().applications().lockIfPresent(application.id(), lockedApplication -> controller.applications().store(lockedApplication.withClusterInfo(deployment.zone(), clusterInfo)));
            } catch (IOException | IllegalArgumentException e) {
                log.log(Level.WARNING, "Failing getting cluster info of for " + deploymentId, e);
            }
        }
    }
}
Also used : DeploymentId(com.yahoo.vespa.hosted.controller.api.identifiers.DeploymentId) ClusterInfo(com.yahoo.vespa.hosted.controller.application.ClusterInfo) NodeList(com.yahoo.vespa.hosted.controller.api.integration.noderepository.NodeList) Deployment(com.yahoo.vespa.hosted.controller.application.Deployment) DeploymentId(com.yahoo.vespa.hosted.controller.api.identifiers.DeploymentId) ZoneId(com.yahoo.vespa.hosted.controller.api.integration.zone.ZoneId) IOException(java.io.IOException) Application(com.yahoo.vespa.hosted.controller.Application)

Aggregations

NodeList (com.yahoo.vespa.hosted.controller.api.integration.noderepository.NodeList)3 Application (com.yahoo.vespa.hosted.controller.Application)2 DeploymentId (com.yahoo.vespa.hosted.controller.api.identifiers.DeploymentId)2 NodeRepositoryNode (com.yahoo.vespa.hosted.controller.api.integration.noderepository.NodeRepositoryNode)2 ZoneId (com.yahoo.vespa.hosted.controller.api.integration.zone.ZoneId)2 ClusterInfo (com.yahoo.vespa.hosted.controller.application.ClusterInfo)2 Deployment (com.yahoo.vespa.hosted.controller.application.Deployment)2 IOException (java.io.IOException)2 ClusterSpec (com.yahoo.config.provision.ClusterSpec)1 Controller (com.yahoo.vespa.hosted.controller.Controller)1 ApplicationList (com.yahoo.vespa.hosted.controller.application.ApplicationList)1 Duration (java.time.Duration)1 HashMap (java.util.HashMap)1 List (java.util.List)1 Map (java.util.Map)1 Level (java.util.logging.Level)1 Logger (java.util.logging.Logger)1 Collectors (java.util.stream.Collectors)1