Search in sources :

Example 1 with TJobExecution

use of io.elastest.etm.model.TJobExecution in project elastest-torm by elastest.

the class DockerService2 method getEMSLogConfig.

public LogConfig getEMSLogConfig(String type, String tagPrefix, String tagSuffix, DockerExecution dockerExec) throws Exception {
    TJobExecution tJobExec = dockerExec.gettJobexec();
    String host = null;
    int port = -1;
    if ("tjob".equals(type.toLowerCase())) {
        host = tJobExec.getEnvVars().get("ET_EMS_TCP_TESTLOGS_HOST");
        port = Integer.parseInt(tJobExec.getEnvVars().get("ET_EMS_TCP_TESTLOGS_PORT"));
    } else if ("sut".equals(type.toLowerCase())) {
        host = tJobExec.getEnvVars().get("ET_EMS_TCP_SUTLOGS_HOST");
        port = Integer.parseInt(tJobExec.getEnvVars().get("ET_EMS_TCP_SUTLOGS_PORT"));
    }
    if (host != null && port > -1) {
        logger.info("EMS Host to send logs from {} container: {}. To port {}", type, host, port);
        return this.getLogConfig(host, port, tagPrefix, tagSuffix, dockerExec);
    } else {
        throw new Exception("Error on get EMS Log config");
    }
}
Also used : TJobExecution(io.elastest.etm.model.TJobExecution) SAXException(org.xml.sax.SAXException) UnsupportedEncodingException(java.io.UnsupportedEncodingException) NotModifiedException(com.github.dockerjava.api.exception.NotModifiedException) DockerClientException(com.github.dockerjava.api.exception.DockerClientException) InternalServerErrorException(com.github.dockerjava.api.exception.InternalServerErrorException) NotFoundException(com.github.dockerjava.api.exception.NotFoundException) IOException(java.io.IOException) ParserConfigurationException(javax.xml.parsers.ParserConfigurationException)

Example 2 with TJobExecution

use of io.elastest.etm.model.TJobExecution in project elastest-torm by elastest.

the class DockerService2 method startDockbeat.

public void startDockbeat(DockerExecution dockerExec) throws TJobStoppedException {
    TJobExecution tJobExec = dockerExec.gettJobexec();
    TJob tJob = tJobExec.getTjob();
    Long execution = dockerExec.getExecutionId();
    String containerName = getDockbeatContainerName(dockerExec);
    // Environment variables
    ArrayList<String> envList = new ArrayList<>();
    String envVar;
    // Get Parameters and insert into Env VarsĀ”
    String lsHostEnvVar = "LOGSTASHHOST" + "=" + logstashHost;
    if (tJob.isSelectedService("ems")) {
        envVar = "FILTER_CONTAINERS" + "=" + "\"^sut\\d*_.*_" + execution + "|^test\\d*_.*_" + execution + "\"";
        envList.add(envVar);
        // envVar = "FILTER_EXCLUDE" + "=" + "\"\"";
        // envList.add(envVar);
        envVar = "LOGSTASHPORT" + "=" + tJobExec.getEnvVars().get("ET_EMS_LSBEATS_PORT");
        envList.add(envVar);
        lsHostEnvVar = "LOGSTASHHOST" + "=" + tJobExec.getEnvVars().get("ET_EMS_LSBEATS_HOST");
    }
    envList.add(lsHostEnvVar);
    // dockerSock
    Volume volume1 = new Volume(dockerSock);
    // Pull Image
    this.pullETExecImage(dockbeatImage, "Dockbeat");
    // Create Container
    logger.debug("Creating Dockbeat Container...");
    CreateContainerResponse container = dockerExec.getDockerClient().createContainerCmd(dockbeatImage).withEnv(envList).withName(containerName).withBinds(new Bind(dockerSock, volume1)).withNetworkMode(dockerExec.getNetwork()).exec();
    dockerExec.getDockerClient().startContainerCmd(container.getId()).exec();
    try {
        Thread.sleep(1000);
    } catch (InterruptedException e) {
    }
    this.insertCreatedContainer(container.getId(), containerName);
}
Also used : Bind(com.github.dockerjava.api.model.Bind) Volume(com.github.dockerjava.api.model.Volume) TJobExecution(io.elastest.etm.model.TJobExecution) ArrayList(java.util.ArrayList) CreateContainerResponse(com.github.dockerjava.api.command.CreateContainerResponse) TJob(io.elastest.etm.model.TJob)

Example 3 with TJobExecution

use of io.elastest.etm.model.TJobExecution in project elastest-torm by elastest.

the class DockerService2 method createContainer.

public CreateContainerResponse createContainer(DockerExecution dockerExec, String type) throws TJobStoppedException {
    TJobExecution tJobExec = dockerExec.gettJobexec();
    TJob tJob = tJobExec.getTjob();
    SutSpecification sut = tJob.getSut();
    String image = "";
    String commands = null;
    List<Parameter> parametersList = new ArrayList<Parameter>();
    String prefix = "";
    String suffix = "";
    String containerName = "";
    int logPort = 5000;
    String sutHost = null;
    String sutPath = null;
    if ("sut".equals(type.toLowerCase())) {
        parametersList = sut.getParameters();
        commands = sut.getCommands();
        image = sut.getSpecification();
        prefix = "sut_";
        if (sut.isSutInNewContainer()) {
            suffix = sut.getSutInContainerAuxLabel();
        }
        containerName = getSutName(dockerExec);
        sutPath = filesService.buildFilesPath(tJobExec, ElastestConstants.SUT_FOLDER);
        filesService.createExecFilesFolder(sutPath);
    } else if ("tjob".equals(type.toLowerCase())) {
        parametersList = tJobExec.getParameters();
        commands = tJob.getCommands();
        image = tJob.getImageName();
        prefix = "test_";
        containerName = getTestName(dockerExec);
        if (dockerExec.isWithSut()) {
            sutHost = dockerExec.getSutExec().getIp();
        }
    }
    // Environment variables (optional)
    ArrayList<String> envList = new ArrayList<>();
    String envVar;
    // Get TJob Exec Env Vars
    for (Map.Entry<String, String> entry : dockerExec.gettJobexec().getEnvVars().entrySet()) {
        envVar = entry.getKey() + "=" + entry.getValue();
        envList.add(envVar);
    }
    // Get Parameters and insert into Env Vars
    for (Parameter parameter : parametersList) {
        envVar = parameter.getName() + "=" + parameter.getValue();
        envList.add(envVar);
    }
    if (sutHost != null) {
        envList.add("ET_SUT_HOST=" + dockerExec.getSutExec().getIp());
    }
    // Commands (optional)
    ArrayList<String> cmdList = new ArrayList<>();
    ArrayList<String> entrypointList = new ArrayList<>();
    if (commands != null && !commands.isEmpty()) {
        cmdList.add("-c");
        if (sut != null) {
            if (sut.isSutInNewContainer()) {
                commands = sutPath != null ? ("cd " + sutPath + ";" + commands) : commands;
            }
        } else {
            commands = "export ET_SUT_HOST=$(" + this.getThisContainerIpCmd + ") || echo;" + commands;
        }
        cmdList.add(commands);
        entrypointList.add("/bin/sh");
    }
    // Load Log Config
    LogConfig logConfig = null;
    if (tJob.isSelectedService("ems")) {
        try {
            logConfig = getEMSLogConfig(type, prefix, suffix, dockerExec);
        } catch (Exception e) {
            logger.error("", e);
        }
    } else {
        logConfig = getDefaultLogConfig(logPort, prefix, suffix, dockerExec);
    }
    // Pull Image
    this.pullETExecImage(image, type);
    // Create docker sock volume
    Volume dockerSockVolume = new Volume(dockerSock);
    CreateContainerCmd containerCmd = dockerExec.getDockerClient().createContainerCmd(image).withEnv(envList).withLogConfig(logConfig).withName(containerName).withCmd(cmdList).withEntrypoint(entrypointList).withNetworkMode(dockerExec.getNetwork());
    Volume sharedDataVolume = null;
    if (dockerExec.gettJobexec().getTjob().getSut() != null && dockerExec.gettJobexec().getTjob().getSut().isSutInNewContainer()) {
        sharedDataVolume = new Volume(sharedFolder);
    }
    if (sharedDataVolume != null) {
        containerCmd = containerCmd.withVolumes(dockerSockVolume, sharedDataVolume).withBinds(new Bind(dockerSock, dockerSockVolume), new Bind(sharedFolder, sharedDataVolume));
    } else {
        containerCmd = containerCmd.withVolumes(dockerSockVolume).withBinds(new Bind(dockerSock, dockerSockVolume));
    }
    // Create Container
    return containerCmd.exec();
}
Also used : Bind(com.github.dockerjava.api.model.Bind) TJobExecution(io.elastest.etm.model.TJobExecution) ArrayList(java.util.ArrayList) SutSpecification(io.elastest.etm.model.SutSpecification) TJob(io.elastest.etm.model.TJob) SAXException(org.xml.sax.SAXException) UnsupportedEncodingException(java.io.UnsupportedEncodingException) NotModifiedException(com.github.dockerjava.api.exception.NotModifiedException) DockerClientException(com.github.dockerjava.api.exception.DockerClientException) InternalServerErrorException(com.github.dockerjava.api.exception.InternalServerErrorException) NotFoundException(com.github.dockerjava.api.exception.NotFoundException) IOException(java.io.IOException) ParserConfigurationException(javax.xml.parsers.ParserConfigurationException) CreateContainerCmd(com.github.dockerjava.api.command.CreateContainerCmd) Volume(com.github.dockerjava.api.model.Volume) Parameter(io.elastest.etm.model.Parameter) Map(java.util.Map) HashMap(java.util.HashMap) LogConfig(com.github.dockerjava.api.model.LogConfig)

Example 4 with TJobExecution

use of io.elastest.etm.model.TJobExecution in project elastest-torm by elastest.

the class ModelsTest method executionTest.

@Test
public void executionTest() {
    Project project = new Project(3l, "name", new ArrayList<TJob>(), new ArrayList<SutSpecification>());
    SutSpecification sut = new SutSpecification(34l, "name", "specification", "description", project, new ArrayList<>(), SutTypeEnum.REPOSITORY, false, null, InstrumentedByEnum.WITHOUT, null, ManagedDockerType.IMAGE, CommandsOptionEnum.DEFAULT);
    TJob tjob = new TJob(34l, "name", "imageName", sut, project, false, "execDashboardConfig", null);
    List<Parameter> params = new ArrayList<>();
    params.add(new Parameter(45l, "param1", "value1", tjob, null));
    tjob.setParameters(params);
    TJobExecution exec = new TJobExecution(45l, 34543534l, ResultEnum.SUCCESS);
    List<Parameter> paramsExec = new ArrayList<>();
    paramsExec.add(new Parameter(45l, "param1", "value1", tjob, exec));
    exec.setParameters(paramsExec);
    TJobExecution exec2 = new TJobExecution(45l, 34543534l, ResultEnum.SUCCESS);
    List<Parameter> paramsExec2 = new ArrayList<>();
    paramsExec2.add(new Parameter(45l, "param1", "value1", tjob, exec2));
    exec2.setParameters(paramsExec2);
    exec.setTjob(tjob);
    exec2.setTjob(tjob);
    SutExecution sutExec = new SutExecution(45l, sut, "ssss", DeployStatusEnum.DEPLOYED);
    SutExecution sutExec2 = new SutExecution(45l, sut, "ssss", DeployStatusEnum.DEPLOYED);
    exec.setSutExecution(sutExec);
    exec2.setSutExecution(sutExec2);
    assertEquals(exec, exec2);
    assertEquals(exec.hashCode(), exec2.hashCode());
}
Also used : Project(io.elastest.etm.model.Project) TJobExecution(io.elastest.etm.model.TJobExecution) SutExecution(io.elastest.etm.model.SutExecution) ArrayList(java.util.ArrayList) Parameter(io.elastest.etm.model.Parameter) SutSpecification(io.elastest.etm.model.SutSpecification) TJob(io.elastest.etm.model.TJob) Test(org.junit.jupiter.api.Test)

Example 5 with TJobExecution

use of io.elastest.etm.model.TJobExecution in project elastest-torm by elastest.

the class TJobService method deleteTJobExec.

public void deleteTJobExec(Long tJobExecId) {
    TJobExecution tJobExec = tJobExecRepositoryImpl.findOne(tJobExecId);
    tJobExecRepositoryImpl.delete(tJobExec);
}
Also used : TJobExecution(io.elastest.etm.model.TJobExecution)

Aggregations

TJobExecution (io.elastest.etm.model.TJobExecution)14 TJob (io.elastest.etm.model.TJob)6 IOException (java.io.IOException)6 SutSpecification (io.elastest.etm.model.SutSpecification)4 ArrayList (java.util.ArrayList)3 HashMap (java.util.HashMap)3 HTTPException (javax.xml.ws.http.HTTPException)3 HttpClientErrorException (org.springframework.web.client.HttpClientErrorException)3 DockerClientException (com.github.dockerjava.api.exception.DockerClientException)2 InternalServerErrorException (com.github.dockerjava.api.exception.InternalServerErrorException)2 NotFoundException (com.github.dockerjava.api.exception.NotFoundException)2 NotModifiedException (com.github.dockerjava.api.exception.NotModifiedException)2 Bind (com.github.dockerjava.api.model.Bind)2 Volume (com.github.dockerjava.api.model.Volume)2 Parameter (io.elastest.etm.model.Parameter)2 SutExecution (io.elastest.etm.model.SutExecution)2 ExternalTJobExecution (io.elastest.etm.model.external.ExternalTJobExecution)2 UnsupportedEncodingException (java.io.UnsupportedEncodingException)2 ParserConfigurationException (javax.xml.parsers.ParserConfigurationException)2 SAXException (org.xml.sax.SAXException)2