Search in sources :

Example 6 with ClientSideTest

use of uk.co.automatictester.lightning.tests.ClientSideTest in project lightning by automatictester.

the class TestSetTest method verifyExecuteClientMethod_1_1_1.

@Test
public void verifyExecuteClientMethod_1_1_1() {
    RespTimeAvgTest respTimeAvgTestA = new RespTimeAvgTest("Test #1", "avgRespTimeTest", "", "Login", 4000);
    RespTimeAvgTest respTimeAvgTestB = new RespTimeAvgTest("Test #2", "avgRespTimeTest", "", "Search", 5000);
    RespTimeAvgTest respTimeAvgTestC = new RespTimeAvgTest("Test #3", "avgRespTimeTest", "", "Sear", 1000);
    JMeterTransactions transactions = new JMeterTransactions();
    transactions.add(TestData.LOGIN_3514_SUCCESS);
    transactions.add(TestData.SEARCH_11221_SUCCESS);
    List<ClientSideTest> tests = new ArrayList<>();
    tests.add(respTimeAvgTestA);
    tests.add(respTimeAvgTestB);
    tests.add(respTimeAvgTestC);
    TestSet testSet = new TestSet(tests, null);
    configureStream();
    testSet.executeClientSideTests(transactions);
    revertStream();
    assertThat(testSet.getTestCount(), is(3));
    assertThat(testSet.getPassCount(), is(1));
    assertThat(testSet.getFailCount(), is(1));
    assertThat(testSet.getErrorCount(), is(1));
}
Also used : ClientSideTest(uk.co.automatictester.lightning.tests.ClientSideTest) RespTimeAvgTest(uk.co.automatictester.lightning.tests.RespTimeAvgTest) ArrayList(java.util.ArrayList) JMeterTransactions(uk.co.automatictester.lightning.data.JMeterTransactions) RespTimeAvgTest(uk.co.automatictester.lightning.tests.RespTimeAvgTest) Test(org.testng.annotations.Test) PassedTransactionsTest(uk.co.automatictester.lightning.tests.PassedTransactionsTest) ServerSideTest(uk.co.automatictester.lightning.tests.ServerSideTest) ClientSideTest(uk.co.automatictester.lightning.tests.ClientSideTest)

Example 7 with ClientSideTest

use of uk.co.automatictester.lightning.tests.ClientSideTest in project lightning by automatictester.

the class TestSetTest method verifyExecuteClientMethod_2_0_0.

@Test
public void verifyExecuteClientMethod_2_0_0() {
    PassedTransactionsTest passedTransactionsTestA = new PassedTransactionsTest("Test #1", "passedTransactionsTest", "Verify number of passed tests", "Login", 0);
    PassedTransactionsTest passedTransactionsTestB = new PassedTransactionsTest("Test #2", "passedTransactionsTest", "Verify number of passed tests", null, 0);
    JMeterTransactions transactions = new JMeterTransactions();
    transactions.add(TestData.LOGIN_3514_SUCCESS);
    transactions.add(TestData.SEARCH_11221_SUCCESS);
    List<ClientSideTest> tests = new ArrayList<>();
    tests.add(passedTransactionsTestA);
    tests.add(passedTransactionsTestB);
    TestSet testSet = new TestSet(tests, null);
    configureStream();
    testSet.executeClientSideTests(transactions);
    revertStream();
    assertThat(testSet.getTestCount(), is(2));
    assertThat(testSet.getPassCount(), is(2));
    assertThat(testSet.getFailCount(), is(0));
    assertThat(testSet.getErrorCount(), is(0));
}
Also used : ClientSideTest(uk.co.automatictester.lightning.tests.ClientSideTest) ArrayList(java.util.ArrayList) PassedTransactionsTest(uk.co.automatictester.lightning.tests.PassedTransactionsTest) JMeterTransactions(uk.co.automatictester.lightning.data.JMeterTransactions) RespTimeAvgTest(uk.co.automatictester.lightning.tests.RespTimeAvgTest) Test(org.testng.annotations.Test) PassedTransactionsTest(uk.co.automatictester.lightning.tests.PassedTransactionsTest) ServerSideTest(uk.co.automatictester.lightning.tests.ServerSideTest) ClientSideTest(uk.co.automatictester.lightning.tests.ClientSideTest)

Example 8 with ClientSideTest

use of uk.co.automatictester.lightning.tests.ClientSideTest in project lightning by automatictester.

the class CliTestRunner method runTests.

private static void runTests() {
    long testSetExecStart = System.currentTimeMillis();
    File xmlFile = params.verify.getXmlFile();
    File jmeterCsvFile = params.verify.getJmeterCsvFile();
    File perfmonCsvFile = params.verify.getPerfmonCsvFile();
    LightningXMLFileReader xmlFileReader = new LightningXMLFileReader();
    xmlFileReader.readTests(xmlFile);
    List<ClientSideTest> clientSideTests = xmlFileReader.getClientSideTests();
    List<ServerSideTest> serverSideTests = xmlFileReader.getServerSideTests();
    testSet = new TestSet(clientSideTests, serverSideTests);
    jmeterTransactions = new JMeterCSVFileReader().getTransactions(jmeterCsvFile);
    if (params.verify.isPerfmonCsvFileProvided()) {
        perfMonDataEntries = new PerfMonDataReader().getDataEntires(perfmonCsvFile);
        testSet.executeServerSideTests(perfMonDataEntries);
    }
    testSet.executeClientSideTests(jmeterTransactions);
    testSet.printTestExecutionReport();
    new TestSetReporter(testSet).printTestSetExecutionSummaryReport();
    long testSetExecEnd = System.currentTimeMillis();
    long testExecTime = testSetExecEnd - testSetExecStart;
    logger.info("Total execution time:    {}ms", testExecTime);
    if (testSet.getFailCount() + testSet.getErrorCount() != 0) {
        exitCode = 1;
    }
}
Also used : ClientSideTest(uk.co.automatictester.lightning.tests.ClientSideTest) ServerSideTest(uk.co.automatictester.lightning.tests.ServerSideTest) TestSetReporter(uk.co.automatictester.lightning.reporters.TestSetReporter) JMeterCSVFileReader(uk.co.automatictester.lightning.readers.JMeterCSVFileReader) PerfMonDataReader(uk.co.automatictester.lightning.readers.PerfMonDataReader) LightningXMLFileReader(uk.co.automatictester.lightning.readers.LightningXMLFileReader) File(java.io.File) TestSet(uk.co.automatictester.lightning.TestSet)

Aggregations

ClientSideTest (uk.co.automatictester.lightning.tests.ClientSideTest)8 ServerSideTest (uk.co.automatictester.lightning.tests.ServerSideTest)7 TestSet (uk.co.automatictester.lightning.TestSet)5 TestSetReporter (uk.co.automatictester.lightning.reporters.TestSetReporter)4 Test (org.testng.annotations.Test)3 PerfMonDataEntries (uk.co.automatictester.lightning.data.PerfMonDataEntries)3 JMeterCSVFileReader (uk.co.automatictester.lightning.readers.JMeterCSVFileReader)3 LightningXMLFileReader (uk.co.automatictester.lightning.readers.LightningXMLFileReader)3 PerfMonDataReader (uk.co.automatictester.lightning.readers.PerfMonDataReader)3 PassedTransactionsTest (uk.co.automatictester.lightning.tests.PassedTransactionsTest)3 ArrayList (java.util.ArrayList)2 JMeterTransactions (uk.co.automatictester.lightning.data.JMeterTransactions)2 RespTimeAvgTest (uk.co.automatictester.lightning.tests.RespTimeAvgTest)2 File (java.io.File)1 CoreMatchers.containsString (org.hamcrest.CoreMatchers.containsString)1 JMeterCSVS3ObjectReader (uk.co.automatictester.lightning.lambda.readers.JMeterCSVS3ObjectReader)1 LightningXMLS3ObjectReader (uk.co.automatictester.lightning.lambda.readers.LightningXMLS3ObjectReader)1 PerfMonS3ObjectDataReader (uk.co.automatictester.lightning.lambda.readers.PerfMonS3ObjectDataReader)1