Search in sources :

Example 1 with InMemoryJobManager

use of org.apache.metron.job.manager.InMemoryJobManager in project metron by apache.

the class PcapControllerIntegrationTest method setup.

@BeforeEach
public void setup() throws Exception {
    this.mockMvc = MockMvcBuilders.webAppContextSetup(this.wac).apply(springSecurity()).build();
    InMemoryJobManager jobManager = (InMemoryJobManager) wac.getBean("jobManager");
    jobManager.clear();
}
Also used : InMemoryJobManager(org.apache.metron.job.manager.InMemoryJobManager) BeforeEach(org.junit.jupiter.api.BeforeEach)

Example 2 with InMemoryJobManager

use of org.apache.metron.job.manager.InMemoryJobManager in project metron by apache.

the class PcapServiceImplTest method getRawShouldThrowException.

@Test
public void getRawShouldThrowException() throws Exception {
    Path path = new Path("./target");
    PcapServiceImpl pcapService = spy(new PcapServiceImpl(environment, configuration, new PcapJobSupplier(), new InMemoryJobManager<>(), pcapToPdmlScriptWrapper));
    FileSystem fileSystem = mock(FileSystem.class);
    doReturn(fileSystem).when(pcapService).getFileSystem();
    when(fileSystem.exists(path)).thenReturn(true);
    doReturn(path).when(pcapService).getPath("user", "jobId", 1);
    when(fileSystem.open(path)).thenThrow(new IOException("some exception"));
    RestException e = assertThrows(RestException.class, () -> pcapService.getRawPcap("user", "jobId", 1));
    assertEquals("some exception", e.getMessage());
}
Also used : Path(org.apache.hadoop.fs.Path) InMemoryJobManager(org.apache.metron.job.manager.InMemoryJobManager) MockPcapJobSupplier(org.apache.metron.rest.mock.MockPcapJobSupplier) PcapJobSupplier(org.apache.metron.rest.config.PcapJobSupplier) FileSystem(org.apache.hadoop.fs.FileSystem) RestException(org.apache.metron.rest.RestException) IOException(java.io.IOException) Test(org.junit.jupiter.api.Test)

Example 3 with InMemoryJobManager

use of org.apache.metron.job.manager.InMemoryJobManager in project metron by apache.

the class PcapServiceImplTest method getPdmlShouldReturnNullOnNonexistentPath.

@Test
public void getPdmlShouldReturnNullOnNonexistentPath() throws Exception {
    Path path = new Path("/some/path");
    PcapServiceImpl pcapService = spy(new PcapServiceImpl(environment, configuration, new PcapJobSupplier(), new InMemoryJobManager<>(), pcapToPdmlScriptWrapper));
    FileSystem fileSystem = mock(FileSystem.class);
    doReturn(fileSystem).when(pcapService).getFileSystem();
    when(fileSystem.exists(path)).thenReturn(false);
    doReturn(path).when(pcapService).getPath("user", "jobId", 1);
    assertNull(pcapService.getPdml("user", "jobId", 1));
}
Also used : Path(org.apache.hadoop.fs.Path) InMemoryJobManager(org.apache.metron.job.manager.InMemoryJobManager) MockPcapJobSupplier(org.apache.metron.rest.mock.MockPcapJobSupplier) PcapJobSupplier(org.apache.metron.rest.config.PcapJobSupplier) FileSystem(org.apache.hadoop.fs.FileSystem) Test(org.junit.jupiter.api.Test)

Example 4 with InMemoryJobManager

use of org.apache.metron.job.manager.InMemoryJobManager in project metron by apache.

the class PcapServiceImplTest method getRawShouldReturnNullOnInvalidPage.

@Test
public void getRawShouldReturnNullOnInvalidPage() throws Exception {
    Path path = new Path("/some/path");
    PcapServiceImpl pcapService = spy(new PcapServiceImpl(environment, configuration, new PcapJobSupplier(), new InMemoryJobManager<>(), pcapToPdmlScriptWrapper));
    FileSystem fileSystem = mock(FileSystem.class);
    doReturn(fileSystem).when(pcapService).getFileSystem();
    assertNull(pcapService.getRawPcap("user", "jobId", 1));
}
Also used : Path(org.apache.hadoop.fs.Path) InMemoryJobManager(org.apache.metron.job.manager.InMemoryJobManager) MockPcapJobSupplier(org.apache.metron.rest.mock.MockPcapJobSupplier) PcapJobSupplier(org.apache.metron.rest.config.PcapJobSupplier) FileSystem(org.apache.hadoop.fs.FileSystem) Test(org.junit.jupiter.api.Test)

Example 5 with InMemoryJobManager

use of org.apache.metron.job.manager.InMemoryJobManager in project metron by apache.

the class PcapServiceImplTest method getConfigurationShouldProperlyReturnQueryFilterConfiguration.

@Test
public void getConfigurationShouldProperlyReturnQueryFilterConfiguration() throws Exception {
    QueryPcapRequest queryPcapRequest = new QueryPcapRequest();
    queryPcapRequest.setBasePath("basePath");
    queryPcapRequest.setBaseInterimResultPath("baseOutputPath");
    queryPcapRequest.setFinalOutputPath("finalOutputPath");
    queryPcapRequest.setStartTimeMs(1L);
    queryPcapRequest.setEndTimeMs(2L);
    queryPcapRequest.setNumReducers(2);
    queryPcapRequest.setQuery("query");
    MockPcapJob mockPcapJob = new MockPcapJob();
    mockPcapJobSupplier.setMockPcapJob(mockPcapJob);
    JobManager jobManager = new InMemoryJobManager<>();
    PcapServiceImpl pcapService = spy(new PcapServiceImpl(environment, configuration, mockPcapJobSupplier, jobManager, pcapToPdmlScriptWrapper));
    FileSystem fileSystem = mock(FileSystem.class);
    doReturn(fileSystem).when(pcapService).getFileSystem();
    mockPcapJob.setStatus(new JobStatus().withJobId("jobId"));
    pcapService.submit("user", queryPcapRequest);
    Map<String, Object> configuration = pcapService.getConfiguration("user", "jobId");
    assertEquals("basePath", configuration.get(PcapOptions.BASE_PATH.getKey()));
    assertEquals("finalOutputPath", configuration.get(PcapOptions.FINAL_OUTPUT_PATH.getKey()));
    assertEquals(1L, configuration.get(PcapOptions.START_TIME_MS.getKey()));
    assertEquals(2L, configuration.get(PcapOptions.END_TIME_MS.getKey()));
    assertEquals(2, configuration.get(PcapOptions.NUM_REDUCERS.getKey()));
    assertEquals("query", configuration.get(QueryPcapOptions.QUERY.getKey()));
}
Also used : MockPcapJob(org.apache.metron.rest.mock.MockPcapJob) InMemoryJobManager(org.apache.metron.job.manager.InMemoryJobManager) FileSystem(org.apache.hadoop.fs.FileSystem) InMemoryJobManager(org.apache.metron.job.manager.InMemoryJobManager) JobManager(org.apache.metron.job.manager.JobManager) Test(org.junit.jupiter.api.Test)

Aggregations

InMemoryJobManager (org.apache.metron.job.manager.InMemoryJobManager)15 Test (org.junit.jupiter.api.Test)14 FileSystem (org.apache.hadoop.fs.FileSystem)12 PcapJobSupplier (org.apache.metron.rest.config.PcapJobSupplier)8 MockPcapJobSupplier (org.apache.metron.rest.mock.MockPcapJobSupplier)8 Path (org.apache.hadoop.fs.Path)7 JobManager (org.apache.metron.job.manager.JobManager)6 MockPcapJob (org.apache.metron.rest.mock.MockPcapJob)5 RestException (org.apache.metron.rest.RestException)3 IOException (java.io.IOException)2 FixedPcapFilter (org.apache.metron.pcap.filter.fixed.FixedPcapFilter)2 ByteArrayInputStream (java.io.ByteArrayInputStream)1 ByteArrayOutputStream (java.io.ByteArrayOutputStream)1 OutputStream (java.io.OutputStream)1 HashMap (java.util.HashMap)1 FSDataInputStream (org.apache.hadoop.fs.FSDataInputStream)1 QueryPcapFilter (org.apache.metron.pcap.filter.query.QueryPcapFilter)1 BeforeEach (org.junit.jupiter.api.BeforeEach)1