Search in sources :

Example 1 with RingBufferEventRepository

use of org.apache.nifi.controller.repository.metrics.RingBufferEventRepository in project nifi by apache.

the class TestRingBufferEventRepository method testAdd.

@Test
public void testAdd() throws IOException {
    final RingBufferEventRepository repo = new RingBufferEventRepository(5);
    long insertNanos = 0L;
    for (int i = 0; i < 1000000; i++) {
        final FlowFileEvent event = generateEvent();
        final long insertStart = System.nanoTime();
        repo.updateRepository(event);
        insertNanos += System.nanoTime() - insertStart;
    }
    final long queryStart = System.nanoTime();
    final StandardRepositoryStatusReport report = repo.reportTransferEvents(System.currentTimeMillis() - 2 * 60000);
    final long queryNanos = System.nanoTime() - queryStart;
    System.out.println(report);
    System.out.println("Insert: " + TimeUnit.MILLISECONDS.convert(insertNanos, TimeUnit.NANOSECONDS));
    System.out.println("Query: " + TimeUnit.MILLISECONDS.convert(queryNanos, TimeUnit.NANOSECONDS));
    repo.close();
}
Also used : FlowFileEvent(org.apache.nifi.controller.repository.FlowFileEvent) StandardRepositoryStatusReport(org.apache.nifi.controller.repository.StandardRepositoryStatusReport) RingBufferEventRepository(org.apache.nifi.controller.repository.metrics.RingBufferEventRepository) Test(org.junit.Test)

Example 2 with RingBufferEventRepository

use of org.apache.nifi.controller.repository.metrics.RingBufferEventRepository in project nifi-minifi by apache.

the class MiNiFiServer method start.

public void start() {
    try {
        logger.info("Loading Flow...");
        FlowFileEventRepository flowFileEventRepository = new RingBufferEventRepository(5);
        AuditService auditService = new StandardAuditService();
        Authorizer authorizer = new Authorizer() {

            @Override
            public AuthorizationResult authorize(AuthorizationRequest request) throws AuthorizationAccessException {
                return AuthorizationResult.approved();
            }

            @Override
            public void initialize(AuthorizerInitializationContext initializationContext) throws AuthorizerCreationException {
            // do nothing
            }

            @Override
            public void onConfigured(AuthorizerConfigurationContext configurationContext) throws AuthorizerCreationException {
            // do nothing
            }

            @Override
            public void preDestruction() throws AuthorizerDestructionException {
            // do nothing
            }
        };
        final String sensitivePropAlgorithmVal = props.getProperty(StringEncryptor.NF_SENSITIVE_PROPS_ALGORITHM);
        final String sensitivePropProviderVal = props.getProperty(StringEncryptor.NF_SENSITIVE_PROPS_PROVIDER);
        final String sensitivePropValueNifiPropVar = props.getProperty(StringEncryptor.NF_SENSITIVE_PROPS_KEY, DEFAULT_SENSITIVE_PROPS_KEY);
        StringEncryptor encryptor = StringEncryptor.createEncryptor(sensitivePropAlgorithmVal, sensitivePropProviderVal, sensitivePropValueNifiPropVar);
        VariableRegistry variableRegistry = new FileBasedVariableRegistry(props.getVariableRegistryPropertiesPaths());
        BulletinRepository bulletinRepository = new VolatileBulletinRepository();
        FlowController flowController = FlowController.createStandaloneInstance(flowFileEventRepository, props, authorizer, auditService, encryptor, bulletinRepository, variableRegistry, new StandardFlowRegistryClient());
        flowService = StandardFlowService.createStandaloneInstance(flowController, props, encryptor, // revision manager
        null, authorizer);
        // start and load the flow
        flowService.start();
        flowService.load(null);
        flowController.onFlowInitialized(true);
        flowController.getGroup(flowController.getRootGroupId()).startProcessing();
        this.flowController = flowController;
        logger.info("Flow loaded successfully.");
    } catch (Exception e) {
        // ensure the flow service is terminated
        if (flowService != null && flowService.isRunning()) {
            flowService.stop(false);
        }
        startUpFailure(new Exception("Unable to load flow due to: " + e, e));
    }
}
Also used : VolatileBulletinRepository(org.apache.nifi.events.VolatileBulletinRepository) VolatileBulletinRepository(org.apache.nifi.events.VolatileBulletinRepository) BulletinRepository(org.apache.nifi.reporting.BulletinRepository) AuthorizationRequest(org.apache.nifi.authorization.AuthorizationRequest) FileBasedVariableRegistry(org.apache.nifi.util.FileBasedVariableRegistry) VariableRegistry(org.apache.nifi.registry.VariableRegistry) StatusRequestException(org.apache.nifi.minifi.status.StatusRequestException) AuthorizerCreationException(org.apache.nifi.authorization.exception.AuthorizerCreationException) AuthorizerDestructionException(org.apache.nifi.authorization.exception.AuthorizerDestructionException) AuthorizationAccessException(org.apache.nifi.authorization.exception.AuthorizationAccessException) RingBufferEventRepository(org.apache.nifi.controller.repository.metrics.RingBufferEventRepository) FlowFileEventRepository(org.apache.nifi.controller.repository.FlowFileEventRepository) Authorizer(org.apache.nifi.authorization.Authorizer) StringEncryptor(org.apache.nifi.encrypt.StringEncryptor) FlowController(org.apache.nifi.controller.FlowController) AuthorizerInitializationContext(org.apache.nifi.authorization.AuthorizerInitializationContext) StandardFlowRegistryClient(org.apache.nifi.registry.flow.StandardFlowRegistryClient) StandardAuditService(org.apache.nifi.admin.service.impl.StandardAuditService) AuditService(org.apache.nifi.admin.service.AuditService) StandardAuditService(org.apache.nifi.admin.service.impl.StandardAuditService) AuthorizerConfigurationContext(org.apache.nifi.authorization.AuthorizerConfigurationContext) FileBasedVariableRegistry(org.apache.nifi.util.FileBasedVariableRegistry)

Aggregations

RingBufferEventRepository (org.apache.nifi.controller.repository.metrics.RingBufferEventRepository)2 AuditService (org.apache.nifi.admin.service.AuditService)1 StandardAuditService (org.apache.nifi.admin.service.impl.StandardAuditService)1 AuthorizationRequest (org.apache.nifi.authorization.AuthorizationRequest)1 Authorizer (org.apache.nifi.authorization.Authorizer)1 AuthorizerConfigurationContext (org.apache.nifi.authorization.AuthorizerConfigurationContext)1 AuthorizerInitializationContext (org.apache.nifi.authorization.AuthorizerInitializationContext)1 AuthorizationAccessException (org.apache.nifi.authorization.exception.AuthorizationAccessException)1 AuthorizerCreationException (org.apache.nifi.authorization.exception.AuthorizerCreationException)1 AuthorizerDestructionException (org.apache.nifi.authorization.exception.AuthorizerDestructionException)1 FlowController (org.apache.nifi.controller.FlowController)1 FlowFileEvent (org.apache.nifi.controller.repository.FlowFileEvent)1 FlowFileEventRepository (org.apache.nifi.controller.repository.FlowFileEventRepository)1 StandardRepositoryStatusReport (org.apache.nifi.controller.repository.StandardRepositoryStatusReport)1 StringEncryptor (org.apache.nifi.encrypt.StringEncryptor)1 VolatileBulletinRepository (org.apache.nifi.events.VolatileBulletinRepository)1 StatusRequestException (org.apache.nifi.minifi.status.StatusRequestException)1 VariableRegistry (org.apache.nifi.registry.VariableRegistry)1 StandardFlowRegistryClient (org.apache.nifi.registry.flow.StandardFlowRegistryClient)1 BulletinRepository (org.apache.nifi.reporting.BulletinRepository)1