Search in sources :

Example 1 with HadoopEmbeddedTaskExecutor

use of org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopEmbeddedTaskExecutor in project ignite by apache.

the class HadoopProcessor method start.

/** {@inheritDoc} */
@Override
public void start(boolean activeOnStart) throws IgniteCheckedException {
    if (ctx.isDaemon())
        return;
    HadoopConfiguration cfg = ctx.config().getHadoopConfiguration();
    if (cfg == null)
        cfg = new HadoopConfiguration();
    else
        cfg = new HadoopConfiguration(cfg);
    initializeDefaults(cfg);
    hctx = new HadoopContext(ctx, cfg, new HadoopJobTracker(), new HadoopEmbeddedTaskExecutor(), //cfg.isExternalExecution() ? new HadoopExternalTaskExecutor() : new HadoopEmbeddedTaskExecutor(),
    new HadoopShuffle());
    for (HadoopComponent c : hctx.components()) c.start(hctx);
    hadoop = new HadoopImpl(this);
    ctx.addNodeAttribute(HadoopAttributes.NAME, new HadoopAttributes(cfg));
}
Also used : HadoopShuffle(org.apache.ignite.internal.processors.hadoop.shuffle.HadoopShuffle) HadoopJobTracker(org.apache.ignite.internal.processors.hadoop.jobtracker.HadoopJobTracker) HadoopEmbeddedTaskExecutor(org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopEmbeddedTaskExecutor) HadoopConfiguration(org.apache.ignite.configuration.HadoopConfiguration)

Aggregations

HadoopConfiguration (org.apache.ignite.configuration.HadoopConfiguration)1 HadoopJobTracker (org.apache.ignite.internal.processors.hadoop.jobtracker.HadoopJobTracker)1 HadoopShuffle (org.apache.ignite.internal.processors.hadoop.shuffle.HadoopShuffle)1 HadoopEmbeddedTaskExecutor (org.apache.ignite.internal.processors.hadoop.taskexecutor.HadoopEmbeddedTaskExecutor)1