Search in sources :

Example 6 with JobRun

use of org.apache.hyracks.control.cc.job.JobRun in project asterixdb by apache.

the class ReportProfilesWork method run.

@Override
public void run() {
    for (JobProfile profile : profiles) {
        JobRun run = jobManager.get(profile.getJobId());
        if (run != null) {
            JobProfile jp = run.getJobProfile();
            jp.merge(profile);
        }
    }
}
Also used : JobProfile(org.apache.hyracks.control.common.job.profiling.om.JobProfile) JobRun(org.apache.hyracks.control.cc.job.JobRun)

Example 7 with JobRun

use of org.apache.hyracks.control.cc.job.JobRun in project asterixdb by apache.

the class TaskFailureWork method performEvent.

@Override
protected void performEvent(TaskAttempt ta) {
    IJobManager jobManager = ccs.getJobManager();
    JobRun run = jobManager.get(jobId);
    ccs.getDatasetDirectoryService().reportJobFailure(jobId, exceptions);
    run.getExecutor().notifyTaskFailure(ta, exceptions);
}
Also used : IJobManager(org.apache.hyracks.control.cc.job.IJobManager) JobRun(org.apache.hyracks.control.cc.job.JobRun)

Example 8 with JobRun

use of org.apache.hyracks.control.cc.job.JobRun in project asterixdb by apache.

the class GetJobInfoWork method doRun.

@Override
protected void doRun() throws Exception {
    try {
        JobRun run = jobManager.get(jobId);
        JobInfo info = (run != null) ? new JobInfo(run.getJobId(), run.getStatus(), run.getOperatorLocations()) : null;
        callback.setValue(info);
    } catch (Exception e) {
        callback.setException(e);
    }
}
Also used : JobInfo(org.apache.hyracks.api.job.JobInfo) JobRun(org.apache.hyracks.control.cc.job.JobRun)

Example 9 with JobRun

use of org.apache.hyracks.control.cc.job.JobRun in project asterixdb by apache.

the class ActivityClusterPlanner method getTaskCluster.

private TaskCluster getTaskCluster(TaskId tid) {
    JobRun run = executor.getJobRun();
    ActivityCluster ac = run.getActivityClusterGraph().getActivityMap().get(tid.getActivityId());
    ActivityClusterPlan acp = run.getActivityClusterPlanMap().get(ac.getId());
    Task[] tasks = acp.getActivityPlanMap().get(tid.getActivityId()).getTasks();
    Task task = tasks[tid.getPartition()];
    assert task.getTaskId().equals(tid);
    return task.getTaskCluster();
}
Also used : Task(org.apache.hyracks.control.cc.job.Task) ActivityClusterPlan(org.apache.hyracks.control.cc.job.ActivityClusterPlan) JobRun(org.apache.hyracks.control.cc.job.JobRun) ActivityCluster(org.apache.hyracks.api.job.ActivityCluster)

Example 10 with JobRun

use of org.apache.hyracks.control.cc.job.JobRun in project asterixdb by apache.

the class ActivityClusterPlanner method planActivityCluster.

ActivityClusterPlan planActivityCluster(ActivityCluster ac) throws HyracksException {
    JobRun jobRun = executor.getJobRun();
    Map<ActivityId, ActivityPartitionDetails> pcMap = computePartitionCounts(ac);
    Map<ActivityId, ActivityPlan> activityPlanMap = buildActivityPlanMap(ac, jobRun, pcMap);
    assignConnectorPolicy(ac, activityPlanMap);
    TaskCluster[] taskClusters = computeTaskClusters(ac, jobRun, activityPlanMap);
    if (LOGGER.isLoggable(Level.INFO)) {
        LOGGER.info("Plan for " + ac);
        LOGGER.info("Built " + taskClusters.length + " Task Clusters");
        for (TaskCluster tc : taskClusters) {
            LOGGER.info("Tasks: " + Arrays.toString(tc.getTasks()));
        }
    }
    return new ActivityClusterPlan(taskClusters, activityPlanMap);
}
Also used : ActivityClusterPlan(org.apache.hyracks.control.cc.job.ActivityClusterPlan) ActivityId(org.apache.hyracks.api.dataflow.ActivityId) ActivityPlan(org.apache.hyracks.control.cc.job.ActivityPlan) TaskCluster(org.apache.hyracks.control.cc.job.TaskCluster) JobRun(org.apache.hyracks.control.cc.job.JobRun)

Aggregations

JobRun (org.apache.hyracks.control.cc.job.JobRun)19 IJobManager (org.apache.hyracks.control.cc.job.IJobManager)9 HyracksException (org.apache.hyracks.api.exceptions.HyracksException)5 ObjectMapper (com.fasterxml.jackson.databind.ObjectMapper)3 ActivityId (org.apache.hyracks.api.dataflow.ActivityId)3 ActivityPlan (org.apache.hyracks.control.cc.job.ActivityPlan)3 Task (org.apache.hyracks.control.cc.job.Task)3 TaskCluster (org.apache.hyracks.control.cc.job.TaskCluster)3 ArrayList (java.util.ArrayList)2 List (java.util.List)2 TaskId (org.apache.hyracks.api.dataflow.TaskId)2 ActivityCluster (org.apache.hyracks.api.job.ActivityCluster)2 PartitionId (org.apache.hyracks.api.partitions.PartitionId)2 INodeManager (org.apache.hyracks.control.cc.cluster.INodeManager)2 ActivityClusterPlan (org.apache.hyracks.control.cc.job.ActivityClusterPlan)2 PartitionMatchMaker (org.apache.hyracks.control.cc.partitions.PartitionMatchMaker)2 PartitionDescriptor (org.apache.hyracks.control.common.job.PartitionDescriptor)2 PartitionRequest (org.apache.hyracks.control.common.job.PartitionRequest)2 JobProfile (org.apache.hyracks.control.common.job.profiling.om.JobProfile)2 ObjectNode (com.fasterxml.jackson.databind.node.ObjectNode)1