Search in sources :

Example 1 with YarnAppWithJobs

use of com.microsoft.azure.hdinsight.sdk.rest.spark.YarnAppWithJobs in project azure-tools-for-java by Microsoft.

the class SparkJobHttpHandler method handle.

@Override
public void handle(HttpExchange httpExchange) throws IOException {
    httpExchange.getResponseHeaders().add("Access-Control-Allow-Origin", "*");
    JobRequestDetails requestDetail = JobRequestDetails.getJobRequestDetail(httpExchange);
    try {
        String path = requestDetail.getRequestPath();
        if (path.equalsIgnoreCase("/applications/") && requestDetail.getAppId().equalsIgnoreCase("0")) {
            try {
                List<Application> applications = SparkRestUtil.getSparkApplications(requestDetail.getCluster());
                Optional<String> responseString = ObjectConvertUtils.convertObjectToJsonString(applications);
                JobUtils.setResponse(httpExchange, responseString.orElseThrow(IOException::new));
            } catch (HDIException e) {
                DefaultLoader.getUIHelper().logError("get applications list error", e);
            }
        } else if (path.contains("application_graph")) {
            ApplicationKey key = new ApplicationKey(requestDetail.getCluster(), requestDetail.getAppId());
            List<Job> jobs = JobViewCacheManager.getJob(key);
            App app = JobViewCacheManager.getYarnApp(key);
            List<JobStartEventLog> jobStartEventLogs = JobViewCacheManager.getJobStartEventLogs(key);
            YarnAppWithJobs yarnAppWithJobs = new YarnAppWithJobs(app, jobs, jobStartEventLogs);
            Optional<String> responseString = ObjectConvertUtils.convertObjectToJsonString(yarnAppWithJobs);
            JobUtils.setResponse(httpExchange, responseString.orElseThrow(IOException::new));
        } else if (path.contains("stages_summary")) {
            List<Stage> stages = JobViewCacheManager.getStages(new ApplicationKey(requestDetail.getCluster(), requestDetail.getAppId()));
            Optional<String> responseString = ObjectConvertUtils.convertObjectToJsonString(stages);
            JobUtils.setResponse(httpExchange, responseString.orElseThrow(IOException::new));
        } else if (path.contains("executors_summary")) {
            List<Executor> executors = JobViewCacheManager.getExecutors(new ApplicationKey(requestDetail.getCluster(), requestDetail.getAppId()));
            Optional<String> responseString = ObjectConvertUtils.convertObjectToJsonString(executors);
            JobUtils.setResponse(httpExchange, responseString.orElseThrow(IOException::new));
        } else if (path.contains("tasks_summary")) {
            List<Task> tasks = JobViewCacheManager.getTasks(new ApplicationKey(requestDetail.getCluster(), requestDetail.getAppId()));
            Optional<String> responseString = ObjectConvertUtils.convertObjectToJsonString(tasks);
            JobUtils.setResponse(httpExchange, responseString.orElseThrow(IOException::new));
        }
    } catch (ExecutionException e) {
        JobUtils.setResponse(httpExchange, e.getMessage(), 500);
    }
}
Also used : App(com.microsoft.azure.hdinsight.sdk.rest.yarn.rm.App) Task(com.microsoft.azure.hdinsight.sdk.rest.spark.task.Task) Optional(java.util.Optional) JobRequestDetails(com.microsoft.azure.hdinsight.spark.jobs.framework.JobRequestDetails) HDIException(com.microsoft.azure.hdinsight.sdk.common.HDIException) IOException(java.io.IOException) Stage(com.microsoft.azure.hdinsight.sdk.rest.spark.stage.Stage) List(java.util.List) ExecutionException(java.util.concurrent.ExecutionException) Application(com.microsoft.azure.hdinsight.sdk.rest.spark.Application) YarnAppWithJobs(com.microsoft.azure.hdinsight.sdk.rest.spark.YarnAppWithJobs)

Aggregations

HDIException (com.microsoft.azure.hdinsight.sdk.common.HDIException)1 Application (com.microsoft.azure.hdinsight.sdk.rest.spark.Application)1 YarnAppWithJobs (com.microsoft.azure.hdinsight.sdk.rest.spark.YarnAppWithJobs)1 Stage (com.microsoft.azure.hdinsight.sdk.rest.spark.stage.Stage)1 Task (com.microsoft.azure.hdinsight.sdk.rest.spark.task.Task)1 App (com.microsoft.azure.hdinsight.sdk.rest.yarn.rm.App)1 JobRequestDetails (com.microsoft.azure.hdinsight.spark.jobs.framework.JobRequestDetails)1 IOException (java.io.IOException)1 List (java.util.List)1 Optional (java.util.Optional)1 ExecutionException (java.util.concurrent.ExecutionException)1