Search in sources :

Example 1 with ModelClusterFactory

use of de.tum.in.www1.artemis.service.compass.controller.ModelClusterFactory in project ArTEMiS by ls1intum.

the class AssessmentKnowledgeIntegrationTest method testSetModelAssessmentKnowledgeToModelElements.

/**
 * Tests that a ModelAssessmentKnowledge is correctly set to model elements
 * based on the ModelAssessmentKnowledge of the respective exercise
 *
 * @throws Exception might be thrown from Network Call to Artemis API
 */
@Test
@WithMockUser(username = "instructor1", roles = "INSTRUCTOR")
public void testSetModelAssessmentKnowledgeToModelElements() throws Exception {
    ModelingSubmission submission1 = ModelFactory.generateModelingSubmission(FileUtils.loadFileFromResources("test-data/model-submission/model.54727.json"), true);
    submission1.setId(1L);
    ModelingSubmission submission2 = ModelFactory.generateModelingSubmission(FileUtils.loadFileFromResources("test-data/model-submission/model.54727.cpy.json"), true);
    submission2.setId(2L);
    ModelingSubmission submission3 = ModelFactory.generateModelingSubmission(FileUtils.loadFileFromResources("test-data/model-submission/model.54727.cpy.json"), true);
    submission3.setId(3L);
    ModelingSubmission submission4 = ModelFactory.generateModelingSubmission(FileUtils.loadFileFromResources("test-data/model-submission/model.54727.cpy.json"), true);
    submission4.setId(4L);
    Course course = database.addEmptyCourse();
    ModelingExercise exercise1 = modelingExerciseUtilService.createModelingExercise(course.getId());
    ModelingExercise exercise2 = modelingExerciseUtilService.createModelingExercise(course.getId());
    modelAssessmentKnowledgeService = new ModelAssessmentKnowledgeService(modelAssessmentKnowledgeRepository, modelingExerciseRepository);
    exercise1.setKnowledge(modelAssessmentKnowledgeService.createNewKnowledge());
    exercise2.setKnowledge(modelAssessmentKnowledgeService.createNewKnowledge());
    ModelClusterFactory modelClusterFactory = new ModelClusterFactory();
    List<ModelCluster> modelClusters1 = modelClusterFactory.buildClusters(List.of(submission1, submission2), exercise1);
    List<ModelCluster> modelClusters2 = modelClusterFactory.buildClusters(List.of(submission3, submission4), exercise2);
    ModelCluster modelCluster = modelClusters1.get(0);
    for (ModelElement element : modelCluster.getModelElements()) {
        assertThat(element.getKnowledge().getId()).isEqualTo(exercise1.getKnowledge().getId());
    }
    modelCluster = modelClusters2.get(0);
    for (ModelElement element : modelCluster.getModelElements()) {
        assertThat(element.getKnowledge().getId()).isEqualTo(exercise2.getKnowledge().getId());
    }
    assertThat(exercise1.getKnowledge().getId()).isNotEqualTo(exercise2.getKnowledge().getId());
}
Also used : ModelClusterFactory(de.tum.in.www1.artemis.service.compass.controller.ModelClusterFactory) ModelElement(de.tum.in.www1.artemis.domain.modeling.ModelElement) ModelingSubmission(de.tum.in.www1.artemis.domain.modeling.ModelingSubmission) ModelingExercise(de.tum.in.www1.artemis.domain.modeling.ModelingExercise) ModelAssessmentKnowledgeService(de.tum.in.www1.artemis.service.ModelAssessmentKnowledgeService) ModelCluster(de.tum.in.www1.artemis.domain.modeling.ModelCluster) Course(de.tum.in.www1.artemis.domain.Course) WithMockUser(org.springframework.security.test.context.support.WithMockUser) Test(org.junit.jupiter.api.Test)

Example 2 with ModelClusterFactory

use of de.tum.in.www1.artemis.service.compass.controller.ModelClusterFactory in project ArTEMiS by ls1intum.

the class CompassService method getSuggestionResult.

/**
 * Selects the feedback suggestion for each element in submission and creates a result from them
 * Returns null if no feedback can be selected or the submission has already a manual feedback
 *
 * @param modelingSubmission the submission to select feedbacks for
 * @param modelingExercise the modeling exercise to which the submission belongs
 * @return the semi-automatic result that has the feedbacks inside
 */
public Result getSuggestionResult(ModelingSubmission modelingSubmission, ModelingExercise modelingExercise) {
    Result result = getAutomaticResultForSubmission(modelingSubmission);
    if (result != null) {
        List<Feedback> feedbacksForSuggestion = new ArrayList<>();
        ModelClusterFactory clusterBuilder = new ModelClusterFactory();
        List<UMLElement> elements = clusterBuilder.getModelElements(modelingSubmission);
        List<ModelElement> modelElements = modelElementRepository.findByModelElementIdIn(elements.stream().map(UMLElement::getJSONElementID).collect(Collectors.toList()));
        List<Long> clusterIds = modelElements.stream().map(ModelElement::getCluster).map(ModelCluster::getId).collect(Collectors.toList());
        List<ModelCluster> modelClusters = modelClusterRepository.findAllByIdInWithEagerElements(clusterIds);
        List<String> references = modelClusters.stream().flatMap(modelCluster -> modelCluster.getModelElements().stream()).map(modelElement1 -> modelElement1.getModelElementType() + ":" + modelElement1.getModelElementId()).collect(Collectors.toList());
        List<Feedback> feedbacks = feedbackRepository.findByReferenceInAndResult_Submission_Participation_Exercise(references, modelingExercise);
        for (ModelElement modelElement : modelElements) {
            if (modelElement != null) {
                ModelCluster cluster = modelClusters.get(modelClusters.indexOf(modelElement.getCluster()));
                Set<ModelElement> similarElements = cluster.getModelElements();
                List<String> similarReferences = similarElements.stream().map(element -> element.getModelElementType() + ":" + element.getModelElementId()).toList();
                List<Feedback> similarFeedbacks = feedbacks.stream().filter(feedback -> similarReferences.contains(feedback.getReference())).collect(Collectors.toList());
                Feedback suggestedFeedback = FeedbackSelector.selectFeedback(modelElement, similarFeedbacks, result);
                if (suggestedFeedback != null) {
                    feedbacksForSuggestion.add(suggestedFeedback);
                }
            }
        }
        if (feedbacksForSuggestion.isEmpty()) {
            return null;
        }
        // Note, that a result is always initialized with an empty list -> no NPE here
        result.getFeedbacks().clear();
        result.getFeedbacks().addAll(feedbacksForSuggestion);
        result.setHasFeedback(false);
        result.setAssessmentType(AssessmentType.SEMI_AUTOMATIC);
    }
    return result;
}
Also used : java.util(java.util) Feedback(de.tum.in.www1.artemis.domain.Feedback) Logger(org.slf4j.Logger) FeedbackSelector(de.tum.in.www1.artemis.service.compass.controller.FeedbackSelector) de.tum.in.www1.artemis.repository(de.tum.in.www1.artemis.repository) TimeLogUtil(de.tum.in.www1.artemis.service.util.TimeLogUtil) LoggerFactory(org.slf4j.LoggerFactory) AssessmentType(de.tum.in.www1.artemis.domain.enumeration.AssessmentType) Collectors(java.util.stream.Collectors) UMLElement(de.tum.in.www1.artemis.service.compass.umlmodel.UMLElement) Result(de.tum.in.www1.artemis.domain.Result) ModelElement(de.tum.in.www1.artemis.domain.modeling.ModelElement) ModelClusterFactory(de.tum.in.www1.artemis.service.compass.controller.ModelClusterFactory) Service(org.springframework.stereotype.Service) ModelCluster(de.tum.in.www1.artemis.domain.modeling.ModelCluster) ModelingSubmission(de.tum.in.www1.artemis.domain.modeling.ModelingSubmission) StudentParticipation(de.tum.in.www1.artemis.domain.participation.StudentParticipation) ModelingExercise(de.tum.in.www1.artemis.domain.modeling.ModelingExercise) UMLElement(de.tum.in.www1.artemis.service.compass.umlmodel.UMLElement) ModelCluster(de.tum.in.www1.artemis.domain.modeling.ModelCluster) Result(de.tum.in.www1.artemis.domain.Result) ModelClusterFactory(de.tum.in.www1.artemis.service.compass.controller.ModelClusterFactory) ModelElement(de.tum.in.www1.artemis.domain.modeling.ModelElement) Feedback(de.tum.in.www1.artemis.domain.Feedback)

Example 3 with ModelClusterFactory

use of de.tum.in.www1.artemis.service.compass.controller.ModelClusterFactory in project ArTEMiS by ls1intum.

the class CompassService method build.

/**
 * Builds and saves the clusters
 * Does not build clusters if there is already a cluster for given exercise
 *
 * @param modelingExercise the exercise to build clusters for
 */
public void build(ModelingExercise modelingExercise) {
    long start = System.nanoTime();
    if (!isSupported(modelingExercise)) {
        return;
    }
    List<ModelCluster> currentClusters = modelClusterRepository.findAllByExerciseIdWithEagerElements(modelingExercise.getId());
    if (!currentClusters.isEmpty()) {
        log.info("Clusters have already been built. First delete existing clusters and then rebuild them!");
        // Do not build submissions if this process has already been done before
        return;
    }
    List<ModelingSubmission> submissions = modelingSubmissionRepository.findSubmittedByExerciseIdWithEagerResultsAndFeedback(modelingExercise.getId());
    log.info("ModelCluster: start building clusters of {} submissions for modeling exercise {}", submissions.size(), modelingExercise.getId());
    ModelClusterFactory clusterFactory = new ModelClusterFactory();
    List<ModelCluster> modelClusters = clusterFactory.buildClusters(submissions, modelingExercise);
    log.info("ModelClusterTimeLog: building clusters of {} submissions for modeling exercise {} done in {}", submissions.size(), modelingExercise.getId(), TimeLogUtil.formatDurationFrom(start));
    modelClusterRepository.saveAll(modelClusters);
    modelElementRepository.saveAll(modelClusters.stream().flatMap(modelCluster -> modelCluster.getModelElements().stream()).collect(Collectors.toList()));
    log.info("ModelClusterTimeLog: building and saving clusters of {} submissions for exercise {} done in {}", submissions.size(), modelingExercise.getId(), TimeLogUtil.formatDurationFrom(start));
}
Also used : ModelClusterFactory(de.tum.in.www1.artemis.service.compass.controller.ModelClusterFactory) ModelingSubmission(de.tum.in.www1.artemis.domain.modeling.ModelingSubmission) ModelCluster(de.tum.in.www1.artemis.domain.modeling.ModelCluster)

Example 4 with ModelClusterFactory

use of de.tum.in.www1.artemis.service.compass.controller.ModelClusterFactory in project Artemis by ls1intum.

the class CompassService method build.

/**
 * Builds and saves the clusters
 * Does not build clusters if there is already a cluster for given exercise
 *
 * @param modelingExercise the exercise to build clusters for
 */
public void build(ModelingExercise modelingExercise) {
    long start = System.nanoTime();
    if (!isSupported(modelingExercise)) {
        return;
    }
    List<ModelCluster> currentClusters = modelClusterRepository.findAllByExerciseIdWithEagerElements(modelingExercise.getId());
    if (!currentClusters.isEmpty()) {
        log.info("Clusters have already been built. First delete existing clusters and then rebuild them!");
        // Do not build submissions if this process has already been done before
        return;
    }
    List<ModelingSubmission> submissions = modelingSubmissionRepository.findSubmittedByExerciseIdWithEagerResultsAndFeedback(modelingExercise.getId());
    log.info("ModelCluster: start building clusters of {} submissions for modeling exercise {}", submissions.size(), modelingExercise.getId());
    ModelClusterFactory clusterFactory = new ModelClusterFactory();
    List<ModelCluster> modelClusters = clusterFactory.buildClusters(submissions, modelingExercise);
    log.info("ModelClusterTimeLog: building clusters of {} submissions for modeling exercise {} done in {}", submissions.size(), modelingExercise.getId(), TimeLogUtil.formatDurationFrom(start));
    modelClusterRepository.saveAll(modelClusters);
    modelElementRepository.saveAll(modelClusters.stream().flatMap(modelCluster -> modelCluster.getModelElements().stream()).collect(Collectors.toList()));
    log.info("ModelClusterTimeLog: building and saving clusters of {} submissions for exercise {} done in {}", submissions.size(), modelingExercise.getId(), TimeLogUtil.formatDurationFrom(start));
}
Also used : ModelClusterFactory(de.tum.in.www1.artemis.service.compass.controller.ModelClusterFactory) ModelingSubmission(de.tum.in.www1.artemis.domain.modeling.ModelingSubmission) ModelCluster(de.tum.in.www1.artemis.domain.modeling.ModelCluster)

Example 5 with ModelClusterFactory

use of de.tum.in.www1.artemis.service.compass.controller.ModelClusterFactory in project Artemis by ls1intum.

the class CompassService method getSuggestionResult.

/**
 * Selects the feedback suggestion for each element in submission and creates a result from them
 * Returns null if no feedback can be selected or the submission has already a manual feedback
 *
 * @param modelingSubmission the submission to select feedbacks for
 * @param modelingExercise the modeling exercise to which the submission belongs
 * @return the semi-automatic result that has the feedbacks inside
 */
public Result getSuggestionResult(ModelingSubmission modelingSubmission, ModelingExercise modelingExercise) {
    Result result = getAutomaticResultForSubmission(modelingSubmission);
    if (result != null) {
        List<Feedback> feedbacksForSuggestion = new ArrayList<>();
        ModelClusterFactory clusterBuilder = new ModelClusterFactory();
        List<UMLElement> elements = clusterBuilder.getModelElements(modelingSubmission);
        List<ModelElement> modelElements = modelElementRepository.findByModelElementIdIn(elements.stream().map(UMLElement::getJSONElementID).collect(Collectors.toList()));
        List<Long> clusterIds = modelElements.stream().map(ModelElement::getCluster).map(ModelCluster::getId).collect(Collectors.toList());
        List<ModelCluster> modelClusters = modelClusterRepository.findAllByIdInWithEagerElements(clusterIds);
        List<String> references = modelClusters.stream().flatMap(modelCluster -> modelCluster.getModelElements().stream()).map(modelElement1 -> modelElement1.getModelElementType() + ":" + modelElement1.getModelElementId()).collect(Collectors.toList());
        List<Feedback> feedbacks = feedbackRepository.findByReferenceInAndResult_Submission_Participation_Exercise(references, modelingExercise);
        for (ModelElement modelElement : modelElements) {
            if (modelElement != null) {
                ModelCluster cluster = modelClusters.get(modelClusters.indexOf(modelElement.getCluster()));
                Set<ModelElement> similarElements = cluster.getModelElements();
                List<String> similarReferences = similarElements.stream().map(element -> element.getModelElementType() + ":" + element.getModelElementId()).toList();
                List<Feedback> similarFeedbacks = feedbacks.stream().filter(feedback -> similarReferences.contains(feedback.getReference())).collect(Collectors.toList());
                Feedback suggestedFeedback = FeedbackSelector.selectFeedback(modelElement, similarFeedbacks, result);
                if (suggestedFeedback != null) {
                    feedbacksForSuggestion.add(suggestedFeedback);
                }
            }
        }
        if (feedbacksForSuggestion.isEmpty()) {
            return null;
        }
        // Note, that a result is always initialized with an empty list -> no NPE here
        result.getFeedbacks().clear();
        result.getFeedbacks().addAll(feedbacksForSuggestion);
        result.setHasFeedback(false);
        result.setAssessmentType(AssessmentType.SEMI_AUTOMATIC);
    }
    return result;
}
Also used : java.util(java.util) Feedback(de.tum.in.www1.artemis.domain.Feedback) Logger(org.slf4j.Logger) FeedbackSelector(de.tum.in.www1.artemis.service.compass.controller.FeedbackSelector) de.tum.in.www1.artemis.repository(de.tum.in.www1.artemis.repository) TimeLogUtil(de.tum.in.www1.artemis.service.util.TimeLogUtil) LoggerFactory(org.slf4j.LoggerFactory) AssessmentType(de.tum.in.www1.artemis.domain.enumeration.AssessmentType) Collectors(java.util.stream.Collectors) UMLElement(de.tum.in.www1.artemis.service.compass.umlmodel.UMLElement) Result(de.tum.in.www1.artemis.domain.Result) ModelElement(de.tum.in.www1.artemis.domain.modeling.ModelElement) ModelClusterFactory(de.tum.in.www1.artemis.service.compass.controller.ModelClusterFactory) Service(org.springframework.stereotype.Service) ModelCluster(de.tum.in.www1.artemis.domain.modeling.ModelCluster) ModelingSubmission(de.tum.in.www1.artemis.domain.modeling.ModelingSubmission) StudentParticipation(de.tum.in.www1.artemis.domain.participation.StudentParticipation) ModelingExercise(de.tum.in.www1.artemis.domain.modeling.ModelingExercise) UMLElement(de.tum.in.www1.artemis.service.compass.umlmodel.UMLElement) ModelCluster(de.tum.in.www1.artemis.domain.modeling.ModelCluster) Result(de.tum.in.www1.artemis.domain.Result) ModelClusterFactory(de.tum.in.www1.artemis.service.compass.controller.ModelClusterFactory) ModelElement(de.tum.in.www1.artemis.domain.modeling.ModelElement) Feedback(de.tum.in.www1.artemis.domain.Feedback)

Aggregations

ModelCluster (de.tum.in.www1.artemis.domain.modeling.ModelCluster)6 ModelingSubmission (de.tum.in.www1.artemis.domain.modeling.ModelingSubmission)6 ModelClusterFactory (de.tum.in.www1.artemis.service.compass.controller.ModelClusterFactory)6 ModelElement (de.tum.in.www1.artemis.domain.modeling.ModelElement)4 ModelingExercise (de.tum.in.www1.artemis.domain.modeling.ModelingExercise)4 Course (de.tum.in.www1.artemis.domain.Course)2 Feedback (de.tum.in.www1.artemis.domain.Feedback)2 Result (de.tum.in.www1.artemis.domain.Result)2 AssessmentType (de.tum.in.www1.artemis.domain.enumeration.AssessmentType)2 StudentParticipation (de.tum.in.www1.artemis.domain.participation.StudentParticipation)2 de.tum.in.www1.artemis.repository (de.tum.in.www1.artemis.repository)2 ModelAssessmentKnowledgeService (de.tum.in.www1.artemis.service.ModelAssessmentKnowledgeService)2 FeedbackSelector (de.tum.in.www1.artemis.service.compass.controller.FeedbackSelector)2 UMLElement (de.tum.in.www1.artemis.service.compass.umlmodel.UMLElement)2 TimeLogUtil (de.tum.in.www1.artemis.service.util.TimeLogUtil)2 java.util (java.util)2 Collectors (java.util.stream.Collectors)2 Test (org.junit.jupiter.api.Test)2 Logger (org.slf4j.Logger)2 LoggerFactory (org.slf4j.LoggerFactory)2