Test analysis
Exam analysis: learning analytics (P, Rit and Rir values, standard deviation) in student view
In student view, you can access the following analytics: scores, maximum score percentage, percentage of passes and fails, P value, Rit value, Rir value and the question’s standard deviation. The steps that follow explain how to access this information.
-
Tip! For more practical or content-oriented information on the analysis (and constructing) exams, please go to the Online training on assessment.
This module covers the following topics more in-depth:
- Why should I analyse a test?
- Any related terms are explained (P/P’ values, Rir value, Coefficient alpha)
- How to analyse a test?
- Practice with analysing a test.
-
Step 1
- Log in to student view.
- Click the Results tab, then select Analysis from the drop-down menu.
- Find the exam whose analytics you want to view (you can filter by recipe or test moment using the tabs).
- You will see a table with at the top the tabs: ‘Overview’, ‘Result details’ and ‘Analyze items’.
- Or you can use this shortcut to get to the Learning Analytics.
-
Please note: The ‘Group analysis’ has been turned off for the UU
from 25 September 2022 onwards, but the tab can still be seen in some of the screenshots on this page. If you have any questions about the decision to turn off the group analysis, please contact digitaletoetsing@uu.nl -
Step 2
Tab: Overview
- You will arrive at the following screen in Learning Analytics.
- The line graph shows a percentage of the achieved scores and the pie chart shows the percentages of passing and failing grades when you hover your mouse cursor over it.
- No pie chart will be shown when names for score areas are not mentioned in a test that contains feedback lines. The pie chart will show only grey colours when no caesure is set.
- Below the graphs is a list of all students. You can sort students in ascending or descending order of grade, start time or status by clicking the little arrows behind those headers (see image)
-
Step 3
Tab: Result details
- Up and to the right of the list of students is a tab labelled Result details. Click that to see the P value, standard deviation, Rir value and Rit value of each question as well as how the students answered each question.
- To see which question’s information you’re viewing, you need to hover your mouse cursor over one of the numbers (1 to 9, in this example). That will reveal the name of the question. If you want the see the whole question, you have to click the coloured square (red or green). The question will be shown in its entirety, including the student’s answer.
- The Action drop-down menu allows you to export the data to Excel.
-
Step 4
Tab: Result details
- If you have added feedback (i.e. feedback: see scores for specific exam section), you will be able to filter through the drop-down menu ‘Feedback’ (See screenshot: here in Dutch ‘Terugkoppeling’).
- When filtering you van choose to show the result details of one feedback line, or to show all feedback lines simultaneously.
- The type of values you see with the feedback lines are equal to those under the tab ‘Result details’ (see previous step).
- The Action drop-down menu allows you to export the data to Excel.
-
Step 5
Tab: Analyse questions
- Click on the Analyse questions tab.
- Under ‘Code’, you will see the name of your questions, its ID as noted in the Admin view, and the version used during the exam.
- When you have clicked on the Analyse questions tab, you’ll also see an overview that lists under results the number of students that have answered the question, its P value, its Rit value and its standard deviation.
- Values marked with a red triangle deviate from the defined optimum value. Hover your mouse cursor over these values for an explanation.
- In the column with the word cloud, you can see whether comments have been made on certain questions. Please have a look at this page to learn how to add and read comments.
- On the right-hand side of the table, there are two icons.
- When you click the icon with a lower-case i (show details), you’ll be shown the questions with general information about each question, its version and metadata underneath it.
- When you click the icon that looks like a list (Show answers given), graphs appear showing the number of times students have selected each of the answers. You can modify the answer model directly from this screen if, for instance, it turns out that one of your distractors is actually a valid answer to the question.
-
Step 6
Tab: Comments
Note: this tab is only available when it has been set that candidates can leave comments during the exam.
- Click on the Comments tab.
- Here you will see an overview of all the comments from all the students that have been left on this test recipe/test moment.
- In the column on the right you have the options to reply on a comment, close a comment, or view what you have replied on the comment.
- It is also possible to go directly to the result page of a specific candidate. This page will be filtered to all questions that the candidate has left a comment on.