Guides › Analytics
Analytics
Under Analytics you find everything that was answered in your sessions — from the overview of the whole semester down to the single answer. This guide shows the tabs, the analysis of a session, grading open answers and the export for Excel or statistics software.
-
1
Overview and filters
Step 1 of 13The Overview tab sums up: sessions, questions, answers, average score and participation, plus hints that point to anything unusual — such as questions with negative discrimination. The filter bar narrows things down by Period, Course and Topic and applies to all statistics tabs. Raw data exports the filtered range.
11Tabs22Period33Course44Topic55Raw data
Cockpit - Tabs
- Period
- Course
- Topic
- Raw data
-
2
Topics: maturity and coverage
Step 2 of 13The Topics tab shows for each topic how well it was answered on average and how many of its questions have already been asked. A click on a topic opens its history across the sessions.
Cockpit -
3
Times: planned versus actual
Step 3 of 13Under Times, planned and used time are shown side by side — per question, per playlist and per session. That way you see where your planning is regularly too tight.
Cockpit -
4
Questions: the quality map
Step 4 of 13The Questions tab places every question by difficulty (share correct) and discrimination (does it separate stronger from weaker participants?). The list “For review” names questions that are too easy, too hard or unclear.
Cockpit -
5
Courses: learning curve and engagement
Step 5 of 13The Courses tab draws the learning curve of each course across the semester and the response rate by the position of the question in the session — if it drops toward the end, the last slot is a poor place for the most important question. Further down are the short end-of-session feedback and, for courses with a participant list, attendance and results per person.
Cockpit -
6
Sessions
Step 6 of 13The Sessions tab lists every session with time, join mode, course and the number of questions, participants and answers — the newest at the top. A click on a row opens the session.
11Click a session
Cockpit - Click a session
-
7
The analysis of a session
Step 7 of 13The Analysis shows the key figures for each question: Difficulty P (share correct), Discrimination (red if, of all people, the weaker participants were right more often) and the answering time; below that the distribution of the answers. Longitudinal shows the same question across all sessions, Exclude removes a question from the analysis.
11Longitudinal22Exclude
Cockpit - Longitudinal
- Exclude
-
8
Longitudinal view of a question
Step 8 of 13The longitudinal view shows how a question has developed across all sessions in which it was asked — the difficulty for gradable questions, the median for estimates and scales.
Cockpit -
9
Correct by confidence
Step 9 of 13If a question asked for confidence, the analysis shows the table Correct by confidence: anyone who was sure and wrong has a misconception — that is the most important hint for the next class. Anyone who guessed and was right was lucky.
11Correct by confidence
Cockpit - Correct by confidence
-
10
Grade an answer
Step 10 of 13You grade open answers under Individual answers: the Grade and comment button on each row sets a level from 0 to 100 % and a comment. The grade counts toward the score, the participants’ scores and the raw data.
11Level22Comment
Cockpit - Level
- Comment
-
11
Form answer groups
Step 11 of 13You combine similar open answers into Answer groups: the button with the label icon on each row assigns the answer to a group or creates a new one. Above the table, an overview shows how many answers each group has — turning many free texts into a picture of the typical lines of thought.
11Overview of the groups22Assign answer group33graded answer
Cockpit - Overview of the groups
- Assign answer group
- graded answer
-
12
Export raw data
Step 12 of 13Raw data outputs the answers of the filtered range for Excel or statistics software — one row per answer, as pivot tables, R, SPSS or jamovi expect. Choose Excel (XLSX) or CSV; Participants anonymized replaces names with numbers that stay the same across all sessions.
Cockpit -
13
Answer patterns: can the solution be guessed?
Step 13 of 13The Answer patterns tab checks a topic or a playlist for telltale patterns: is the correct answer conspicuously often in the same position, is it usually the longest? The Hit rate without subject knowledge shows how far such rules would get you. Below are the questions with hints, each with the pencil for editing.
11Hit rate without subject knowledge
Cockpit - Hit rate without subject knowledge