Item analysis measures the effectiveness of your test questions;
letting you see quickly which questions might need revision.
This tutorial shows you how to access and run item analysis,
view test-level and question-level statistics,
and edit a test question.
Item analysis is available for deployed tests only.
You can access item analysis in a few key locations.
From a test deployed in the content area,
the Tests page,
or a Grade Center column.
Select item analysis.
Now you can select the test to run an item analysis for.
Only deployed tests are listed.
Click run.
Access the report by clicking the link in the status bar
or the new link under Available Analysis.
The item analysis page contains summaries statistics for the test as a whole
as well as statistics for individual questions.
The test summary provides a snapshot of the test.
It shows how many attempts are still in progress or complete.
and average completion time.
You can see how many questions are good, fair, and poor discriminators of student
performance.
For example, a question is a good discriminator when students who answer
the question correctly
also score well on the entire test.
You can see how many questions in the test are Easy, Medium or Hard.
A question's difficulty value is the percentage of students that answered it
correctly.
Further down the page, each question and and its statistics are listed.
Questions you might need to investigate are indicated with red dots.
These questions have Easy or Hard difficulty values or Poor discrimination
values.
Symbols indicate if the question changed after the test was deployed, which might
affect your analysis.
An asterisk tells you that the statistics do not include ungraded
submissions.
Let's investigate a question that is recommended for review.
This question was recommended for review because it had a low or negative
discrimination value and was in the Hard difficulty category.
These values mean that students' scores on this question
tended to not correlate with their overall scores,
and a low percentage of students answer this question correctly.
At first glance it appears that the reason few students got the question
correct is because it was a hard question.
However, in looking at the distribution of answers, you can see that none of the
students in the top twenty five percent of the class chose the correct answer.
Let's investigate further.
Click Edit Test to access the Test Canvas and view the question.
In this case, the correct answer was missed keyed.
You can correct the problem now, and all current submissions are automatically
regraded.
The problem will be fixed in future test deployments as well.
Scroll back to the top and Submit and Update Attempts to save the change.
A warning appears to let you know this will affect submitted attempts.
The status of regrading is indicated at the top of the page.
Click OK
at the bottom of the Test Canvas
to return to the item analysis report.
To see if this change affects the question statistics, you must run the item
analysis again.
Let's review. First access the item analysis tool.
Run the item analysis for the selected test.
Next, view the statistics for the test as a whole and individual questions.
Investigate questions that are recommended for review.
Ff necessary, edit the question.