- Research & Collections
- Using the Library
The quiz measures the outcomes of the video and:
The quiz was developed by a sub-group of the Information Literacy Committee. Each of the questions was refined through testing on sample groups, then results of which were run through statistical software to ensure a consistent level of difficulty. The final questions as presented took five months of development time and were given to multiple groups for testing and evaluation.
To evaluate the cohesiveness of the sets of questions, the committee reviewed the internal-consistency of the items and the inter-item correlations. For internal-consistency, the committee used Kuder-Richardson 20 (K-R20) or Cronbach’s Alpha (α), which yield the same result with dichotomous data (i.e., correct or incorrect). Values can range from 0.00 to 1.00, with higher numbers indicating a homogeneous test. Homogeneity, or consistency means that there are similar patterns for responding (i.e., the same person tends to get them all right or all wrong). The target for a set of questions was a Cronbach's Alpha of 0.70 or higher with each item being positively correlated with all or most of the other items in the set.
To evaluate the individual questions within each set, the committee reviewed the percent of correct responses for each item and the distribution of responses between the distracters. The committee chose questions that fewer than 80% of the naïve pilot students were answering correctly and modified distracters that less than 5% of the students choose.