Yu-Hui Ching's List: InnovativeTestingBenchmarking

• A new graphical summary has been added to one of the standard item analysis reports: a scatterplot of item difficulty and discrimination indices is now produced for each cognitive subtest.
• A new paper, "Visual Item Analysis", suggesting an ocular  approach to item analysis, and exemplifying some of the graphics made by  Lertap 5, is available as a PDF file at: http://www.lertap.curtin.edu.au/Documentation/UsingLertapQuintilePlots.pdf
• Test scores may now be tabulated by groups, making it possible, for example, to quickly compare results by regions, gender, course study code,  and so on. Each scores breakout is accompainied by a plot of group means. 
    Get the scoop at: www.lertap.curtin.edu.au/HTMLHelp/HTML/breakouts.htm 
• The Laboratory of Educational Research Test Analysis Package, "LERTAP", is a classical item and test analysis system. Lertap also analyzes surveys and mastery tests.
• Lertap uses both correlational and upper-lower groups methods to index  item functioning. It produces three reports for each cognitive subtest - two  based on correlation coefficients (point-biserial and biserial, corrected for  part-whole inflation), and one on upper-lower  proportions.

3 more annotations...

• Item Analysis: Provide psychometricians the tools they need to analyze question results in depth. This report displays histograms and statistics showing distribution of discrimination, correlation, p-value, difficulty, outcome frequency, participant mean, times occurred (frequency), proportion selected, upper group selection, lower group selections, outcome discrimination, outcome correlation, mean of P value, proportion correct, mean of item discrimination, and mean of item total correlation. 
   
  • Benefits: 
     
    • Conduct in-depth analysis of question results
     
    • Obtain data critical to creating valid, reliable high-stakes exams
     
    • Histograms and statistics to quickly drill down to information you need
• Overview of Test Analysis Report (Slides - PDF)

• 
• • This is a sample report on distribution. But no sample report on item analysis.
  Add Sticky Note

• Data/Analysis Features
• Test Reports Include
• • Detailed Item Analysis Report
   
  • Item Analysis Graph Report
   
  • Condensed Item Analysis
   
  • Test Item Statistics Report

1 more annotation...