Title: Semi Automated Scoring Support in Technology based Assessment
Categories: Technology Based Assessment, Item Development, Algorithm Design, Reliability Analysis.
Supervisors: Prof. Dr. Karsten Wolf, Prof. Dr. Andreas Breiter
Develop and evaluate an algorithmic approach to partially evaluate results in a spreadsheet. The results are intended to support a human coder. A great challenge was to respect the extensive model with evaluation rules (determined by third parties).
The inter-coder reliability between a human group and the machine rating has been analyzed and evaluated. Finally, a qualitative analysis of the inter-coder reliabilities has been applied. Conclusions for the algorithm as well for the overall proceeding have been drawn for future efforts in this field.