Malmö University Publications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
The use of scoring rubrics: Reliability, validity, and educational consequences
Malmö högskola, School of Teacher Education (LUT), Nature-Environment-Society (NMS).ORCID iD: 0000-0002-3251-6082
Malmö högskola, School of Teacher Education (LUT), Nature-Environment-Society (NMS).
2007 (English)In: Educational Research Review, ISSN 1747-938X, E-ISSN 1878-0385, Vol. 2, p. 130-144Article in journal (Refereed) Published
Abstract [en]

Several benefits of using scoring rubrics in performance assessments have been proposed, such as increased consistency of scoring, the possibility to facilitate valid judgment of complex competencies, and promotion of learning. This paper investigates whether evidence for these claims can be found in the research literature. Several databases were searched for empirical research on rubrics, resulting in a total of 75 studies relevant for this review. Conclusions are that: (1) the reliable scoring of performance assessments can be enhanced by the use of rubrics, especially if they are analytic, topic-specific, and complemented with exemplars and/or rater training; (2) rubrics do not facilitate valid judgment of performance assessments per se. However, valid assessment could be facilitated by using a more comprehensive framework of validity when validating the rubric; (3) rubrics seem to have the potential of promoting learning and/or improve instruction. The main reason for this potential lies in the fact that rubrics make expectations and criteria explicit, which also facilitates feedback and self-assessment.

Place, publisher, year, edition, pages
Elsevier Ltd. , 2007. Vol. 2, p. 130-144
Keywords [en]
Alternative assessment, Performance assessment, Scoring rubrics, Validity
National Category
Pedagogy
Identifiers
URN: urn:nbn:se:mau:diva-3834DOI: 10.1016/j.edurev.2007.05.002Scopus ID: 2-s2.0-36049027816Local ID: 6007OAI: oai:DiVA.org:mau-3834DiVA, id: diva2:1400643
Available from: 2020-02-28 Created: 2020-02-28 Last updated: 2026-02-04Bibliographically approved
In thesis
1. Educative assessment for/of teacher competency. A study of assessment and learning in the "Interactive examination" for student teachers
Open this publication in new window or tab >>Educative assessment for/of teacher competency. A study of assessment and learning in the "Interactive examination" for student teachers
2008 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [sv]

Syftet med den här avhandlingen är att studera några av de problem som är förknippade med implementering av så kallad autentisk bedömning i lärarutbildningen. I den första delen av avhandlingen undersöks, genom en litteraturöversikt, huruvida användningen av bedömningsmatriser kan fungera som ett stöd för ökad tillförlitlighet och trovärdighet vid bedömning av komplexa kompetenser, samtidigt som matriserna även stöttar studenternas lärande. I avhandlingens andra del, utnyttjas slutsatserna från den första delen genom att föra in dem i konstruktionen av den så kallade ”Interaktiva examinationen” för lärarstudenter, vilket är en autentisk bedömning för lärarkompetens. I denna examination får lärarstudenter se korta filmsekvenser, vilka visar olika kritiska situationer i skolan, varvid studenterna får beskriva, analysera samt föreslå sätt att hantera dessa situationer, men också reflektera över sina svar. Det som studeras i avhandlingen är huruvida de kompetenser som ingår i examinationen bedöms på ett tillförlitligt och trovärdigt sätt, samt huruvida examinationen stöttar studenternas lärande. Utifrån dessa studier, vilka omfattar tre på varandra efterföljande årskullar med lärarstudenter (n = 462) har framför allt tre viktiga forskningsbidrag gjorts. För det första, genom att analysera empirisk forskning om bedömningsmatriser, har ett antal utgångspunkter sammanställts för hur man kan konstruera autentiska bedömningar som stöttar studenternas lärande, samtidigt som stöd ges för tillförlitlig och trovärdig bedömning av studenternas kompetens. För det andra, genom att uttrycka lärarkompetens i form av kriterier och nivåbeskrivningar, blir det möjligt att bedöma studenternas förmåga att analysera klassrumssituationer, såväl som deras förmåga till självbedömning. Genom att på detta sätt göra bedömningens förutsättningar mer tydliga och transparenta, förbättras dessutom kvaliteten på studenternas prestationer avsevärt. För det tredje, ges det genom den ”Interaktiva examinationen” ett exempel på hur lärarkompetens kan bedömas på ett tillförlitligt, trovärdigt och lärande sätt, och därmed hur formativa och summativa bedömningssyften kan samexistera inom ramen för samma (lärande) bedömning.

Abstract [en]

The aim of this dissertation is to explore some of the problems associated with introducing authentic assessment in teacher education. In the first part of the dissertation the question is investigated, through a literature review, whether the use of scoring rubrics can aid in supporting credible assessment of complex performance, and at the same time support student learning of such complex performance. In the second part, the conclusions arrived at from the first part are implemented into the design of the so-called "Interactive examination" for student teachers, which is designed to be an authentic assessment for teacher competency. In this examination, the students are shown short video sequences displaying critical classroom situations, and are then asked to describe, analyze, and suggest ways to handle the situations, as well as reflect on their own answers. It is investigated whether the competencies aimed for in the "Interactive examination" can be assessed in a credible manner, and whether the examination methodology supports student learning. From these investigations, involving three consecutive cohorts of student teachers (n = 462), it is argued that three main contributions to research have been made. First, by reviewing empirical research on performance assessment and scoring rubrics, a set of assumptions has been reached on how to design authentic assessments that both support student learning, and provide reliable and valid data on student performance. Second, by articulating teacher competency in the form of criteria and standards, it is possible to assess students’ skills in analyzing classroom situations, as well as their self-assessment skills. Furthermore, it is demonstrated that by making the assessment demands transparent, students’ performances are greatly improved. Third, it is shown how teacher competency can be assessed in a valid way, without compromising the reliability. Thus the dissertation gives an illustration of how formative and summative purposes might co-exist within the boundaries of the same (educative) assessment.

Place, publisher, year, edition, pages
Malmö University, 2008. p. 254
Series
Malmö Studies in Educational Sciences: Doctoral Dissertation Series, ISSN 1651-4513 ; 41Studies in Science and Technology Education, ISSN 1652-5051 ; 18
Keywords
authentic assessment, formative assessment, learning, reliability, performance assessment, scoring rubrics, teacher education, validity, formativ bedömning, bedömningsmatriser, bedömning
National Category
Pedagogy
Identifiers
urn:nbn:se:mau:diva-7567 (URN)6182 (Local ID)978-91-977100-3-9 (ISBN)6182 (Archive number)6182 (OAI)
Note

Note: The papers are not included in the fulltext online.

Paper III and IV in dissertation as manuscript.

Available from: 2020-02-28 Created: 2020-02-28 Last updated: 2026-02-04Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Jönsson, AndersSvingby, Gunilla

Search in DiVA

By author/editor
Jönsson, AndersSvingby, Gunilla
By organisation
Nature-Environment-Society (NMS)
In the same journal
Educational Research Review
Pedagogy

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 394 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf