sh.sePublikasjoner
Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • harvard-anglia-ruskin-university
  • apa-old-doi-prefix.csl
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Bedömarvariation: Balansen mellan teknisk och hermeneutisk rationalitet vid bedömning av skrivprov
Örebro universitet.
Örebro universitet.ORCID-id: 0000-0002-3176-7226
2014 (svensk)Inngår i: Språk & Stil, ISSN 1101-1165, nr 24, s. 133-165Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

It is well known from studies of inter-rater reliability that assessments of writing tests vary. In order to discuss this rater variation, we depart from two research questions: 1. How can rater variation be conceived of from a professional, i.e. teacher, perspective? 2. What characterises Swedish (mother-tongue) teachers’ assessments of writing tests? The first question is addressed in a meta-study of previous research, and the second question is answered in a study of 14 Swedish teachers’ rating of texts from a national written composition test in upper secondary school. The results show that teachers in the same subject assess better, i.e. have less rater variation, than other groups. It is also clear that writing tests are notoriously difficult to rate. It is very rare that the correlation coefficients reach the desirable 0.7, a number that means that 50 % of the variance could be explained by shared norms. Another main result concerns criteria and tools for assessment. Such tools should be grounded in teachers’ professional expertise, in their expectations for different levels of performance. Our study reveals several situations where teachers’ professional expertise clashes with assessment criteria. The article concludes that valid assessments of tests that are high-stakes must handle both a technical rationality, i.e. the grading should be predictable from rater to rater, and a hermeneutic rationality, i.e. the grading must be based on teachers’ professional judgment.

sted, utgiver, år, opplag, sider
Uppsala: Adolf Noreen-Sällskapet för Svensk Språk- och Stilforskning , 2014. nr 24, s. 133-165
Emneord [en]
inter-rater reliability, interpretative community, writing assessment, Swedish national writing tests, assessment criteria, true score
HSV kategori
Identifikatorer
URN: urn:nbn:se:sh:diva-28584Scopus ID: 2-s2.0-84922876854OAI: oai:DiVA.org:sh-28584DiVA, id: diva2:861733
Tilgjengelig fra: 2015-10-19 Laget: 2015-10-16 Sist oppdatert: 2018-01-11bibliografisk kontrollert

Open Access i DiVA

Fulltekst mangler i DiVA

Andre lenker

Scopushttp://urn.kb.se/resolve?urn=urn:nbn:se:oru:diva-42199

Personposter BETA

Ledin, Per

Søk i DiVA

Av forfatter/redaktør
Ledin, Per
I samme tidsskrift
Språk & Stil

Søk utenfor DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric

urn-nbn
Totalt: 235 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • harvard-anglia-ruskin-university
  • apa-old-doi-prefix.csl
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf