Reliability of a computerized scoring routine for an open-ended task

Joan Jamieson, John Campbell, Leslie Norfleet, Nora Berbisada

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

This article asserts the value of open-ended responses for CALL lessons and language tests. Results are presented from a study in which students' notes and recall protocols of computerized reading passages were scored by both people and a computer program. The reliability of human scores was calculated using coefficient alpha; the reliability of human and computer scores was computed using Pearson's product-moment correlation coefficient. Results indicated that the computer program scored reliably with the people, and in much less time.

Original languageEnglish (US)
Pages (from-to)305-322
Number of pages18
JournalSystem
Volume21
Issue number3
DOIs
StatePublished - 1993

Fingerprint

data processing program
language
Values
student
Scoring
time
Language Tests
Correlation Coefficient

ASJC Scopus subject areas

  • Language and Linguistics
  • Education
  • Linguistics and Language

Cite this

Reliability of a computerized scoring routine for an open-ended task. / Jamieson, Joan; Campbell, John; Norfleet, Leslie; Berbisada, Nora.

In: System, Vol. 21, No. 3, 1993, p. 305-322.

Research output: Contribution to journalArticle

Jamieson, Joan ; Campbell, John ; Norfleet, Leslie ; Berbisada, Nora. / Reliability of a computerized scoring routine for an open-ended task. In: System. 1993 ; Vol. 21, No. 3. pp. 305-322.
@article{cf93dc0e029e4d0e8e96e58fe90420d3,
title = "Reliability of a computerized scoring routine for an open-ended task",
abstract = "This article asserts the value of open-ended responses for CALL lessons and language tests. Results are presented from a study in which students' notes and recall protocols of computerized reading passages were scored by both people and a computer program. The reliability of human scores was calculated using coefficient alpha; the reliability of human and computer scores was computed using Pearson's product-moment correlation coefficient. Results indicated that the computer program scored reliably with the people, and in much less time.",
author = "Joan Jamieson and John Campbell and Leslie Norfleet and Nora Berbisada",
year = "1993",
doi = "10.1016/0346-251X(93)90022-9",
language = "English (US)",
volume = "21",
pages = "305--322",
journal = "System",
issn = "0346-251X",
publisher = "Elsevier Limited",
number = "3",

}

TY - JOUR

T1 - Reliability of a computerized scoring routine for an open-ended task

AU - Jamieson, Joan

AU - Campbell, John

AU - Norfleet, Leslie

AU - Berbisada, Nora

PY - 1993

Y1 - 1993

N2 - This article asserts the value of open-ended responses for CALL lessons and language tests. Results are presented from a study in which students' notes and recall protocols of computerized reading passages were scored by both people and a computer program. The reliability of human scores was calculated using coefficient alpha; the reliability of human and computer scores was computed using Pearson's product-moment correlation coefficient. Results indicated that the computer program scored reliably with the people, and in much less time.

AB - This article asserts the value of open-ended responses for CALL lessons and language tests. Results are presented from a study in which students' notes and recall protocols of computerized reading passages were scored by both people and a computer program. The reliability of human scores was calculated using coefficient alpha; the reliability of human and computer scores was computed using Pearson's product-moment correlation coefficient. Results indicated that the computer program scored reliably with the people, and in much less time.

UR - http://www.scopus.com/inward/record.url?scp=3042655709&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=3042655709&partnerID=8YFLogxK

U2 - 10.1016/0346-251X(93)90022-9

DO - 10.1016/0346-251X(93)90022-9

M3 - Article

AN - SCOPUS:3042655709

VL - 21

SP - 305

EP - 322

JO - System

JF - System

SN - 0346-251X

IS - 3

ER -