Evaluating CALL use across multiple contexts

Joan Jamieson, Carol A. Chapelle

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

For an audience of teachers, materials developers, students, and other applied linguists, three key issues in materials evaluation are establishing a means of drawing on professional knowledge about language learning in the evaluation process; recognizing the tension between the utility of robust evaluation results and the inherent context-specific nature of evaluation; and articulating the need for a procedure that produces stable, defensible results. This study explored one approach to addressing these issues when evaluating computer-assisted language learning (CALL) materials. A survey was developed and used in a multiple case study in twelve different English language classes in four countries. Results on six different criteria indicated generally good internal consistency. Findings from classes both inside and outside the USA suggest that the survey approach combined with multiple case studies had the sensitivity to reveal some differences both within and across classroom contexts. This study illustrates an additional method that can easily complement the more traditional process- and outcomes-based approaches for CALL evaluators.

Original languageEnglish (US)
Pages (from-to)357-369
Number of pages13
JournalSystem
Volume38
Issue number3
DOIs
StatePublished - Sep 2010

Fingerprint

language
evaluation
learning
English language
classroom
Computer-assisted Language Learning
Evaluation
teacher
knowledge
student
Language Acquisition
Language Classes

Keywords

  • Applied linguistics
  • Case studies
  • Computer-assisted language learning
  • Evaluation
  • Second language learning
  • Surveys

ASJC Scopus subject areas

  • Language and Linguistics
  • Education
  • Linguistics and Language

Cite this

Evaluating CALL use across multiple contexts. / Jamieson, Joan; Chapelle, Carol A.

In: System, Vol. 38, No. 3, 09.2010, p. 357-369.

Research output: Contribution to journalArticle

Jamieson, Joan ; Chapelle, Carol A. / Evaluating CALL use across multiple contexts. In: System. 2010 ; Vol. 38, No. 3. pp. 357-369.
@article{b68eb944d066481b8d171566c950c25f,
title = "Evaluating CALL use across multiple contexts",
abstract = "For an audience of teachers, materials developers, students, and other applied linguists, three key issues in materials evaluation are establishing a means of drawing on professional knowledge about language learning in the evaluation process; recognizing the tension between the utility of robust evaluation results and the inherent context-specific nature of evaluation; and articulating the need for a procedure that produces stable, defensible results. This study explored one approach to addressing these issues when evaluating computer-assisted language learning (CALL) materials. A survey was developed and used in a multiple case study in twelve different English language classes in four countries. Results on six different criteria indicated generally good internal consistency. Findings from classes both inside and outside the USA suggest that the survey approach combined with multiple case studies had the sensitivity to reveal some differences both within and across classroom contexts. This study illustrates an additional method that can easily complement the more traditional process- and outcomes-based approaches for CALL evaluators.",
keywords = "Applied linguistics, Case studies, Computer-assisted language learning, Evaluation, Second language learning, Surveys",
author = "Joan Jamieson and Chapelle, {Carol A.}",
year = "2010",
month = "9",
doi = "10.1016/j.system.2010.06.014",
language = "English (US)",
volume = "38",
pages = "357--369",
journal = "System",
issn = "0346-251X",
publisher = "Elsevier Limited",
number = "3",

}

TY - JOUR

T1 - Evaluating CALL use across multiple contexts

AU - Jamieson, Joan

AU - Chapelle, Carol A.

PY - 2010/9

Y1 - 2010/9

N2 - For an audience of teachers, materials developers, students, and other applied linguists, three key issues in materials evaluation are establishing a means of drawing on professional knowledge about language learning in the evaluation process; recognizing the tension between the utility of robust evaluation results and the inherent context-specific nature of evaluation; and articulating the need for a procedure that produces stable, defensible results. This study explored one approach to addressing these issues when evaluating computer-assisted language learning (CALL) materials. A survey was developed and used in a multiple case study in twelve different English language classes in four countries. Results on six different criteria indicated generally good internal consistency. Findings from classes both inside and outside the USA suggest that the survey approach combined with multiple case studies had the sensitivity to reveal some differences both within and across classroom contexts. This study illustrates an additional method that can easily complement the more traditional process- and outcomes-based approaches for CALL evaluators.

AB - For an audience of teachers, materials developers, students, and other applied linguists, three key issues in materials evaluation are establishing a means of drawing on professional knowledge about language learning in the evaluation process; recognizing the tension between the utility of robust evaluation results and the inherent context-specific nature of evaluation; and articulating the need for a procedure that produces stable, defensible results. This study explored one approach to addressing these issues when evaluating computer-assisted language learning (CALL) materials. A survey was developed and used in a multiple case study in twelve different English language classes in four countries. Results on six different criteria indicated generally good internal consistency. Findings from classes both inside and outside the USA suggest that the survey approach combined with multiple case studies had the sensitivity to reveal some differences both within and across classroom contexts. This study illustrates an additional method that can easily complement the more traditional process- and outcomes-based approaches for CALL evaluators.

KW - Applied linguistics

KW - Case studies

KW - Computer-assisted language learning

KW - Evaluation

KW - Second language learning

KW - Surveys

UR - http://www.scopus.com/inward/record.url?scp=77956177263&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77956177263&partnerID=8YFLogxK

U2 - 10.1016/j.system.2010.06.014

DO - 10.1016/j.system.2010.06.014

M3 - Article

VL - 38

SP - 357

EP - 369

JO - System

JF - System

SN - 0346-251X

IS - 3

ER -