Meta-analysis in second language research

Choices and challenges

Frederick L. Oswald, Luke D Plonsky

Research output: Contribution to journalArticle

78 Citations (Scopus)

Abstract

Applied linguists are increasingly conducting meta-analysis in their substantive domains, because as a quantitative approach for averaging effect sizes across studies, it is more systematic and replicable than traditional, qualitative literature reviews. Additional strengths, such as increased statistical power, moderator analyses, and model testing, have also contributed to its appeal. The current review describes typical stages of a meta-analysis in second language acquisition (SLA) research: (a) defining the research domain, (b) developing a reliable coding scheme, (c) analyzing data, and (d) interpreting results. Each stage has a host of equally reasonable decisions that can be made; each decision will influence the conduct of the meta-analysis, the nature of the results, and the substantive implications of findings for SLA. We highlight a number of benefits and challenges that inform these decisions. In general, when a meta-analysis in applied linguistics is well planned, employs sound statistical methods, and is based on a thorough understanding of relevant theory, it can provide critical information that informs theory as well as future research, practice, and policy.

Original languageEnglish (US)
Pages (from-to)85-110
Number of pages26
JournalAnnual Review of Applied Linguistics
Volume30
DOIs
StatePublished - Mar 2010
Externally publishedYes

Fingerprint

language
language acquisition
moderator
statistical method
coding
appeal
linguistics
Second-language Research
Meta-analysis
Second Language Acquisition
literature
Sound
Coding Scheme
Effect Size
Testing
Literature Review
Research Practice
Conducting
Statistical Methods
Applied Linguistics

ASJC Scopus subject areas

  • Linguistics and Language
  • Language and Linguistics

Cite this

Meta-analysis in second language research : Choices and challenges. / Oswald, Frederick L.; Plonsky, Luke D.

In: Annual Review of Applied Linguistics, Vol. 30, 03.2010, p. 85-110.

Research output: Contribution to journalArticle

@article{aeb3aa7a16b14f099e3e518800f1c10e,
title = "Meta-analysis in second language research: Choices and challenges",
abstract = "Applied linguists are increasingly conducting meta-analysis in their substantive domains, because as a quantitative approach for averaging effect sizes across studies, it is more systematic and replicable than traditional, qualitative literature reviews. Additional strengths, such as increased statistical power, moderator analyses, and model testing, have also contributed to its appeal. The current review describes typical stages of a meta-analysis in second language acquisition (SLA) research: (a) defining the research domain, (b) developing a reliable coding scheme, (c) analyzing data, and (d) interpreting results. Each stage has a host of equally reasonable decisions that can be made; each decision will influence the conduct of the meta-analysis, the nature of the results, and the substantive implications of findings for SLA. We highlight a number of benefits and challenges that inform these decisions. In general, when a meta-analysis in applied linguistics is well planned, employs sound statistical methods, and is based on a thorough understanding of relevant theory, it can provide critical information that informs theory as well as future research, practice, and policy.",
author = "Oswald, {Frederick L.} and Plonsky, {Luke D}",
year = "2010",
month = "3",
doi = "10.1017/S0267190510000115",
language = "English (US)",
volume = "30",
pages = "85--110",
journal = "Annual Review of Applied Linguistics",
issn = "0267-1905",
publisher = "Cambridge University Press",

}

TY - JOUR

T1 - Meta-analysis in second language research

T2 - Choices and challenges

AU - Oswald, Frederick L.

AU - Plonsky, Luke D

PY - 2010/3

Y1 - 2010/3

N2 - Applied linguists are increasingly conducting meta-analysis in their substantive domains, because as a quantitative approach for averaging effect sizes across studies, it is more systematic and replicable than traditional, qualitative literature reviews. Additional strengths, such as increased statistical power, moderator analyses, and model testing, have also contributed to its appeal. The current review describes typical stages of a meta-analysis in second language acquisition (SLA) research: (a) defining the research domain, (b) developing a reliable coding scheme, (c) analyzing data, and (d) interpreting results. Each stage has a host of equally reasonable decisions that can be made; each decision will influence the conduct of the meta-analysis, the nature of the results, and the substantive implications of findings for SLA. We highlight a number of benefits and challenges that inform these decisions. In general, when a meta-analysis in applied linguistics is well planned, employs sound statistical methods, and is based on a thorough understanding of relevant theory, it can provide critical information that informs theory as well as future research, practice, and policy.

AB - Applied linguists are increasingly conducting meta-analysis in their substantive domains, because as a quantitative approach for averaging effect sizes across studies, it is more systematic and replicable than traditional, qualitative literature reviews. Additional strengths, such as increased statistical power, moderator analyses, and model testing, have also contributed to its appeal. The current review describes typical stages of a meta-analysis in second language acquisition (SLA) research: (a) defining the research domain, (b) developing a reliable coding scheme, (c) analyzing data, and (d) interpreting results. Each stage has a host of equally reasonable decisions that can be made; each decision will influence the conduct of the meta-analysis, the nature of the results, and the substantive implications of findings for SLA. We highlight a number of benefits and challenges that inform these decisions. In general, when a meta-analysis in applied linguistics is well planned, employs sound statistical methods, and is based on a thorough understanding of relevant theory, it can provide critical information that informs theory as well as future research, practice, and policy.

UR - http://www.scopus.com/inward/record.url?scp=78649923309&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78649923309&partnerID=8YFLogxK

U2 - 10.1017/S0267190510000115

DO - 10.1017/S0267190510000115

M3 - Article

VL - 30

SP - 85

EP - 110

JO - Annual Review of Applied Linguistics

JF - Annual Review of Applied Linguistics

SN - 0267-1905

ER -