Quantitative research methods and study quality in learner corpus research

Magali Paquot, Luke Plonsky

Research output: Contribution to journalReview articlepeer-review

Abstract

This study aims to provide the first empirical assessment of quantitative research methods and study quality in learner corpus research. We systematically review quantitative primary studies referenced in the Learner Corpus Bibliography (LCB), a representative bibliography of learner corpus research maintained by the Learner Corpus Association which contained 1,276 references when the current study began. Each primary study in the LCB was coded for over fifty features representing six dimensions: (a) publication type (i.e. conference paper, book chapter, journal article), (b) research focus (e.g. lexis, grammar), (c) methodological features (e.g. keyword analysis, error analysis, use of reference corpus), (d) statistical analyses (e.g. X2 t-test, regression analysis), and (e) reporting practices (e.g. reliability coefficients, means). Results point to several systematic strengths as well as many flaws, such as the absence of research questions, incomplete and inconsistent reporting practices (e.g. means without standard deviations), and lack of statistical literacy (i.e. LCR studies generally overrely on tests of statistical significance, do not report effect sizes, rarely check or report whether statistical assumptions have been met, and rarely use multivariate analyses). Improvements over time, however, are clearly noted and there are signs that, like other related disciplines, learner corpus research is slowly undergoing methodological reform.

Original languageEnglish (US)
Pages (from-to)61-94
Number of pages34
JournalInternational Journal of Learner Corpus Research
Volume3
Issue number1
DOIs
StatePublished - 2017
Externally publishedYes

Keywords

  • Quantitative research methods
  • Reporting practices
  • Research synthesis
  • Study quality

ASJC Scopus subject areas

  • Language and Linguistics
  • Linguistics and Language
  • Education

Fingerprint

Dive into the research topics of 'Quantitative research methods and study quality in learner corpus research'. Together they form a unique fingerprint.

Cite this