Reporting and Interpreting Quantitative Research Findings

What Gets Reported and Recommendations for the Field

Jenifer Larson-Hall, Luke D Plonsky

Research output: Contribution to journalArticle

44 Citations (Scopus)

Abstract

This paper presents a set of guidelines for reporting on five types of quantitative data issues: (1) Descriptive statistics, (2) Effect sizes and confidence intervals, (3) Instrument reliability, (4) Visual displays of data, and (5) Raw data. Our recommendations are derived mainly from various professional sources related to L2 research but motivated by results from investigations into how well the field as a whole is following these guidelines for best methodological practices, and illustrated by L2 examples. Although recent surveys of L2 reporting practices have found that more researchers are including important data such as effect sizes, confidence intervals, reliability coefficients, research questions, a priori alpha levels, graphics, and so forth in their research reports, we call for further improvement so that research findings may build upon each other and lend themselves to meta-analyses and a mindset that sees each research project in the context of a coherent whole.

Original languageEnglish (US)
Pages (from-to)127-159
Number of pages33
JournalLanguage Learning
Volume65
Issue numberS1
DOIs
StatePublished - Jun 1 2015

Fingerprint

quantitative research
confidence
descriptive statistics
research project
Effect Size
Confidence Interval
Descriptive
Research Projects
Statistics

Keywords

  • Confidence intervals
  • Effect sizes
  • L2
  • Language
  • Mean
  • Meta-analysis
  • Methodology
  • Quantitative
  • Raw data
  • Reporting practices
  • Standard deviation

ASJC Scopus subject areas

  • Linguistics and Language
  • Education
  • Language and Linguistics

Cite this

Reporting and Interpreting Quantitative Research Findings : What Gets Reported and Recommendations for the Field. / Larson-Hall, Jenifer; Plonsky, Luke D.

In: Language Learning, Vol. 65, No. S1, 01.06.2015, p. 127-159.

Research output: Contribution to journalArticle

@article{e78e4c72c63e47b38fa99a8601affb8d,
title = "Reporting and Interpreting Quantitative Research Findings: What Gets Reported and Recommendations for the Field",
abstract = "This paper presents a set of guidelines for reporting on five types of quantitative data issues: (1) Descriptive statistics, (2) Effect sizes and confidence intervals, (3) Instrument reliability, (4) Visual displays of data, and (5) Raw data. Our recommendations are derived mainly from various professional sources related to L2 research but motivated by results from investigations into how well the field as a whole is following these guidelines for best methodological practices, and illustrated by L2 examples. Although recent surveys of L2 reporting practices have found that more researchers are including important data such as effect sizes, confidence intervals, reliability coefficients, research questions, a priori alpha levels, graphics, and so forth in their research reports, we call for further improvement so that research findings may build upon each other and lend themselves to meta-analyses and a mindset that sees each research project in the context of a coherent whole.",
keywords = "Confidence intervals, Effect sizes, L2, Language, Mean, Meta-analysis, Methodology, Quantitative, Raw data, Reporting practices, Standard deviation",
author = "Jenifer Larson-Hall and Plonsky, {Luke D}",
year = "2015",
month = "6",
day = "1",
doi = "10.1111/lang.12115",
language = "English (US)",
volume = "65",
pages = "127--159",
journal = "Language Learning",
issn = "0023-8333",
publisher = "Wiley-Blackwell",
number = "S1",

}

TY - JOUR

T1 - Reporting and Interpreting Quantitative Research Findings

T2 - What Gets Reported and Recommendations for the Field

AU - Larson-Hall, Jenifer

AU - Plonsky, Luke D

PY - 2015/6/1

Y1 - 2015/6/1

N2 - This paper presents a set of guidelines for reporting on five types of quantitative data issues: (1) Descriptive statistics, (2) Effect sizes and confidence intervals, (3) Instrument reliability, (4) Visual displays of data, and (5) Raw data. Our recommendations are derived mainly from various professional sources related to L2 research but motivated by results from investigations into how well the field as a whole is following these guidelines for best methodological practices, and illustrated by L2 examples. Although recent surveys of L2 reporting practices have found that more researchers are including important data such as effect sizes, confidence intervals, reliability coefficients, research questions, a priori alpha levels, graphics, and so forth in their research reports, we call for further improvement so that research findings may build upon each other and lend themselves to meta-analyses and a mindset that sees each research project in the context of a coherent whole.

AB - This paper presents a set of guidelines for reporting on five types of quantitative data issues: (1) Descriptive statistics, (2) Effect sizes and confidence intervals, (3) Instrument reliability, (4) Visual displays of data, and (5) Raw data. Our recommendations are derived mainly from various professional sources related to L2 research but motivated by results from investigations into how well the field as a whole is following these guidelines for best methodological practices, and illustrated by L2 examples. Although recent surveys of L2 reporting practices have found that more researchers are including important data such as effect sizes, confidence intervals, reliability coefficients, research questions, a priori alpha levels, graphics, and so forth in their research reports, we call for further improvement so that research findings may build upon each other and lend themselves to meta-analyses and a mindset that sees each research project in the context of a coherent whole.

KW - Confidence intervals

KW - Effect sizes

KW - L2

KW - Language

KW - Mean

KW - Meta-analysis

KW - Methodology

KW - Quantitative

KW - Raw data

KW - Reporting practices

KW - Standard deviation

UR - http://www.scopus.com/inward/record.url?scp=84929883176&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84929883176&partnerID=8YFLogxK

U2 - 10.1111/lang.12115

DO - 10.1111/lang.12115

M3 - Article

VL - 65

SP - 127

EP - 159

JO - Language Learning

JF - Language Learning

SN - 0023-8333

IS - S1

ER -