Concept map assessment of classroom learning: Reliability, validity, and logistical practicality

John R McClure, Brian Sonak, Hoi K. Suen

Research output: Contribution to journalArticle

270 Citations (Scopus)

Abstract

The psychometric characteristics and practicality of concept mapping as a technique for classroom assessment were evaluated. Subjects received 90 min of training in concept mapping techniques and were given a list of terms and asked to produce a concept map. The list of terms was from a course in which they were enrolled. The maps were scored by pairs of graduate students, each pair using one of six different scoring methods. The score reliability of the six scoring methods ranged from r = .23 to r = .76. The highest score reliability was found for the method based on the evaluation of separate propositions represented. Correlations of map scores with a measure of the concept maps' similarity to a master map provided evidence supporting the validity of five of the six scoring methods. The times required to provide training in concept mapping, produce concepts, and score concept maps were compatible with the adoption of concept mapping as classroom assessment technique.

Original languageEnglish (US)
Pages (from-to)475-492
Number of pages18
JournalJournal of Research in Science Teaching
Volume36
Issue number4
StatePublished - Apr 1999

Fingerprint

classroom
learning
psychometrics
Students
graduate
evaluation
evidence
student

ASJC Scopus subject areas

  • Engineering(all)
  • Education

Cite this

Concept map assessment of classroom learning : Reliability, validity, and logistical practicality. / McClure, John R; Sonak, Brian; Suen, Hoi K.

In: Journal of Research in Science Teaching, Vol. 36, No. 4, 04.1999, p. 475-492.

Research output: Contribution to journalArticle

@article{a9be4c9f43e84fadb7ea79161ce1e697,
title = "Concept map assessment of classroom learning: Reliability, validity, and logistical practicality",
abstract = "The psychometric characteristics and practicality of concept mapping as a technique for classroom assessment were evaluated. Subjects received 90 min of training in concept mapping techniques and were given a list of terms and asked to produce a concept map. The list of terms was from a course in which they were enrolled. The maps were scored by pairs of graduate students, each pair using one of six different scoring methods. The score reliability of the six scoring methods ranged from r = .23 to r = .76. The highest score reliability was found for the method based on the evaluation of separate propositions represented. Correlations of map scores with a measure of the concept maps' similarity to a master map provided evidence supporting the validity of five of the six scoring methods. The times required to provide training in concept mapping, produce concepts, and score concept maps were compatible with the adoption of concept mapping as classroom assessment technique.",
author = "McClure, {John R} and Brian Sonak and Suen, {Hoi K.}",
year = "1999",
month = "4",
language = "English (US)",
volume = "36",
pages = "475--492",
journal = "Journal of Research in Science Teaching",
issn = "0022-4308",
publisher = "John Wiley and Sons Inc.",
number = "4",

}

TY - JOUR

T1 - Concept map assessment of classroom learning

T2 - Reliability, validity, and logistical practicality

AU - McClure, John R

AU - Sonak, Brian

AU - Suen, Hoi K.

PY - 1999/4

Y1 - 1999/4

N2 - The psychometric characteristics and practicality of concept mapping as a technique for classroom assessment were evaluated. Subjects received 90 min of training in concept mapping techniques and were given a list of terms and asked to produce a concept map. The list of terms was from a course in which they were enrolled. The maps were scored by pairs of graduate students, each pair using one of six different scoring methods. The score reliability of the six scoring methods ranged from r = .23 to r = .76. The highest score reliability was found for the method based on the evaluation of separate propositions represented. Correlations of map scores with a measure of the concept maps' similarity to a master map provided evidence supporting the validity of five of the six scoring methods. The times required to provide training in concept mapping, produce concepts, and score concept maps were compatible with the adoption of concept mapping as classroom assessment technique.

AB - The psychometric characteristics and practicality of concept mapping as a technique for classroom assessment were evaluated. Subjects received 90 min of training in concept mapping techniques and were given a list of terms and asked to produce a concept map. The list of terms was from a course in which they were enrolled. The maps were scored by pairs of graduate students, each pair using one of six different scoring methods. The score reliability of the six scoring methods ranged from r = .23 to r = .76. The highest score reliability was found for the method based on the evaluation of separate propositions represented. Correlations of map scores with a measure of the concept maps' similarity to a master map provided evidence supporting the validity of five of the six scoring methods. The times required to provide training in concept mapping, produce concepts, and score concept maps were compatible with the adoption of concept mapping as classroom assessment technique.

UR - http://www.scopus.com/inward/record.url?scp=0001461046&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0001461046&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:0001461046

VL - 36

SP - 475

EP - 492

JO - Journal of Research in Science Teaching

JF - Journal of Research in Science Teaching

SN - 0022-4308

IS - 4

ER -