Refined metrics for measuring ideation effectiveness

Brent A Nelson, Jamal O. Wilson, David Rosen, Jeannette Yen

Research output: Contribution to journalArticle

106 Citations (Scopus)

Abstract

Idea generation is an important step in the engineering design process, and as a result significant research efforts have focused on developing methods to aid designers in exploring design possibilities. Metrics to evaluate design exploration are thus necessary to make conclusions and comparisons among idea generation methods. Metrics have previously been proposed, identifying novelty, variety, quantity, and quality to characterize sets of designs and the degree to which they describe design space exploration. This article describes flaws in the variety metric and proposes a new metric to eliminate the flaws. Additionally, a single metric is proposed to evaluate the quality of design space exploration during concept generation, enabling application of a single metric to compare idea generation processes and methodologies.

Original languageEnglish (US)
Pages (from-to)737-743
Number of pages7
JournalDesign Studies
Volume30
Issue number6
DOIs
StatePublished - Nov 2009
Externally publishedYes

Fingerprint

research results
engineering
Defects
methodology
Novelty
Engineering Design
Methodology
Designer

Keywords

  • conceptual design
  • design education
  • design techniques
  • evaluation
  • research methods

ASJC Scopus subject areas

  • Engineering(all)
  • Architecture
  • Computer Science Applications
  • Artificial Intelligence
  • Social Sciences(all)

Cite this

Refined metrics for measuring ideation effectiveness. / Nelson, Brent A; Wilson, Jamal O.; Rosen, David; Yen, Jeannette.

In: Design Studies, Vol. 30, No. 6, 11.2009, p. 737-743.

Research output: Contribution to journalArticle

Nelson, Brent A ; Wilson, Jamal O. ; Rosen, David ; Yen, Jeannette. / Refined metrics for measuring ideation effectiveness. In: Design Studies. 2009 ; Vol. 30, No. 6. pp. 737-743.
@article{a5963c5b1d224d01904c98bcd7edb881,
title = "Refined metrics for measuring ideation effectiveness",
abstract = "Idea generation is an important step in the engineering design process, and as a result significant research efforts have focused on developing methods to aid designers in exploring design possibilities. Metrics to evaluate design exploration are thus necessary to make conclusions and comparisons among idea generation methods. Metrics have previously been proposed, identifying novelty, variety, quantity, and quality to characterize sets of designs and the degree to which they describe design space exploration. This article describes flaws in the variety metric and proposes a new metric to eliminate the flaws. Additionally, a single metric is proposed to evaluate the quality of design space exploration during concept generation, enabling application of a single metric to compare idea generation processes and methodologies.",
keywords = "conceptual design, design education, design techniques, evaluation, research methods",
author = "Nelson, {Brent A} and Wilson, {Jamal O.} and David Rosen and Jeannette Yen",
year = "2009",
month = "11",
doi = "10.1016/j.destud.2009.07.002",
language = "English (US)",
volume = "30",
pages = "737--743",
journal = "Design Studies",
issn = "0142-694X",
publisher = "Elsevier Limited",
number = "6",

}

TY - JOUR

T1 - Refined metrics for measuring ideation effectiveness

AU - Nelson, Brent A

AU - Wilson, Jamal O.

AU - Rosen, David

AU - Yen, Jeannette

PY - 2009/11

Y1 - 2009/11

N2 - Idea generation is an important step in the engineering design process, and as a result significant research efforts have focused on developing methods to aid designers in exploring design possibilities. Metrics to evaluate design exploration are thus necessary to make conclusions and comparisons among idea generation methods. Metrics have previously been proposed, identifying novelty, variety, quantity, and quality to characterize sets of designs and the degree to which they describe design space exploration. This article describes flaws in the variety metric and proposes a new metric to eliminate the flaws. Additionally, a single metric is proposed to evaluate the quality of design space exploration during concept generation, enabling application of a single metric to compare idea generation processes and methodologies.

AB - Idea generation is an important step in the engineering design process, and as a result significant research efforts have focused on developing methods to aid designers in exploring design possibilities. Metrics to evaluate design exploration are thus necessary to make conclusions and comparisons among idea generation methods. Metrics have previously been proposed, identifying novelty, variety, quantity, and quality to characterize sets of designs and the degree to which they describe design space exploration. This article describes flaws in the variety metric and proposes a new metric to eliminate the flaws. Additionally, a single metric is proposed to evaluate the quality of design space exploration during concept generation, enabling application of a single metric to compare idea generation processes and methodologies.

KW - conceptual design

KW - design education

KW - design techniques

KW - evaluation

KW - research methods

UR - http://www.scopus.com/inward/record.url?scp=70349999946&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70349999946&partnerID=8YFLogxK

U2 - 10.1016/j.destud.2009.07.002

DO - 10.1016/j.destud.2009.07.002

M3 - Article

VL - 30

SP - 737

EP - 743

JO - Design Studies

JF - Design Studies

SN - 0142-694X

IS - 6

ER -