Refined metrics for measuring ideation effectiveness

Brent A. Nelson, Jamal O. Wilson, David Rosen, Jeannette Yen

Research output: Contribution to journalArticle

122 Scopus citations

Abstract

Idea generation is an important step in the engineering design process, and as a result significant research efforts have focused on developing methods to aid designers in exploring design possibilities. Metrics to evaluate design exploration are thus necessary to make conclusions and comparisons among idea generation methods. Metrics have previously been proposed, identifying novelty, variety, quantity, and quality to characterize sets of designs and the degree to which they describe design space exploration. This article describes flaws in the variety metric and proposes a new metric to eliminate the flaws. Additionally, a single metric is proposed to evaluate the quality of design space exploration during concept generation, enabling application of a single metric to compare idea generation processes and methodologies.

Original languageEnglish (US)
Pages (from-to)737-743
Number of pages7
JournalDesign Studies
Volume30
Issue number6
DOIs
StatePublished - Nov 1 2009
Externally publishedYes

Keywords

  • conceptual design
  • design education
  • design techniques
  • evaluation
  • research methods

ASJC Scopus subject areas

  • Architecture
  • Arts and Humanities (miscellaneous)
  • Engineering(all)
  • Social Sciences(all)
  • Computer Science Applications
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Refined metrics for measuring ideation effectiveness'. Together they form a unique fingerprint.

  • Cite this