Computational Support for Sketching in Design: A Review

Gabe Johnson
Carnegie Mellon University, USA, johnsogg@cmu.edu

Mark D. Gross
Carnegie Mellon University, USA, mdgross@cmu.edu

Jason Hong
Carnegie Mellon University, USA, jasonh@cs.cmu.edu

Ellen Yi-Luen Do
Georgia Institute of Technology, USA, ellendo@gatech.edu

SUGGESTED CITATION:
Gabe Johnson and Mark D. Gross and Jason Hong and Ellen Yi-Luen Do (2009) "Computational Support for Sketching in Design: A Review",
Foundations and Trends® in Human–Computer Interaction: Vol. 2: No 1, pp 1-93.
http:/dx.doi.org/10.1561/1100000013

Abstract

Computational support for sketching is an exciting research area at the intersection of design research, human-computer interaction, and artificial intelligence. Despite the prevalence of software tools, most designers begin their work with physical sketches. Modern computational tools largely treat design as a linear process beginning with a specific problem and ending with a specific solution. Sketch-based design tools offer another approach that may fit design practice better. This review surveys literature related to such tools. First, we describe the practical basis of sketching -- why people sketch, what significance it has in design and problem solving, and the cognitive activities it supports. Second, we survey computational support for sketching, including methods for performing sketch recognition and managing ambiguity, techniques for modeling recognizable elements, and human-computer interaction techniques for working with sketches. Last, we propose challenges and opportunities for future advances in this field.