Design Tools Lab

Barnard College Computer Science
Columbia University

The Design Tools Lab (DTL) is a research group that develops design software, toolkits, and learning experiences for supporting the next generation of designers.

We investigate how novel technologies can enable new forms of creative expression. Our goal is to empower beginners to develop computational fluency through building and sharing design projects representing their ideas, identities, and values.

We are especially interested in creative computing design tools that cut across disciplinary boundaries, with prior work in the domains of machine learning, visual arts, electronics, and design documentation.

👉 Interested in joining? Find out more here!

Publications

TOCE 2024

paper video

Co-ML: Collaborative machine learning model building for developing dataset design practices

Tiffany Tseng, Matt J Davidson, Luis Morales-Navarro, Jennifer King Chen, Victoria Delaney, Mark Leibowitz, Jazbo Beason, R Benjamin Shapiro

We outline a set of four data design practices (DDPs) for designing inclusive ML models and share how we designed a tablet-based application called Co-ML to foster learning of DDPs through a collaborative ML model building experience. We deployed Co-ML in a 2-week-long educational AIML Summer Camp, where youth ages 13–18 worked in groups to build custom ML-powered mobile applications.

machine-learning

arXiv preprint 2024

paper video

Keyframer: Empowering Animation Design using Large Language Models

Tiffany Tseng, Ruijia Cheng, Jeffrey Nichols

We present Keyframer, a design tool for animating static images (SVGs) with natural language. Informed by interviews with professional animation designers and engineers, Keyframer supports exploration and refinement of animations through the combination of prompting and direct editing of generated output.

machine-learningvisual-arts

IDC 2023 honorable mention

paper video

Collaborative Machine Learning Model Building with Families Using Co-ML

Tiffany Tseng, Jennifer King Chen, Mona Abdelrahman, Mary Beth Kery, Fred Hohman, Adriana Hilliard, R Benjamin Shapiro

We created Co-ML – a tablet-based app for learners to collaboratively build ML image classifiers through an end-to-end, iterative model-building process. In this paper, we illustrate the feasibility and potential richness of collaborative modeling by presenting an in-depth case study of a family (two children 11 and 14-years-old working with their parents) using Co-ML in a facilitated introductory ML activity at home.

machine-learning

DIS 2021

paper video presentation

Circuit Assemblies: Electronic Modules for Interactive 3D-Prints

Tiffany Tseng, Yoshihiro Kawahara

This pictorial presents Circuit Assemblies, a design system for beginners to create 3D-printed interactive objects with embedded electronics. Circuit Assemblies are modules used to create objects that light up, move, or spin using basic electronic components like LEDs, batteries, and motors. To support beginners incorporating Circuit Assemblies into 3D designs, a set of virtual components were added to Tinkercad, a popular browser-based 3D CAD application with over 10 million users.

electronics

IDC 2021 best paper

paper video presentation

PlushPal: Storytelling with interactive plush toys and machine learning

Tiffany Tseng, Yumiko Murai, Natalie Freed, Deanna Gelosi, Tung D Ta, Yoshihiro Kawahara

This paper presents PlushPal, a web-based design tool for children to make plush toys interactive with machine learning (ML). With PlushPal, children attach micro:bit hardware to stuffed animals, design custom gestures for their toy, and build gesture-recognition ML models to trigger their own sounds. We describe how, in the context of storytelling, PlushPal introduces core concepts in ML including data sampling and model evaluation.

machine-learningelectronics

DIS 2016

paper video

Spin: Examining the role of engagement, integration, and modularity in supporting youth creating documentation

Tiffany Tseng, Mitchel Resnick

In this paper, we contribute an evaluation of Spin, a system for youth to capture and share animations of physical design projects. We describe how educators and students used Spin in 16 different K-12 makerspaces over 6 months, ranging from 2-hour-long workshops to extended 8-week engagements. We outline the role of engagement, integration, and modularity for making documentation practice relevant and meaningful.

design-documentation

Fablearn 2015

paper demo

Making Make-throughs: Supporting young makers sharing design process.

Tiffany Tseng

This paper introduces the concept of make-throughs, a documentation format in which Makers share their design process throughout the development of a design project. Makethroughs capture the rich, iterative nature of a design process in which a project is constantly revised and refined over time. In contrast to tutorials, make-through documentation is shared throughout the design process (rather than after a project is complete), and incorporates iteration (rather than a finalized list of instructions).

design-documentation

IDC 2014

paper

Product versus process: Representing and appropriating DIY projects online

Tiffany Tseng, Mitchel Resnick

Through interviews and surveys with authors and readers of Instructables, we describe differences found in the practices of these two types of users in creating and applying design documentation. Based on the results, we identify design opportunities for members of the HCI community developing tools to better support people sharing creative work online..

design-documentation