Publications

TOCE 2024
papervideo
Co-ML: Collaborative machine learning model building for developing dataset design practices
Tiffany Tseng, Matt J Davidson, Luis Morales-Navarro, Jennifer King Chen, Victoria Delaney, Mark Leibowitz, Jazbo Beason, R Benjamin Shapiro
We outline a set of four data design practices (DDPs) for designing inclusive ML models and share how we designed a tablet-based application called Co-ML to foster learning of DDPs through a collaborative ML model building experience. We deployed Co-ML in a 2-week-long educational AIML Summer Camp, where youth ages 13–18 worked in groups to build custom ML-powered mobile applications.
machine-learning
arXiv preprint 2024
papervideo
Keyframer: Empowering Animation Design using Large Language Models
Tiffany Tseng, Ruijia Cheng, Jeffrey Nichols
We present Keyframer, a design tool for animating static images (SVGs) with natural language. Informed by interviews with professional animation designers and engineers, Keyframer supports exploration and refinement of animations through the combination of prompting and direct editing of generated output.
machine-learningvisual-arts
IDC 2023 honorable mention
papervideo
Collaborative Machine Learning Model Building with Families Using Co-ML
Tiffany Tseng, Jennifer King Chen, Mona Abdelrahman, Mary Beth Kery, Fred Hohman, Adriana Hilliard, R Benjamin Shapiro
We created Co-ML – a tablet-based app for learners to collaboratively build ML image classifiers through an end-to-end, iterative model-building process. In this paper, we illustrate the feasibility and potential richness of collaborative modeling by presenting an in-depth case study of a family (two children 11 and 14-years-old working with their parents) using Co-ML in a facilitated introductory ML activity at home.
machine-learning
DIS 2021
papervideopresentation
Circuit Assemblies: Electronic Modules for Interactive 3D-Prints
Tiffany Tseng, Yoshihiro Kawahara
This pictorial presents Circuit Assemblies, a design system for beginners to create 3D-printed interactive objects with embedded electronics. Circuit Assemblies are modules used to create objects that light up, move, or spin using basic electronic components like LEDs, batteries, and motors. To support beginners incorporating Circuit Assemblies into 3D designs, a set of virtual components were added to Tinkercad, a popular browser-based 3D CAD application with over 10 million users.
electronics
IDC 2021 best paper
papervideopresentation
PlushPal: Storytelling with interactive plush toys and machine learning
Tiffany Tseng, Yumiko Murai, Natalie Freed, Deanna Gelosi, Tung D Ta, Yoshihiro Kawahara
This paper presents PlushPal, a web-based design tool for children to make plush toys interactive with machine learning (ML). With PlushPal, children attach micro:bit hardware to stuffed animals, design custom gestures for their toy, and build gesture-recognition ML models to trigger their own sounds. We describe how, in the context of storytelling, PlushPal introduces core concepts in ML including data sampling and model evaluation.
machine-learningelectronics
DIS 2016
papervideo
Spin: Examining the role of engagement, integration, and modularity in supporting youth creating documentation
Tiffany Tseng, Mitchel Resnick
In this paper, we contribute an evaluation of Spin, a system for youth to capture and share animations of physical design projects. We describe how educators and students used Spin in 16 different K-12 makerspaces over 6 months, ranging from 2-hour-long workshops to extended 8-week engagements. We outline the role of engagement, integration, and modularity for making documentation practice relevant and meaningful.
design-documentation
Fablearn 2015
paperdemo
Making Make-throughs: Supporting young makers sharing design process.
Tiffany Tseng
This paper introduces the concept of make-throughs, a documentation format in which Makers share their design process throughout the development of a design project. Makethroughs capture the rich, iterative nature of a design process in which a project is constantly revised and refined over time. In contrast to tutorials, make-through documentation is shared throughout the design process (rather than after a project is complete), and incorporates iteration (rather than a finalized list of instructions).
design-documentation
IDC 2014
paper
Product versus process: Representing and appropriating DIY projects online
Tiffany Tseng, Mitchel Resnick
Through interviews and surveys with authors and readers of Instructables, we describe differences found in the practices of these two types of users in creating and applying design documentation. Based on the results, we identify design opportunities for members of the HCI community developing tools to better support people sharing creative work online..
design-documentation

People

Tiffany Tseng
Assistant Professor
Lulu Wang
Research Assistant
Liliana Seoror
Research Assistant

👋 DTL is actively recruiting students!

DTL welcomes students with a range of backgrounds and interests, including software, product, UX, hardware, and learning experience design.

Our research involves system building – we design and build prototypes of new design tools while studying how they can be used in practice.

Drawing from design-based research, we create learning experiences (such as workshops and activity guides) in collaboration with community partners – and iteratively refine these materials based on learner feedback.

Barnard and Columbia Undergraduates

Please get in touch with Professor Tseng at ttseng@barnard.edu. Include what year you are in, your major, what software or design skills you may have, and why you are interested in joining the lab.

Prospective Graduating Students

Apply to Columbia CS and mention PI Tiffany Tseng in your application.