Tapis Magique: A Choreomusical Interactive Carpet

New smart materials and digital fabrication technologies have modernized and pushed forward textile design, fabrication, and applications. Textile's physical and functional properties can now be tuned at the resolution of a fiber, a particle coating, a loop structure, or a multi-dimensional knit layer. These textiles can be fully customized from the micro, meso, to macro-scale and computationally designed and fabricated to form a seamless and functional sensate skin. Patterns, colors, texture, thickness, elasticity, breathability, conductivity, and other electromechanical parameters can be engineered through fiber-fabric structures or material choices.

In this project, we utilized the additive manufacturing process of machine knitting and electrically-conducting yarns to develop large-scale, interactive textile sensate surface. The tapis indeed not only serves for aesthetic, comfort, and insulation purposes, but is also augmented as a responsive skin that bridges the tactile-physical with the immersive-digital world.

The tapis design is composed of multi-layer knitted textiles. The top and bottom layers are orthogonal conductive line matrices knitted within a single operation using multi-material twisted yarns. The middle layer is a knitted piezo-resistive textile, a pressure-sensitive layer that interfaces with the conductive matrices to create a sensing grid. The dense geometrical patterns of the stars scattered around the brushstroke details in the tapis represent 1800 pressure-sensing pixels (distributed in 15 MIDI Channels) and are inspired by the galactic space. Parametric design transformed these patterns into a 3-D spatial illusion to illustrate the multi-dimensionality of the sensor data.  

The furry textures from the synthetic mink yarns provide a soft tactility for physical feedback and give an intimate and comforting feel of the tapis. The thermoplastic fibers were  then steamed to melt the multi-layer knitted textiles into one rigid surface, giving it structural reinforcements. In addition, the outer-facing textile glows in the dark from the luminous yarns, bringing out the starry effects for night performance. 

The knitted conductive lines are connected to a system hardware consisting of multiplexers, shift-registers, operational amplifiers, and microcontroller that sequentially reads each pressure sensing pixel and sends it to a computer. These pixels collectively generate continuous 3-D spatiotemporal sensor data mapped into MIDI streams to trigger and control discrete notes, continuous effects, and immersive soundscapes through science-inspired musical tools. 

Several musical pieces were designed to invoke various emotions to inspire conversations between the choreographer and the instrument. Behind the scenes, runs a digital modular synthesizer made of several patches, each for a different type of performance. The incoming stream of MIDI data is first fed into quantizer modules that align the notes to major, minor, and pentatonic scales, as well as mystic chords. The sounds are then generated by a collection of subtractive, additive, and granular synthesizers. "Venus Sunrise", one of our performance pieces, as shown in the video above, presents a metaphorical celestial sound of the universe as the dancer is twirling around the stars, traveling through space and time. 

Tapis Magique demonstrates the interplay between art and technology,  highlighting the deep emotional link between contemporary textiles, dance, and music through the physical-digital connection. It provides a canvas for dancers and sound artists to modulate sound, perform and compose a musical piece based on choreography and vice versa; it also creates an auditory-gestural synesthetic environment that invites and encourages audiences to interact and express themselves with the tapis, experiencing a magical connection that stimulates the body and mind.

*Covid protocols were followed in the making and filming of the video.