The Box World
1 Month
Speculative Interaction
Timeline
Nov 2023
Tools
Touch designer, Arduino, Microsoft Kinect, Rhino, 3D Printing
Project Overview
In a highly personalized yet anonymous future community, emotional expression becomes essential for communication. Box World explores new modes of interaction by translating human states through combinations of sensors.
My Contributions
Proposed the concept of translating human sensory data into visual interactions using Touch Designer and Arduino.
Concept
Recognizing human states through patterns
Humans rely on rich sensory cues beyond language to communicate, but interaction in virtual worlds remains limited. Visualizing users’ bodily changes as patterns may enable more effective communication in virtual environments.
Data collection via sensor input
To realize this idea, we needed to collect data that reflects human states. Among these, movement, emotional state, and behavior are key factors. To digitize these aspects, we used three sensors.
Encoded data - Identity
Data collected from each sensor is translated into visual expressions representing individual states. This enables the communication of personal characteristics while maintaining privacy.
transformation
Transforming personal data into interactive graphic
pulse and gyro sensors captured movement intensity, position, and momentary psychological states. The data was translated into visual expressions using TouchDesigner, reflecting each individual’s unique characteristics.
controller design
Controller design
We designed prototypes to ensure that when the controller is gripped, the fingers naturally align with the sensors and provide a comfortable grip.
Prototype
SLA printing technology was utilized to achieve a smooth and high-quality prototype similar to that of a real product.
Integrate sensors
The MPU6560, Arduino Nano, and pulse sensor are housed inside the controller. In addition, a semitransparent finish has been applied to the controller, allowing the operating status of the internal sensors to be observed.
Patterning Human Signals
We explored how Kinect, gyroscope, and heart rate sensors capture user data and transform it into color, shape, and pattern.
VIsual representation
Interactive exhibition
We utilized projection mapping not only to visually represent our ideas in real-time but also to facilitate active participation from people.
images
Concept Video
Interactive exhibition
We utilized projection mapping not only to visually represent our ideas in real-time but also to facilitate active participation from people.
contact