Interactive experiences · Practical guide
From sensor to image: design a readable response
A sensor provides a measurement or a state. The installation must decide what it means for the experience and turn it into a readable response. Separating these stages makes the system easier to adjust and diagnose.
Measurement, interpretation, and display have different owners
- Sensor / data
- Interpretation / zone
- Visual state
- Render / surface
In a proposed scenario, a zone changes a wall’s color when presence is detected. The sensor does not need to generate a skeleton or identify people. A presence input may be enough. If the picture must follow a hand, the required data and coverage test change.
- Data: name, type, units, origin, and receipt time. Specify whether position uses meters, pixels, or normalized values; a tracking ID does not guarantee persistent identity.
- Interpretation: zone boundaries, filtering, and entry/exit conditions. Distinguish “no person” from “no data.”
- Visual state: idle, invitation, active, exit, and assisted mode. Define priority for multiple people and repeated gestures.
- Output: canvas, resolution, frame rate, physical destination, and owner. A valid input does not confirm the projected picture.
Example interface to agree on between integrators: zone_A.present is Boolean; validity is reported separately; the receiver keeps the last receipt time. An agreed expiration period returns the experience to idle and alerts the operator. Adjust that period in prototyping and rehearsal; it is not a universal constant.
TouchDesigner can represent numbers in CHOP channels. When choosing a tool, confirm the interfaces and licenses needed for the project. Coordinate protocols and cues with show control. Before connecting hardware, simulate entry, presence, exit, stalled data, and recovery. This scope covers noncritical image/audio interaction; do not apply these decisions to machinery or safety systems.
Questions to plan the configuration
Does a responsive image require identifying people?
It depends on the action. A zone response may use presence or position without identifying a person. Before selecting a sensor, define the required data and what is processed or retained.
Where should I start if video works but does not respond?
Separate received data, validity, application state, and visible output. A connected sensor may have stopped providing data; a correct picture does not validate detection. Record each stage before changing settings.
Sources and scope
- Derivative — CHOP — Numeric channels and data processing for a visual response.