# Interactive "painting" controlled with OSC data from phone to Isadora

**Description:**

A set-up with an interactive "painting" and light fixture named "Van Gogh heeft een oogje op je foon" controlled by the smartphone sensors with ZigSim to OSC, Isadora, DMX light and a projector. The installation demonstrates the use of smartphone sensors within in a creative context.

**Required components:**

- <span class="s1">Smartphone with [Zigsim](https://1-10.github.io/zigsim/getting-started.html) app</span>
- <span class="s1">Computer with Isadora (Isadora patch via this [<span class="s2">link</span>](https://nextcloud.hku.nl/s/sDmGtM4PjZkmSpz))</span>
- Projector or display
- Isadora patch and media files:[ Files.zip](https://bookstack.hku.nl/attachments/33)

**Order from input to output:**

  
\- Smartphone sends [OSC](https://en.wikipedia.org/wiki/Open_Sound_Control) data using the [ZigSim](https://1-10.github.io/zigsim/getting-started.html) app:  
\- OSC data is received by the visual programming environment [Isadora](https://support.troikatronix.com/support/solutions/articles/13000056359-pricing-for-isadora-3).  
\- In Isadora, the data from phone rotation and finger position on the touchscreen is converted into, among other things, eye movement, fade between projections and scrolling through frames.  
\- [Gazebo](https://github.com/hku-ect/gazebosc) was used as a bridge to convert telephone data to [DMX](https://nl.wikipedia.org/wiki/DMX512) for controlling theater lighting. Most recent versions can be found [here](https://pong.hku.nl/~buildbot/gazebosc/). More info [here](https://bookstack.hku.nl/books/gazebosc).

[![IMG_1018.jpeg](https://bookstack.hku.nl/uploads/images/gallery/2023-11/scaled-1680-/img-1018.jpeg)](https://bookstack.hku.nl/uploads/images/gallery/2023-11/img-1018.jpeg)

<iframe allowfullscreen="allowfullscreen" height="379" src="https://www.youtube.com/embed/kn_O34BuWag" style="width: 678px; height: 379px;" width="678"></iframe>

[![Screenshot 2023-11-20 at 16.45.43.png](https://bookstack.hku.nl/uploads/images/gallery/2023-11/scaled-1680-/screenshot-2023-11-20-at-16-45-43.png)](https://bookstack.hku.nl/uploads/images/gallery/2023-11/screenshot-2023-11-20-at-16-45-43.png)

**Terminology:**

- [OSC](https://bookstack.hku.nl/books/osc-open-sound-control)
- [DMX](https://en.wikipedia.org/wiki/DMX512)
- [Patch](https://en.wikipedia.org/wiki/Patch_(computing))