# Sensors

# wearable sensors



# Muse 2 EEG headband

Muse is a smart headband that acts as your personal meditation coach. Using advanced EEG brain sensors, Muse can detect your brain activity and provide you with real-time feedback in the form of gentle audio sounds through your headphones (regular use in the Muse app). Primarily advertised as a neurofeedback tool, the headband tracks heart rate (**PPG + Pulse Oximetry**), angular velocity (**gyroscope**), proper acceleration (**accelerometer**), and electroencephalography (**dry electrodes**) to assist you in your meditation sessions.

<table border="1" id="bkmrk-the-muse-can-be-conn" style="border-collapse: collapse; width: 116.296%; height: 213px;"><colgroup><col style="width: 70.41%;"></col><col style="width: 29.59%;"></col></colgroup><tbody><tr><td>The Muse can be connected to your computer using Petal Metrics: [https://petal.tech/downloads](https://petal.tech/downloads)  
This tool allows you to send the EEG data to your computer through OSC. </td><td>![Screenshot 2024-02-26 at 15.19.55.png](https://bookstack.hku.nl/uploads/images/gallery/2024-02/scaled-1680-/screenshot-2024-02-26-at-15-19-55.png)</td></tr></tbody></table>

[Brain waves](https://www.diygenius.com/the-5-types-of-brain-waves/ "more info on these 5 types of brainwaves") are measured in hertz (Hz), which refers to cycles per second.

[![image.png](https://bookstack.hku.nl/uploads/images/gallery/2024-02/scaled-1680-/NGpimage.png)](https://bookstack.hku.nl/uploads/images/gallery/2024-02/NGpimage.png)

#### Muse 2 in Touchdesigner:

<iframe allowfullscreen="allowfullscreen" height="314" src="https://www.youtube.com/embed/Br0JXvuzWEI" width="560"></iframe>

This video covers how to connect the Muse 2 device into TouchDesigner.   
Using OSC ports (muse app, paid) to get the data, we will build a simple generative animation controlled with the mind.  
The connected app is *[Mind Monitor ](https://mind-monitor.com/ "mind monitor app")(paid)*

Download [muse\_data.tox](https://bookstack.hku.nl/attachments/47) for touchdesigner use with and OSC app connected to the headset &amp; get named channels.

#### Extra reads:

[Interesting article on Medium](https://anushmutyala.medium.com/muse-101-how-to-start-developing-with-the-muse-2-right-now-a1b87119be5c) : Muse 101 — How to start Developing with the Muse 2 right now

# Apple watch , iphone

available sensors:

- <div class="vector-toc-text">Proximity sensor</div>
- <div class="vector-toc-text">Ambient light sensor</div>
- <div class="vector-toc-text">Accelerometer</div>
- <div class="vector-toc-text">Magnetometer</div>
- <div class="vector-toc-text">Gyroscopic sensor</div>
- <div class="vector-toc-text">Barometer</div>

ZigSimPro

# Genki Wave

[![image.png](https://bookstack.hku.nl/uploads/images/gallery/2024-02/scaled-1680-/sttimage.png)](https://bookstack.hku.nl/uploads/images/gallery/2024-02/sttimage.png)

[Wave Midi Ring](https://reserveren.hku.nl/#equipment/189504 "for loan @ Blackbox IBB") : This MIDI controller can add dynamic effects with the tap of a finger, the click of a button, the wave of your hand.

connect to your computer via [Softwave ](https://genkiinstruments.com/products/softwave "softwave download")  
Download the [manual](https://bitbucket.org/genki_instruments/software_releases/downloads/Softwave_quickstartguide.pdf "softwave manual") here   
  
<iframe allowfullscreen="allowfullscreen" height="314" src="https://www.youtube.com/embed/TB789hiIJfA" width="560"></iframe>

**Working with the Wave in Isadora:**

Softwave software comes with presets on the left side in the interface. Preset 15 is already set to MIDI with channel 15. Go to Menu &gt; Audio/MIDI settings. Here you can choose MIDI output. When you start Isadora it will show "Isadora Virtual In"

In Isadora you receive MIDI by setting your input channel in the Communications &gt; Midi Setup window  
Input ports:  
Port 1: Wave  
  
Use the Actor Control Watcher: Set Controller to the number of the channel you send MIDI to from Softwave. Like channel 15.

In Softwave you can make your own presets and choose your own channel numbers.   
Make a new preset by clicking + next to "Default Preset Blank" at the top of the presets list. Choose "add function" and a function. In the bottom right of the new function press the MIDI icon &gt; CC to choose a channel like 3.  
In Isadora change yout control watcher controller channel to 3 to receive tha values.

Sometimes Isadora looses communication to the Wave, go to midi setup window change the port to none and choose wave again. Connection should be back.

# position tracking



# Vive trackers

Vive trackers

Vive Ultimate trackers

# Full body mocap

Motive/Optitrack <span style="color: rgb(224, 62, 45);">TDB</span>

Rokoko <span style="color: rgb(224, 62, 45);">TBD</span>

Als see [https://bookstack.hku.nl/books/3d-depth-cameras/page/types-of-depth-cameras-alternatives-for-position-tracking](https://bookstack.hku.nl/books/3d-depth-cameras/page/types-of-depth-cameras-alternatives-for-position-tracking)  
for 3d camera's, mediapipe and apps that allow body tracking through camera

# Leap Motion

**With the Leap Motion you can track the movement of your hands.**

You can buy Leap version 2 since 2023, the Leap 1 is still relevant.  
Here you can find information on how to install the software for Leap1 and use it in Isadora and Touchdesigner

Leap1 + software SDK 3.2.1 (older version) works with PC and Isadora. New software SDK works with Leap1, TD and Apple Silicon Macs, provided the SDK file “libLeapC.5.dylib” is in the correct folder.

  
**Windows**:   
Desktop/Laptop Computers &gt; (Scroll down )Technical details &gt; windows &gt; Legacy downloads &gt; V3.2.1   
Direct link: [V3.2.1 for Windows](https://leap2.ultraleap.com/download/software?name=tracking-software&version=3.2.1&platform=windows)

 **Mac**:   
Desktop/Laptop Computers &gt; Choose the new [version](https://leap2.ultraleap.com/gemini-downloads/?_gl=1*zi7eks*_ga*MTIyMjcwNzMwNi4xNzA5MDU1MDU2*_ga_5G8B19JLWG*MTcxMDc2NTQzNS43LjEuMTcxMDc2NTQ3My4yMi4wLjA.)  
For Mac M1 &amp; M2, Direct link [v5.17.1 – Beta](https://leap2.ultraleap.com/download/software?name=tracking-software&version=5.17.1-2023.11.16&platform=macos-silicon)  
  
**Use Leap motion in Isadora on PC &amp; Mac**  
For more info on how to use the Leap Motion [read this ](https://troikatronix.com/add-ons/leap-motion-watcher/)and download and install the Leap Motion user actor.

Isadora mentions in the README file bij de user actor: If you want to run this plugin on an Apple Silicon (ARM/M1) based Mac, you'll have to enable Intel emulation (Rosetta) mode on the Isadora application. But if you work with Sonoma (Mac OS) this might not be the case. I found this online:  
Does Rosetta work on Sonoma?  
A major macOS Sonoma update cuts the compatibility of an array of software, resulting in all of them not working properly on a brand-new environment, such as apps designed for Intel Mac stop working on Apple Silicon Macs. This issue happens because of Rosetta 2 support incompatibility on macOS Sonoma.  
  
More info about Leap motion and Isadora can be found [here](https://support.troikatronix.com/support/solutions/articles/13000070017-leap-motion-drivers-sdk-requirements) and [here](https://community.troikatronix.com/topic/8652/answered-urgent-leap-motion-not-detected/20), also [here.](https://community.troikatronix.com/topic/6242/workaround-logged-leap-motion-actor-doesn-t-work-with-latest-sdk/6)

**Preperations to use Leap Motion with Touchdesigner on Mac (not yet tested on PC)**  
[https://docs.derivative.ca/Leap\_Motion\_TOP](https://docs.derivative.ca/Leap_Motion_TOP)  
This info is not complete,   
the SDK files are located in: /Library/Application Support/Ultraleap/LeapSDK   
For Sonoma users: /Library/Applications/Ultraleap Hands Tracking (right mouse click &gt; show package contents)/Contents/LeapSDK

Copy the files mentioned on [this page](https://docs.derivative.ca/Leap_Motion_TOP) to`TouchDesigner.app/(right mouse click > show package contents)contents/frameworks`