← Design + Engineering
Apple Watch and EmotiBit sending live readings to an iPhone, then to a headset and the physician’s view

Physician tool · iOS, watchOS, XR

EMOTHESIA

A patient’s live biosignals, in the physician’s headset

RoleSoftware Developer
Year2023 – 24
LabResponsive Environments & Artifacts Lab, Harvard
BuiltSwift · watchOS · EmotiBit · Magic Leap 2
Tested50 physicians

A native iOS and Apple Watch app I wrote in Swift. It streams live biosignals from the Watch and an EmotiBit sensor, through the iPhone, into an XR view on Magic Leap 2.

Overview

01

Emothesia puts a patient’s body signals in front of a physician as they happen. Two sensors read the patient, a phone collects and forwards everything, and a Magic Leap 2 headset draws it into the physician’s field of view.

It was built for physicians from the start, and shaped through interviews and user tests with 50 of them.

System

Signal path
EMOTHESIA · SYSTEM2023 – 2401 / ON THE PATIENTTwo sensors, wornEmotiBitskin conductance (EDA)temperatureApple Watchheart rate, HRV: liveECG: 30 s recording02 / SIGNAL PATHEverything routes through the phoneA · WRISTApple WatchB · BODYEmotiBitC · PHONEiPhone appSwift. Pairs both,forwards every readingD · HEADSETMagic Leap 272draws it into thephysician’s view03 / PHYSICIAN VIEWThrough the headsetpatientPATIENT · LIVE72BPMHRV48 msEDA2.6 µSTEMP33.8 °CDASHBOARDLive HR, HRV, EDA,temperatureSCENEDims on everyheartbeatEMOTHESIA · SYSTEM2023 – 2401 / ON THE PATIENTTwo sensors, wornEmotiBitskin conductance (EDA)temperatureApple Watchheart rate, HRV: liveECG: 30 s recording02 / SIGNAL PATHAll through the phoneA · WRISTApple WatchB · BODYEmotiBitC · PHONEiPhone appSwift. Pairs both,forwards every readingD · HEADSETMagic Leap 272draws it into thephysician’s view03 / PHYSICIAN VIEWThrough the headsetpatientPATIENT · LIVE72BPMHRV48 msEDA2.6 µSTEMP33.8 °CDASHBOARDLive HR, HRV, EDA, temperatureSCENEDims on every heartbeat

Watch + phone

Try it
Emothesia10:09
72BPM
HRV 48 ms
EmothesiaPatient session
Live

Sensors

Apple WatchConnected

Heart rate

Apple Watch
72bpm
HRV48ms
EDA2.6µS
Temp33.8°C

ECG

None yet

Record one on the watch

Sending HR, HRV, EDA, Temp

Watch
Record ECG takes a real 30-second recording, drawing the strip as it goes, then sends it to the phone.
Phone
Tap the EmotiBit to disconnect it, and EDA and temperature drop out of every screen.
Stream
Choose which signals reach the physician’s headset, or pause the stream.

The watch and iPhone apps, recreated to work as they did. Record an ECG, drop the EmotiBit, choose what streams.

In the headset

Loop

The physician’s view, recreated over stock footage.

Prototype Demo

1:11

Biosignals visualized in XR

Findings

02

Implicit feedback beat explicit: world-dimming on each heartbeat created a stronger sense of embodied connection than the icon dashboard, an immersion through diminishment. We recommend hybrid systems integrating both.

Headsets remain a barrier to the very connection they augment: obscuring the eyes interferes with the microexpressions interpersonal communication depends on. And biosignal interpretation raises philosophical problems: classifying emotion into discrete categories is imperfect and culturally contingent, while our emotional experience is fundamentally continuous.