...

NeuralDrum: Perceiving Brain Synchronicity in XR Drumming

Abstract

Brain synchronicity is a neurological phenomenon where two or more individuals have their brain activation in the phase when performing a shared activity. We present NeuralDrum, an extended reality (XR) drumming experience that allows two players to drum together while their brain signals are simultaneously measured. We calculate the Phase Locking Value (PLV) to determine their brain synchronicity and use this to directly affect their visual and auditory experience in the game, creating a closed feedback loop. In a pilot study, we logged and analyzed the users’ brain signals as well as had them answer a subjective questionnaire regarding their perception of synchronicity with their partner and the overall experience. From the results, we discuss design implications to further improve NeuralDrum and propose methods to integrate brain synchronicity into interactive experiences.

Pai, Yun Suen, Ryo Hajika, Kunal Gupta, Prasanth Sasikumar, and Mark Billinghurst. 'NeuralDrum: Perceiving Brain Synchronicity in XR Drumming.' In SIGGRAPH Asia 2020 Technical Communications, pp. 1-4. 2020.

Siggraph Asia 2020, Virtual Event Republic of Korea

Read Paper