Motivation: BCI for Creativity and enhanced Inclusion Paul McCullagh University of Ulster
RTD challenges Problems with current BCI Slow data rate, 30-80 bits per minute dependent on the experimental strategy used Errors / problem for safety critical applications Number of classes that can be reliably distinguished Generalisation of paradigms Small sample sizes Harness faster EEG components How much influence / control / expressiveness, creativity can be exerted?
Inclusion BCI channel controls interface Personalisation: photo albums Watching films Listening to music Intuitive common interface ipod metaphor BCI Engaging environment EEG channel brain activity modulates BCI and multimodal control of music derived from sonified EEG BCI and multimodal augmentation of visual textures
BCI Europe stakeholders Communication of severely handicapped people who have no other physical means to express themselves (Birbaumer et al. 1999). Navigate from avatar to avatar along a virtual street (in a CAVE) (Friedman, 2007). Environmental control, e.g. Smart Home EU project PRESENCCIA (Leeb and Pfurtscheller, Univ Graz ), g.bcisys www.gtec.at/products/g.bcisys/bci.htm#smarthome) BCI for manipulation of prosthesis or robotic devices (Univ Bremen)...others
Creativity Using EEG as a forum for musical expression was first demonstrated by Alvin Lucier through his recital named Music for Solo Performer (Lucier, 1965) The BioMuse system developed by Lusted and Knapp (1996, 1998). Atau Tanaka was commission to compose for the original BioMuse system and has given performances using it to control real time image processing as well as musical recitals (Tanaka, 2002). Music generation by brain waves Eduardo Miranda, 2003; University of Plymouth; Arslan, 2006 ). Sonification of EEG rhythms (Hermann, 2005; Hinterberger, 2005; Dirbus, 2004) BCI feedback useful in creative tasks (Gruzelier, 2004).
Roadmap... 5 years Practical BCI, e.g. (FP7-2007-ICT-2-7.2, Accessible and Inclusive ICT, Brain computer interfaces with Rapid Automated Interfaces for Nonexperts, Grant agreement no.: 224156) 6..10 years Research studies with larger groups Ubiquitous devices Enhanced Inclusion for independent living Gaming, second life 11 years+,???? Disappearing devices, interaction with ambient intelligent environments, and personalised healthspace Prediction of adverse neurological events Better understand dysfunction, mood
Arslan, B., Brouse, A., Castet, J., Lehembre, R., Simon, C., Filatriau, JJ and Noirhomme, Q. (2006). A Real Time Music Synthesis Environment Driven with Biological Signals, IEEE International Conference on Acoustics, Speech and Signal Processing, 2006. ICASSP 2006 Proceedings, vol. 2. Birbaumer N., Ghanayim N., Hinterberger T., Iversen I., Kotchoubey B., Kubler A., Perelmouter J., Taub E., and Flor H (1999). A spelling device for the paralysed. Nature, 398, 297-8. Dribus, J. (2004). The other ear: a musical sonification of eeg data, Proceedings of the 2004 International Conference on Auditory Display. Friedman D, Leeb R, Guger C, Steed A, Pfurtscheller G and Slater M, (2007). Navigating virtual reality by thought: what is it like? Presence: Teleoperators and Virtual Environments, 16, 100-10. Gruzelier, J. & Egner, T. (2004). Physiological self-regulation: Biofeedback and neurofeedback, in: aron Williamon (Ed.), Musical Excellence. Strategies and Techniques to Enhance Performance, Oxford Hermann, T. and Hunt, A. (2005). Guest Editors' Introduction: An Introduction to Interactive Sonification, IEEE Multimedia, vol. 12, no. 2, pp. 20-24. Hinterberger, T. and Baier, G. (2005). Parametric orchestral sonification of EEG in real time, IEEE Multimedia, vol. 12, no. 2, pp 70-79. Interdisciplinary centre for computer music, http://cmr.soc.plymouth.ac.uk/index.html, last accessed July 07. Knapp, R. B. and Lusted, H.S. (1998). A real-time digital signal processing system for bioelectriccontrol of music, International Conference on Acoustics, Speech, and Signal Processing, (ICASSP), pp 2556-2557. Lucier, A (1965). Music for the solo performer, http://www.emfinstitute.emf.org/exhibits/luciersolo.html last accessed July 2007. Lusted, H. S. and Knapp, B. (1996). Controlling Computers with Neural Signals, Journal of Scientific American, vol. 275, no. 4, pp 82-97. Miranda, E. R., Sharman, K., Kilborn, K., Duncan, A. (2003). On Harnessing the Electroencephalogram for the Musical Braincap", Computer Music Journal, Vol. 27, No. 2, pp. 80-102. Sonic Arts Research Centre, http://www.sarc.qub.ac.uk/main.php Tanaka, A. and Knapp, R.B. (2002). Multimodal interaction in music using the Electromyogram and relative position sensing, Proceedings of the 2002 conference on new interfaces for musical expression, pp 1-6.