Design of a Mobile Brain Computer Interface-Based Smart Multimedia Controller

Similar documents
A BCI Control System for TV Channels Selection

Development of 16-channels Compact EEG System Using Real-time High-speed Wireless Transmission

IJESRT. (I2OR), Publication Impact Factor: 3.785

TECHNICAL SPECIFICATIONS, VALIDATION, AND RESEARCH USE CONTENTS:

Brain-Computer Interface (BCI)

Real-time EEG signal processing based on TI s TMS320C6713 DSK

Detecting and Analyzing System for the Vibration Comfort of Car Seats Based on LabVIEW

Real-time Chatter Compensation based on Embedded Sensing Device in Machine tools

Re: ENSC 370 Project Physiological Signal Data Logger Functional Specifications

SMARTING SMART, RELIABLE, SIMPLE

6.111 Project Proposal IMPLEMENTATION. Lyne Petse Szu-Po Wang Wenting Zheng

Real Time Bio-signal Acquisition System

Digital Strobe Tuner. w/ On stage Display

DAT335 Music Perception and Cognition Cogswell Polytechnical College Spring Week 6 Class Notes

Thought Technology Ltd Belgrave Avenue, Montreal, QC H4A 2L8 Canada

Multi-Parameter Monitoring Data Acquisition System for SpO 2 Signals

18th European Signal Processing Conference (EUSIPCO-2010) Aalborg, Denmark, August 23-27, GIPSA-lab CNRS UMR 5216

BRAIN-COMPUTER interface (BCI) systems have been

HBI Database. Version 2 (User Manual)

Chapter 1. Introduction to Digital Signal Processing

Common Spatial Patterns 2 class BCI V Copyright 2012 g.tec medical engineering GmbH

Implementing A Low Cost Data Acquisition System for Engineering Education Programs in Universities

Effects of Musical Tempo on Heart Rate, Brain Activity, and Short-term Memory Abstract

An Integrated EMG Data Acquisition System by Using Android app

Research Article Music Composition from the Brain Signal: Representing the Mental State by Music

EEG Eye-Blinking Artefacts Power Spectrum Analysis

Brain.fm Theory & Process

Gated Driver Tree Based Power Optimized Multi-Bit Flip-Flops

Internet of Things Technology Applies to Two Wheeled Guard Robot with Visual Ability

1ms Column Parallel Vision System and It's Application of High Speed Target Tracking

Common Spatial Patterns 3 class BCI V Copyright 2012 g.tec medical engineering GmbH

Accuracy improvement of indenting test results by using wireless cable indenting robot

Sensor Development for the imote2 Smart Sensor Platform

Reliable visual stimuli on LCD screens for SSVEP based BCI

inter.noise 2000 The 29th International Congress and Exhibition on Noise Control Engineering August 2000, Nice, FRANCE

Hidden melody in music playing motion: Music recording using optical motion tracking system

ECG SIGNAL COMPRESSION BASED ON FRACTALS AND RLE

An Ultra-Low Power Physical Layer Design For Wireless Body Area Network

A QUERY BY EXAMPLE MUSIC RETRIEVAL ALGORITHM

Investigation of Digital Signal Processing of High-speed DACs Signals for Settling Time Testing

IN DIGITAL transmission systems, there are always scramblers

ECE 4220 Real Time Embedded Systems Final Project Spectrum Analyzer

A Noble Identification System for Tumors and Implementation

Hidden Markov Model based dance recognition

Adaptive Key Frame Selection for Efficient Video Coding

INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATION ENGINEERING & TECHNOLOGY (IJECET) APPLIANCE SWITCHING USING EYE MOVEMENT FOR PARALYZED PEOPLE

Identification of Motion Artifact in Ambulatory ECG Signal Using Wavelet Techniques

MANAGING POWER SYSTEM FAULTS. Xianyong Feng, PhD Center for Electromechanics The University of Texas at Austin November 14, 2017

A First Laboratory Course on Digital Signal Processing

Applications of the Internet of Things Technology in Advanced Planning Systems

AN ANALYSIS OF SOUND FOR FAULT ENGINE

SedLine Sedation Monitor

AppNote - Managing noisy RF environment in RC3c. Ver. 4

News from Rohde&Schwarz Number 195 (2008/I)

Operating Bio-Implantable Devices in Ultra-Low Power Error Correction Circuits: using optimized ACS Viterbi decoder

An Efficient Low Bit-Rate Video-Coding Algorithm Focusing on Moving Regions

HEART ATTACK DETECTION BY HEARTBEAT SENSING USING INTERNET OF THINGS : IOT

Design and Realization of the Guitar Tuner Using MyRIO

Low Cost RF Amplifier for Community TV

Broken Wires Diagnosis Method Numerical Simulation Based on Smart Cable Structure

Discovering Similar Music for Alpha Wave Music

An Exploration of the OpenEEG Project

Mind Alive Inc. Product History

The Design of Efficient Viterbi Decoder and Realization by FPGA

Welcome to Electrical and Electronic Engineering UCD. Electronic/Computer Engineering (ECE)

The Power of Listening

Driver Fatigue Detection Using Neurosky Mindwave Headset

CONSTRUCTION OF LOW-DISTORTED MESSAGE-RICH VIDEOS FOR PERVASIVE COMMUNICATION

Work In Progress: Adapting Inexpensive Game Technology to Teach Principles of Neural Interface Technology and Device Control

Audio Compression Technology for Voice Transmission

This Is Your Brain On Music. BIA-MA Brain Injury Conference March 30, 2017 Eve D. Montague, MSM, MT-BC

The Healing Power of Music. Scientific American Mind William Forde Thompson and Gottfried Schlaug

1 Feb Grading WB PM Low power Wireless RF Transmitter for Photodiode Temperature Measurements

LOW-COMPLEXITY BIG VIDEO DATA RECORDING ALGORITHMS FOR URBAN SURVEILLANCE SYSTEMS

IC Design of a New Decision Device for Analog Viterbi Decoder

ni.com Digital Signal Processing for Every Application

SHORT TERM PITCH MEMORY IN WESTERN vs. OTHER EQUAL TEMPERAMENT TUNING SYSTEMS

IoT-based Monitoring System using Tri-level Context Making for Smart Home Services

Optimization and Emulation Analysis on Sampling Model of Servo Burst

EngineDiag. The Reciprocating Machines Diagnostics Module. Introduction DATASHEET

Temporal control mechanism of repetitive tapping with simple rhythmic patterns

Overview of All Pixel Circuits for Active Matrix Organic Light Emitting Diode (AMOLED)

BCI Autonomous Assistant System with Seven Tasks for Assisting Disable People

EngineDiag. The Reciprocating Machines Diagnostics Module. Introduction DATASHEET

Transmission System for ISDB-S

Temporal Envelope and Periodicity Cues on Musical Pitch Discrimination with Acoustic Simulation of Cochlear Implant

However, in studies of expressive timing, the aim is to investigate production rather than perception of timing, that is, independently of the listene

Libera Hadron: demonstration at SPS (CERN)

Abstract REVIEW PAPER DOI: / Peter Ahnblad. International Tinnitus Journal. 2018;22(1):72-76.

Voice & Music Pattern Extraction: A Review

Smart Traffic Control System Using Image Processing

PRODUCT SHEET

A Matlab toolbox for. Characterisation Of Recorded Underwater Sound (CHORUS) USER S GUIDE

TongArk: a Human-Machine Ensemble

Environmental Controls Laboratory

Analyser WAWEON AD Intended for Measurement Mainly in Textile Industry

UNDERSTANDING TINNITUS AND TINNITUS TREATMENTS

The Design of Teaching Experiment System Based on Virtual Instrument Technology. Dayong Huo

A Vision of IoT: Applications, Challenges, and Opportunities With China Perspective

WEB SERVER NETWORK FOR ECG RECORDING AND BODY TEMPERATURE MONITORING SYSTEM BASED ON ARM MICROCONTROLLER

Transcription:

Sensors 2015, 15, 5518-5530; doi:10.3390/s150305518 Article OPEN ACCESS sensors ISSN 1424-8220 www.mdpi.com/journal/sensors Design of a Mobile Brain Computer Interface-Based Smart Multimedia Controller Kevin C. Tseng 1,2, Bor-Shing Lin 3, Alice May-Kuen Wong 4 and Bor-Shyh Lin 5,6, * 1 Department of Industrial Design, Chang-Gung University, Taoyuan 333, Taiwan; E-Mail: ktseng@pddlab.org 2 Healthy Aging Research Centre, Chang Gung University, Taoyuan 333, Taiwan 3 Department of Computer Science and Information Engineering, National Taipei University, New Taipei 237, Taiwan; E-Mail: bslin@mail.ntpu.edu.tw 4 Department of Physical Medicine and Rehabilitation, Chang Gung Medical Foundation, Taoyuan 333, Taiwan; E-Mail: walice@adm.cgmh.org.tw 5 Institute of Imaging and Biomedical Photonics, National Chiao Tung University, Tainan 711, Taiwan 6 Department of Medical Research, Chi-Mei Medical Center, Tainan 710, Taiwan * Author to whom correspondence should be addressed; E-Mail: borshyhlin@mail.nctu.edu.tw; Tel.: +886-6-303-2121 (ext. 57835). Academic Editor: Gianluca Paravati Received: 2 January 2015 / Accepted: 2 March 2015 / Published: 6 March 2015 Abstract: Music is a way of expressing our feelings and emotions. Suitable music can positively affect people. However, current multimedia control methods, such as manual selection or automatic random mechanisms, which are now applied broadly in MP3 and CD players, cannot adaptively select suitable music according to the user s physiological state. In this study, a brain computer interface-based smart multimedia controller was proposed to select music in different situations according to the user s physiological state. Here, a commercial mobile tablet was used as the multimedia platform, and a wireless multi-channel electroencephalograph (EEG) acquisition module was designed for real-time EEG monitoring. A smart multimedia control program built in the multimedia platform was developed to analyze the user s EEG feature and select music according his/her state. The relationship between the user s state and music sorted by listener s preference was also examined in this study. The experimental results show that real-time music biofeedback according a user s EEG feature may positively improve the user s attention state.

Sensors 2015, 15 5519 Keywords: brain computer interface; multimedia controller; electroencephalograph; music biofeedback 1. Introduction Music is a significant approach to enhancing human physiology and psychology and applied in many areas such as disease treatment and recovery, physical rehabilitation, and enrichment of cognitive function. For example, music positively affects people with dementia, heart disease, or stroke [1,2], increases the effectiveness of pain alleviation and relaxing during rehabilitation [3], and enables people to improve mood state and mental processing [4]. Recently, many studies have explored the relationship between music listening and task performance. For instance, some studies indicated that music positively enhances work performance [5 7]. However, current multimedia control methods, such as manual selection or automatic random mechanisms, which are now applied broadly in MP3 and CD players, cannot adaptively select music according to the user s physiological state. In order to achieve this aim, a novel brain computer interface (BCI)-based smart multimedia controller is proposed in this study. Unlike manual selection or automatic random mechanism, our BCI-based smart multimedia controller selects music types according to the user s cognitive state. Brain computer interface provides a pragmatic and non-invasive way for communication between the human brain and external devices [8 14]. Several BCI-based controllers have been proposed in previous studies; however, only a few studies have tried to explore it on music control [15]. However, the above BCI-based multimedia controllers require the user s active mental command to control multimedia, but cannot select music automatically and adaptively according to the user s current state. Moreover, most of BCI systems require bulky and expensive electroencephalograph (EEG) machines and personal computers to process EEG in real time. This also limits the feasibility of these BCI-based multimedia controllers for daily applications. With the rapidly increasing popularity of mobile tablet, using mobile tablets as assistive technology devices of music listening becomes feasible and convenient. Mobile tablets contain small-volume and light-weight properties. In particular, recently, mobile tablets tend to offer more advanced computing ability, connectivity, and music efficiency. Therefore, in the proposed BCI-based multimedia controller, a commercial mobile tablet was used as the development platform. A smart multimedia control program built in the mobile tablet was also developed to continuously monitor the user s EEG feature. When a music selection nears its end, the smart multimedia control program will select the next music type according to the user s EEG feature. Moreover, unlike other bulky EEG machines, a wireless multi-channel EEG acquisition module was also designed to provide portability and improve the convenience of use for daily applications. 2. System Architecture and Design The basic scheme of the proposed brain computer interface-based smart multimedia controller is illustrated in Figure 1. The system hardware contains a wireless multi-channel EEG acquisition module and a multimedia platform. Here, the wireless multi-channel EEG acquisition module is

Sensors 2015, 15 5520 designed to acquire multi-channel EEG signals simultaneously and then transmit these EEG signals to the multimedia platform wirelessly. A smart multimedia control program is built in the multimedia platform to receive and analyze the acquired EEG signal and then store the estimated EEG features continuously. Several types of music are stored in different folders on the multimedia platform. When the music section nears its end, the next musical piece will be selected according to the user s EEG feature. Figure 1. Basic scheme of proposed brain computer interface-based mobile multimedia controller. 2.1. Wireless Multi-Channel EEG Acquisition Module The block diagram of the wireless multi-channel EEG acquisition module, as shown in Figure 2a, consists of three main parts: The front-end amplifier circuit, the microprocessor, and the Bluetooth transmission circuit. Here, the front-end amplifier circuit is designed to amplifier and filter EEG signals acquired from EEG electrodes, and the microprocessor is used to digitize the EEG signal, perform a low-pass filter, control the peripheral circuits, and send EEG signal into the Bluetooth transmission circuit. The front-end amplifier circuit contains an instrument amplifier and a band-pass filter. The gain of the front-end amplifier circuit is set to 5000 times with a frequency band of 0.1 Hz~150 Hz. In this study, an ultra-low power 16-bit RISC mixed-signal microprocessor (MPS430, Texas Instruments, Dallas, TX, USA) is used as the microprocessor. It can provide an 8-channel 12-bit successive approximation register analog-to-digital converter (SAR ADC) used to digitize acquired EEG signal. Here, the sampling rate of the SAR ADC is set to 512 Hz. Before transmitting the EEG signal to the Bluetooth transmission circuit, the microprocessor will pass the EEG signal through a moving average with a 56 Hz cutoff frequency to reduce the power-line interference. The Bluetooth transmission circuit contains a printed circuit board (PCB) antenna and a Bluetooth module, which is fully compliant with the Bluetooth v2.0+ EDR specification. The microprocessor communicates with the Bluetooth module via a universal asynchronous receiver/transmitter (UART). The wireless multi-channel EEG acquisition module is designed to operate at 35 ma with a 3.7 V DC power supply, and can be operated continuously for over 30 h with a commercial 1100 mah Li-ion battery. The size

Sensors 2015, 15 5521 of the wireless multi-channel EEG acquisition module is about 62 mm 28 mm 5 mm. Figure 2b shows the photograph of the wireless multi-channel EEG acquisition module. Figure 2. (a) Block diagram and (b) photograph of wireless multi-channel EEG acquisition module. 2.2. Multimedia Platform In this study, a commercial mobile tablet is used as the multimedia platform, and the operation system (OS) of the multimedia platform is Windows 8.1. The operation system of Windows 8.1 is known to allow the multi-tasking, allowing users to operate more than one application at one point of time. Besides the basic functions of receiving, displaying and storing the raw EEG data, the smart multimedia control program built in the mobile tablet will also provide the functions of monitoring the user s EEG feature and selecting next music type according the user s EEG feature. 3. System Software Design 3.1. Implement of Smart Multimedia Control Program The smart multimedia control program is developed by Microsoft C#. The operation procedure of the smart multimedia control program is shown in Figure 3. In the beginning, the smart multimedia control program will build the graphical user interface (GUI). Next, the smart multimedia control program will call the thread of Bluetooth API to search the wireless multi-channel EEG acquisition module and create a SPP stream to connect with the module, and then the REC thread will receive the raw EEG signal and store them into the memory and the solid-state drive (SSD) of the tablet. Next, the

Sensors 2015, 15 5522 ALGOR thread will calculate EEG feature from EEG signal recorded in the locations Fz, Fp1 and Fp2 of the EEG 10-20 electrode system. The smart multimedia control program will check the playing state of the music. If the musical piece is nearly over, the smart multimedia control program will calculate the average of the last three-minute EEG features and decide the next music type according to the averaged EEG feature. Figure 3. Operation procedure of smart multimedia control program. 3.2. EEG Feature Extraction Algorithm Changes in the sustained necessary attention can be reflected in the EEG spectra as theta rhythm (4~7 Hz) [16,17]. Iramina et al. have investigated the relationship between the measured EEG signals and subject s level of attention state, and they found that frontal theta increases when participants were studying but decreases when resting. Meanwhile, frontal alpha acts oppositely [16]. Moreover, Ishii et al. indicated that EEG spectra in the theta rhythm, obtained from the frontal midline, can provide discriminating power and has a high correlation with sustained necessary attention [17]. Based on the abovementioned phenomenon, EEG feature extraction algorithm was designed (its flowchart is shown in Figure 4a). First, EEG signals recorded from the locations Fz, Fp1, and Fp2 will be preprocessed. Here, EEG signal is down-sampled to 64 Hz to reduce the computation load, and a 512-point fast Fourier transform (FFT) with a 448-point overlap is used to obtain EEG spectra. Next, EEG spectra in theta, alpha (8~12 Hz), and beta (13~30 Hz) rhythms are calculated. In order to reduce the influence of measuring difference from session to session or from subject to subject, the normalized EEG spectra in theta rhythm is calculated. Let EEG Fz T (t), EEG Fz A (t), and EEG Fz B (t) be EEG spectra, obtained from Fz at iteration t, in theta, alpha, and beta rhythms, respectively. The normalized EEG spectra in theta rhythm can be calculated with the following equation: NEEG Fz T EEGFz T 100% = EEG + EEG + EEG (1) Fz T Fz A Fz B

Sensors 2015, 15 5523 Next, a linear combination EEG Index (t) of normalized EEG spectra in theta rhythm at iteration t can be calculated by: EEG Index( 2 t) = NEEGFz T + NEEGFp 1 T + NEEGFp T (2) where NEEG Fp 1 T and NEEG Fp 2 T denote the normalized EEG spectra in theta rhythm at iteration t, obtained from Fp1 and Fp2 respectively. Here, the reference electrode was placed at the ear. The tendency of the user s EEG spectra in theta rhythm may remain higher when he/she remains in the state of attention. Otherwise, the tendency of the user s EEG spectra may decrease, if he/she trends toward the state of inattention. Although the change of the user s EEG spectra in theta rhythm is not precisely correlated to the change of the user s state, the change tendency of EEG spectra can still provide a reference index for the user s state. The time-series diagram of multimedia control is shown in Figure 4b. In order to estimate the tendency of EEG spectra in theta rhythm, the averaged EEG Index for the last three minutes is calculated. (a) EEG in Fz, Fp1, Fp2 Pre-processing Calculate EEG spectra in theta, alpha and beta rhythms (b) Begin playing music Calculate normalize EEG spectra in theta rhythm NEEG Fz-T, NEEG Fp1-T, NEEG Fp2-T Calculate EEG Index Calculate the averaged EEG Index and decide the next music type Play music (5-10 minutes) EEG Index (k) Play music 10 seconds : EEG Index (k-17) 10 seconds 10 seconds EEG Index (k-1) 3 minutes before the end of music Figure 4. (a) Flowchart of EEG feature extraction algorithm, and (b) time-series diagram of multimedia control.

Sensors 2015, 15 5524 4. Experiment Designs 4.1. Experiment Design for Effect of Selecting Music Type on Cognitive State Before music biofeedback, the effect of selecting music type on cognitive state has to be first investigated. Defining a precise music recommendation rule which matches everyone s requirement is difficult because of differences in cultures, backgrounds, and personalities. Several previous studies attempted to conduct a practical approach to recommend suitable music for the users. Shan et al. proposed using the user s psychology, such as emotions, as the music selection rule because selecting suitable music can enhance the both the psychological and physiological response of the listeners [18]. Levitin and McGill suggested using the specific features of music, such as tempo, rhythm, melody, or the preference, as the music selection rule in different situations [19]. In this study, the preference is used as the music selection factor. Two predefined music selections, such as high focus and piano concerto K488, and a self-selected (SS) musical piece were used in this experiment. Here, high focus is usually composed for brain wave therapy, and K488, composed by Mozart, is the most used concerto in previous studies [20,21]. In this experiment, the preference rate for different music and the self-rating cognitive state level after listening different music were investigated. A total of 28 participants, aged from 18 to 32 years old, attended this experiment. Before the experiment, a staff instructed the participants to choose a favorite piece of music for this test and answer the self-rating cognitive state questionnaire to record the initial cognitive state. The participant has to rate the preference scale for the three music pieces. In the experiment, three types of music piece (high focus, K488, and self-selected music) were tested individually for every participant, and the time duration of these music piece are about 5 min. The participant s EEG signal was recorded continuously during the entire experimental procedure in a soundproof room that minimized the influence of background noise. When the music piece was over, the participants were instructed to answer the self-rating cognitive state questionnaire again. Here, according to the definition of preference level in continuous digital response interface (CDRI), the preference level for music was rated from 0 to 256. The higher value of preference level denotes more positive responses for the participant. The attention state level was rated from 0 to10 (0: No attention at all, 10: Maximum attention). One-way ANOVA was used to test the significant difference between different music type, and the significance was set at p < 0.05. 4.2. Experiment Design for Effect of Music Biofeedback In this experiment, the effect of real-time music biofeedback was examined. Here, a total of 28 participants attended this experiment. The participants were also instructed to rate the preference level for three music types (high focus, K488, and self-selected music). The most preferred music was set as type1 music, the least preferred music was set to type 3, and the neutral music was set as type 2 music. Here, the aim of multimedia control criterion was set to enhance the participant s attention. Under the assumption of that the higher preference-level music can effectively evoke the user s attention, the preferred music will be selected when the cognitive status of the participant becomes relatively inattentive. Therefore, the multimedia control criterion was set as follows: (a) select type 1 music as the next piece when the averaged EEGIndex decreases over 5% of the previous averaged EEGIndex; (b) select type 3 music as the next piece when the averaged EEGIndex increases over 5% of

Sensors 2015, 15 5525 the previous averaged EEGIndex; and (c) select type 2 music as the next piece when the change of the averaged EEGIndex is between ±5% of the previous averaged EEGIndex. In this experiment, the initial music was randomly selected. The proposed BCI-based smart multimedia controller was used to monitor the user s real-time EEG continuously during the entire experiment procedure and to select the next musical piece according to the user s EEG feature. The time interval between two music pieces is about 5 s. Moreover, after finishing a music piece, the participant will be instructed to answer the self-rating cognitive state questionnaire again to evaluate the performance of music biofeedback. 5. Results and Discussions 5.1. Effect of Selecting Music Type on Cognitive State Figure 5 shows the averages and standard deviations of the music preference level corresponding to different music types. The symbol ** denotes significance. The experimental result shows that the difference between the preference levels of any two music types is significant. Therefore, for the participants, the preference levels of high focus, K488, and self-selected music are significantly different. Music preference level 200 180 160 140 120 100 80 60 40 20 0 ** ** ** K448 High focus Self-selected Music type Figure 5. Music preference level corresponding to different types of music. Here, ** denotes significance. Next, the effect of listening different music type on the self-rating cognitive state level and EEG spectra in theta rhythm was investigated. Figure 6 shows two experimental results for the time-frequency analysis of EEG signal under different self-rating cognitive state level. The EEG spectra in theta rhythm obviously increases when the self-rating cognitive state level is relatively large. Figure 7 shows the averages and standard deviations of the participants cognitive state level and EEG spectra in theta rhythm for different music types. The experimental result shows that the effect of listening self-selected music on evoking attention is most significant. Moreover, the cognitive state level of the participant can also reflected on the EEG spectra in theta rhythm. When the cognitive state level is relatively large, the EEG spectra in theta rhythm exactly increases. The effect of music type on evoking the participant s attention can also be improved with the increase of the music preference level.

Sensors 2015, 15 5526 Frequency (Hz) Frequency (Hz) 25 20 15 10 5 25 20 15 10 5 Self-rating cognitive state level = 8 5 10 15 20 25 30 Time (second) Self-rating cognitive state level = 3 5 10 15 20 25 30 Time (second) 200 150 100 50 0 200 150 100 50 0 Figure 6. Time-frequency analysis of EEG signal corresponding to different self-rating cognitive state level. Self-rating cognitive state level 10 9 8 7 6 5 4 3 2 1 0 ** ** K448 High focus Self-selected Music type 150 140 130 120 110 100 90 80 70 60 50 EEG spectra in theta rhythm (%) Self-rating cognitive state level Spectra in theta rhythm Figure 7. Self-rating cognitive state level and EEG spectra in theta rhythm corresponding to different music types. Here, ** denotes significance. 5.2. Effect of Music Biofeedback by Using BCI-Based Multimedia Controller Figure 8 shows four randomly selected results for real-time music biofeedback. As our expectation, most of the participants cognitive states trends toward the state of attention, and the tendency of the EEG spectrum in theta rhythm also increased gradually. Experimental results show that about 71.40% of the participants felt their cognitive state significantly trends toward an attentive state, and about 67.86% of the participants EEG spectra in theta rhythm trend to increase. Figure 9 shows the averages

Sensors 2015, 15 5527 and standard deviations of self-rating cognitive state level and EEG spectra in theta rhythm under music biofeedback. Figure 8. Four randomly selected results for real-time music biofeedback. Self-rating cognitive state level 10 9 8 7 6 5 4 3 2 1 0 ** ** ** After 1st music After 2nd music After 3rd music Experimental procedure 150 140 130 120 110 100 90 80 70 60 50 EEG spectra in theta rhythm (%) Self-rating cognitive state level EEG spectra in theta rhythm (%) Figure 9. Self-rating cognitive state level and EEG spectra in theta rhythm under music biofeedback. Here, ** denotes significance. The experimental result shows that, after music biofeedback, the cognitive state level of the participant gradually increases, and the EEG spectra in theta rhythm also trends to increase. Next, the experiment of randomly music selection was also examined, and a total of 20 participants attended this

Sensors 2015, 15 5528 experiment. For randomly music selection, experimental results show that about 45% of the participants cognitive state significantly trends toward the state of attention. Therefore, real-time music biofeedback using the proposed system exactly improves the user s attention state. 3.3. Specification Comparison The specification comparisons between our system and other BCI-based multimedia control systems are listed in Table 1. Shyu et al. proposed a FPGA-based SSVEP BCI multimedia control system [15]. Instead of personal computers, the real-time SSVEP BCI algorithm was implemented in a FPGA board. Here, the user can control multimedia via SSVEP generated from four visual stimuli, which were labeled as four multimedia command symbols. However, both of the above BCI-based multimedia control systems require external visual stimulating devices and active mental command to control multimedia. Unlike the above system, the proposed BCI-based multimedia controller controls multimedia automatically and adaptively according to the user s EEG feature. Moreover, different from the most frequently used bulky EEG machine, the properties of small-volume and wireless communication for the wireless multi-channel EEG acquisition module are more suitable for daily application. Furthermore, a commercial mobile tablet is also used as the multimedia platform. The commercial mobile tablet is small, light, and popular, and this may increase the acceptability for general users. Table 1. Specification comparison between proposed system and other BCI-based multimedia controller. BCI System SSVEP BCI Multimedia Control [15] Proposed BCI-Based Multimedia Controller EEG Signal SSVEP EEG spectra in theta rhythm Transmission RF transmission Bluetooth Power Supply Power line 3.7 V Li Battery Sampling Rate 8 khz 512 Hz Gain 1000 5000 Analog Filter 20 22 Hz 0.1 100 Hz Backend Signal Processing Unit FPGA board Mobile tablet Control Mode Active BCI [22] Passive BCI [22] Multimedia Applications Music Music 6. Conclusions In this study, a novel brain computer interface-based smart multimedia controller was proposed to select music according the user s EEG feature. Unlike other BCI-based multimedia controllers that require the user s active mental command to control multimedia, the proposed system can control multimedia automatically and adaptively according to the user s EEG feature. From the experimental results, the effect of the most preferred music on evoking attention is exactly most significant. By using the approach of real-time music biofeedback, the proposed BCI-based smart multimedia controller can positively improve the user s attention state. Moreover, in this study, the efficiency of selecting music according to the user s state on evoking attention is superior to that of randomly music selection. The concept of modular design is also used in the development of the proposed system. The

Sensors 2015, 15 5529 wireless multi-channel EEG acquisition module can easily communicate with any type of commercial tablet via Bluetooth communication to increase acceptability for a large population of users. Therefore, the design of the BCI-based smart multimedia controller can be viewed as a completely innovative system prototype, and can be applied in different researches of music biofeedback in the future. Acknowledgments This research work was supported in part by the research grants of the Ministry of Science and Technology of Taiwan, Republic of China under grant numbers NSC-101-2218-E-182-002, MOST-103-2221-E-009-035-MY2 and MOST-103-2628-H-182-001-MY2, Chang Gung University under grant number EMRPD1E1691, and Chang Gung Memorial Hospital under grant numbers CMRPD290063 and CMRPD3E0371. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. Author Contributions Kevin C. Tseng provided the mechanical design of the wearable EEG cap and the graphical user interface of the system software. Bor-Shyh Lin and Bor-Shing Lin designed the system hardware and software, and the EEG analysis algorithm. Alice May-Kuen Wong supported the experiment design. Conflicts of Interest The authors declare no conflict of interest. References 1. Riley, P.; Alm, N.; Newell, A. An interactive tool to promote musical creativity in people with dementia. Comput. Hum. Behav. 2009, 25, 599 608. 2. Topo, P.; Mäki, O.; Saarikalle, K.; Clarke, N.; Begley, E.; Cahill, S.; Arenlind, J.; Holthe, T.; Morbey, H.; Hayes, K.; et al. Assessment of a music-based multimedia program for people with dementia. Dementia 2004, 3, 331 350. 3. Pratt, R.R. Art, dance, and music therapy. Phys. Med. Rehabil. Clin. N. Am. 2004, 15, 827 842. 4. Davidson, J.W. The effect of music therapy on mood states in neurological patients: A pilot study. J. Music Ther. 2002, 39, 20 29. 5. Lesiuk, T. The effect of music listening on work performance. Psychol. Music 2005, 33, 173 191. 6. Haake, A.B. Individual music listening in workplace settings: An exploratory survey of offices in the UK. Music. Sci. 2011, 15, 107 129. 7. Cassidy, G.; MacDonald, R. The effects of music choice on task performance: A study of the impact of self-selected and experimenter-selected music on driving game performance and experience. Music. Sci. 2009, 13, 357 386. 8. Yuan, H.; He, B. Brain-computer interfaces using sensorimotor rhythms: Current state and future perspectives. IEEE Trans. Biomed. Eng. 2014, 61, 1425 1435. 9. Gao, S.; Wang, Y.; Gao, X.; Hong, B. Visual and auditory brain-computer interfaces. IEEE Trans. Biomed. Eng. 2014, 61, 1436 1447.

Sensors 2015, 15 5530 10. He, B.; Gao, S.; Yuan, H.; Wolpaw, J. Brain-computer interface. In Neural Engineering, 2nd ed.; Springer: New York, NY, USA, 2013; pp. 87 151. 11. Huang, Y.J.; Wu, C.Y.; Wong, A.M.K.; Lin, B.S. Novel active comb-shaped dry electrode for EEG measurement in hairy site. IEEE Trans. Biomed. Eng. 2014, 99, 1 8. 12. Lin, C.T.; Lin, B.S.; Lin, F.C.; Chang, C.J. Brain computer interface-based smart living environmental auto-adjustment control system in UPnP home networking. IEEE Syst. J. 2014, 8, 363 370. 13. Lin, C.T.; Liao, L.D.; Liu, Y.H.; Wang, I.J.; Lin, B.S.; Chang, J.Y. Novel dry polymer foam electrodes for long-term EEG measurement. IEEE Trans. Biomed. Eng. 2011, 58, 1200 1207. 14. Lin, C.T.; Chang, C.J.; Lin, B.S.; Hung, S.H.; Chao, C.F.; Wang, I.J. A real-time wireless brain computer interface system for drowsiness detection. IEEE Trans. Biomed. Circuits Syst. 2010, 4, 214 222. 15. Shyu, K.K.; Lee, P.L.; Lee, M.H.; Lin, M.H.; Lai, R.J.; Chiu, Y.J. Development of a low-cost FPGA-based SSVEP BCI multimedia control system. IEEE Trans. Biomed. Circuits Syst. 2010, 4, 125 132. 16. Iramina, K.; Matsuda, K.; Ide, J.; Noguchi, Y. Monitoring system of neuronal activity and moving activity without restraint using wireless EEG, NIRS and accelerometer. In Proceedings of the 2010 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES), Kuala Lumpur, Malaysia, 30 November 2 December 2010; pp. 481 484. 17. Ishii, R.; Shinosaki, K.; Ukai, S.; Inouye, T.; Ishihara, T.; Yoshimine, T.; Hirabuki, N.; Asada, H.; Kihara, T.; Robinson, S.E. Medial prefrontal cortex generates frontal midline theta rhythm. Neuroreport 1999, 10, 675 679. 18. Shan, M.K.; Kuo, F.F.; Chiang, M.F.; Lee, S.Y. Emotion-based music recommendation by affinity discovery from film music. Expert Syst. Appl. 2009, 36, 7666 7674. 19. Levitin, D.J.; McGill, J. Life Soundtracks: The Uses of Music in Everyday Life. Available online: www.russballard.com/rbv7-workshop/physics/unit 3 Vibrations/LifeSoundtracks.pdf (accessed on 5 March 2015). 20. Jausovec, N.; Jausovec, K.; Gerlic, I. The influence of Mozart s music on brain activity in the process of learning. Clin. Neurophysiol. 2006, 117, 2703 2714. 21. Thompson, W.F.; Schellenberg, E.G.; Husain, G. Arousal, mood, and the Mozart effect. Psychol. Sci. 2001, 12, 248 251. 22. Zander, T.O.; Kothe, C. Towards passive brain-computer interfaces: Applying brain-computer interface technology to human-machine systems in general. J. Neural Eng. 2011, 8, 1 5. 2015 by the authors; licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/4.0/).