J. HARRY WHALLEY. Mixed Quartet, NGS and EEG 2012

Transcription

1 J HARRY WHALLEY CLASP TOGETHER (BETA) Mixed Quartet, NGS and EEG 202

2 Architecture: The diagrams on these ages demonstrate the architecture of the technology for Clas Together (beta) NGS - Neurogranular Samler (Audio Unit Plugin) EEG - Electroencehalograhy Headset (Emotiv EPOC) Performers Max/MSP atch Front of House Sound inut NGS Inut Buffer NGS Parameters EEG signals (emotiv eoc) Detection Suites Affective States Sound outut Facial Exressions Sound Samles Background: EEG, or Electroencehalograhy, is the caacity to detect brain activity and is all but ne, dating back to 929 and the efforts of Hans Berger The electric discharge roduced by millions of firing synases roduces a faint electrical current that can be detected by electrodes ositioned on the scal While rimarily used to study brain functions or anomalies, during the last decades EEG has been at the centre of scientific research on Brain Comuter Interfaces (BCI) and the scoe and use of them has exanded; the 'Emotiv EPOC' headset used in this iece as develoed for use in comuter games, for examle Using a Bluetooth connection to a comuter running the Emotiv SDK Affectiv suite, the signals are converted into a ercentage value in one of the categories; engagement, instantaneous excitement, long term excitement or mediation These in turn drive the amount of activity in the NGS by continuously changing its arameters Facial exressions and head s (Gyroscoe) trigger re-recorded samles of the ensemble The iece also fits in the ider context of artificial intelligence and creativity as exlored by Douglas Hofstadter

3 Audio Iinterface / Mixer Wifi connection Lato running Max/Ms NGS Patch Lato running Emotiv Eoc Affective Suite Bluetooth connection Eoc headset Aux Send/ Return Bass Clarinet Trombone Violin C Bass Stage Box Mixer Front of House Technical Requirements: Lato running 'Max/MSP' ith 'NGS Audio Unit' (au) installed Audio interface ith to analogue I/O and fast stable drivers (eg RME) Small Mixer (2 in, aux) Lato running Emotiv EPOC 'Affective suite' and 'Mind your OSCs' Emotiv EPOC bluetooth headset Front of House (FOH) Mixer (8in, stereo 2 aux send/return, one re-fade (to NGS) one ost-fade(to FX))) Aroriate microhone(s) for each instrument Three Technician/Engineers - Fit EEG, connect to 'Affective Suite' 2- Activate / Deactivate NGS, Activate 'Gesture samles' -Front of House sound engineer The Max/MSP Patch, Samles and NGS au can be found on the data DVD The Emotiv EPOC softare comes ith the EPOC headset

4 First erformance by the 'Red Note Ensemble' in the Inventor Comoser Co-action concert in the Jam House, Edinburgh, May 9th 202 Featuring Pete Furniss on Bass Clarinet My thanks to Panos Mavros for his hel and his coding of the Max/MSP Patch used in this iece, to John Matthias et al, for alloing me to use their Neurogranular Samler and to Lauren Hayes, for organising this roject Performance elements ere develoed ith Pete Furniss and Panos Mavros Instrumentation:* Bb Bass Clarinet Tenor Trombone Violin Contrabass * All instruments should have microhones for sound reinforcement / NGS inut TRANSPOSED SCORE Bb Bass Clarinet sounds a major ninth loer than notated Performance Notes: Bass Clarinet The EPOC EEG headset ill detect your overall affective state and facial and head s Your affective state controls the amount of activity in the 'Neurogranular Samler' and as a result the amount extras sound in the form of 'grains' coming from the instrument The quick changing of tasks (imrovise - sight read - grahic notion) is designed to insure that the NGS receives a high level of activation The facial and head s ill trigger re-recorded samles of the ensemble Technique instructions in Italics indicate either mental erformance instructions or dramaturgical / triggering s The timing is marked by donard arros above the staff Interret '' instructions to be any tye of head from the list belo, unless secified exactly Movement Head Left / Right Head U / Don Eyebros U Furro Samle Triggered - Double Bass - Trombone - Violin - Clarinet Interret 'grahic notation' freely Do not learn measures 4-5, and lay as accurately a ossible Notation: - Highest ossible note 'Doodle Tongue' - Use the mouthed sounds "da-dle, dee-dle", but otherise the same technique as double-tonguing should be used [] - Box above a note: Create multihonic based on the given itch Boxed Text - Instructions to technician regarding Max/MSP Patch

5 Bass Clarinet in Bb B Cl 9 Rubato (c q = 2) Assisted donning of headset 4 b f sfz m ff Allegro non troo (c q=20) CLASP TOGETHER (BETA) # b b b b START NGS Think about something unrealted and lay from memory until b2 (GP) Con sordino, 'doodle tongue' () Firece free Imrovisation b J HARRY WHALLEY ü Reeat until headset is on and orking b b b n (2) b () b (4) sul ont, trem (5) gliss izz b b B Cl 24 b b b b b b b b (6) (7) (8) (9) (0) () (2) b b b b B Cl 29 b b b () (4) b b b U (5) (6) b GP (ait for NGS to decay somehat) U U U Coyright 20 by J Harry Whalley All rights reserved

6 B Cl 2 (A Temo) b n b b n J m ff sfz m Ord arco izz b b b n j n b b b b B Cl B Cl 4 U 49 ff m ff ACTIVATE GESUTRE SAMPLES Lunga GP All: move aay from instruments Demonstrate all s U 4 (A Temo) multihonic m f m U b sul ont (sul ont) J U b Raise Eyebros Quick head mov Left j b gliss harm f m (ord) j # j j # j j # j b b b n n b b Ord j sfz sffz sffz n n b b sffz Sul Pont gliss harm B Cl 58 head j # j # # j # j j ff f m b b sfz sfz arco izz J b n b gliss harm sfz o m gliss gliss head gliss harm

7 B Cl B Cl 65 7 # j j # # # f f f sfz o m 5 # J ff sf m f # b b J b b sf m f b b j n sf f # n n # n # b b b m gliss harm # m con sordino m b b B Cl 79 # J sf Become Still - Calm thoughts Nat b b b J J # # J arco, sul ont,trem gliss harm f m f b J J # # n# n# sf f m f J m f B Cl 88 GP 6 U GP GP 2 # # U j # # f f m f sub f f f n U j # # n n# n# f f m f sub f f f U j f f m f sub f f f

8 B Cl B Cl 99 f f f f f f f f 0 f f f ff 7 Interret freely í R # ~~~~~~~~í í~~~~~~~~ Furro í í # # # b Imrovise Sul Pont b Head nods gliss harm con sordino Angry thoughts: Crunch Face: Do not learn!^ j j b b Ù b  b # J n ff fff m j b j f f j b j n f f gliss harm R R B Cl B Cl 5 20 n j b - 7 m b R # J R f Head shakes nb nb nb n ff fff f sf sf sf sf izz n R R b R r b b n J Imrovise freely n R R b R n R R R b R R b b b b r r b r r R R b R R n n n n n R R b R R b interret freely ~ # R ÍÍÍÍ R~ R J 4 b J gliss harm ff J R Raise Eyebros b J J n r r r R j b j #

9 B Cl 28 Interret Head nods í íí í íííí í í flz 7 Imrovise b fff b J # b J J sf f sub f b j b j # # n sf f b B Cl 5 j j Imrovise fff f f f ff fff f f f ff fff arco b f f ff fff 8 STOP AUDIO INPUT TO NGS B Cl 42 Clear thoughts ' meditate' Make NGS FADE until silent U o U U U