CymaSense: A Real-Time 3D Cymatics- Based Sound Visualisation Tool
|
|
- Helen Nichols
- 5 years ago
- Views:
Transcription
1 CymaSense: A Real-Time 3D Cymatics- Based Sound Visualisation Tool John McGowan J.McGowan@napier.ac.uk Grégory Leplâtre G.Leplatre@napier.ac.uk Iain McGregor I.McGregor@napier.ac.uk Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author. DIS'17 Companion, June 10-14, 2017, Edinburgh, United Kingdom 2017 Copyright is held by the owner/author(s). ACM ISBN /17/06. Abstract What does music look like? Representation of music has taken many forms over time, from musical notation [16], through to random algorithm-based visualisations based on the amplitude of an audio signal [19]. One aspect of music visualisation that has not been widely explored is that of Cymatics. Cymatics are physical impressions of music created in mediums such as water. Current Cymatic visualisations are restricted to 2D imaging, whilst 3D visualisations of music are generally based on arbitrary mapping of audio-visual attributes. This paper looks at the design of CymaSense, an interactive tool based on Cymatics. Author Keywords Autism Spectrum Condition (ASC); Assistive Technologies; Music Therapy; Interactive Audio-Visual; Cymatics. ACM Classification Keywords H.5.2. Information interfaces and presentation: Graphical User Interfaces (GUI); Prototyping; Screen Design; User-Centered Design; Visualization Theory, Concepts and Paradigms. Introduction Sound visualisation takes many forms, which can be organised along a continuum, from pragmatic or functional to artistic [11]. On the functional side, volume unit (VU) meters (see Figure 1) exemplify 270
2 Figure 1: VU meter Figure 2: Cymatic image of sound vibrated through water Figure 3: Chladni plate representations which, though abstract, have become standard. In this case a VU meter provides an informative visualisation of loudness. Most software music players include a visualiser that fall on the artistic side of the continuum. The visualisation is driven by the audio data, but no information about the sound can be inferred from the visuals. Sound visualisation techniques can also be categorized in function of the semantic link between a sound and its visualisation. A recognised categorization is used in Auralisation, the discipline in which information is conveyed through sound: Auditory Icons [5] are linked to what they represent semantically. For example, in a user interface, the action of deleting a file can be represented by the sound of an object thrown in a trashcan. Earcons, on the other hand, involve arbitrary mappings between abstract sounds and what they represent [2]. Their meaning must therefore be learnt. It is difficult to apply the abstract/concrete categorization used in Auralisation to sound visualisation, for practical reasons: common sound analysis techniques used for real-time sound visualisation do not provide any information about the source of the sound. For example, a bird sound can only be represented by the image of a bird if the sound can be identified as being a bird sound. The only data available are generally limited to loudness, pitch and spectral data. Natural Sound Visualisation Audiovisual mappings Devising a natural visual representation of audio signals involves finding perceptually meaningful audiovisual correlates. Research into audiovisual correspondences has identified reliable mappings, such as: size to loudness, vertical position to pitch, visual brightness to pitch, visual repetitiveness to sound dissonance, texture granularity to sound compactness [6][7][13]. What visual objects these parameters should be applied to, for representation of sound, remains an open question. There are countless metaphors and systems, mostly using 2D Graphics, with an increasing number of sound representation using 3D and virtual reality [1]. Cymatics Cymatics are physical impressions of sound created in mediums such as water (Figure 2) or through particulate material on a brass plate [9]. They are the result of diffraction and refraction of sound waves created within the visualising medium [4]. Sound propagates in a spherical manner from its source contrary to typical 2D representations of sound waves. Cymatics until now have been viewed as quasi-3d patterns on the surface of water or on the surface of a Chladni plate (Figure 3). The appeal of Cymatics as a sound visualisation technique is two-fold. Firstly, they present undeniable aesthetic qualities (see Figure 2), which makes them an interesting proposition for artistic visualisation applications. Functionally, Cymatics are unique in that they are concrete representations of a sound. This does not mean, however, that they are necessarily informative. On the one hand, Chladni patterns can make an effective representation of pitch (see vibration patterns of a circular plate vibrating at 2434Hz and 3986Hz on Figure 4 and Figure 5 respectively). On the other hand, the pattern changes resulting from small spectral differences can be quite dramatic and surprising. These are, however, deterministic and are 271
3 Figure 4: Circular plate vibrating at 2434Hz Figure 5: Circular plate vibrating at 3986Hz Figure 6: CymaSense sample output used by some instrument makers to visualise the tonal qualities of their instruments. The aesthetic qualities, combination of predictability and surprise that Cymatic patterns exhibit, as well as the fact that they are physically accurate representations of sounds make them a fascinating sound visualisation paradigm. CymaSense A prototype was developed to experiment with and evaluate the potential of Cymatics-based sound visualisations. CymaSense is an interactive application that generates real-time 3D graphics, inspired by Cymatics, intended to encourage musical exploration through visual feedback. Given the complexity of the equations that describe the propagation of a sound wave in a fluid in 3 dimensions, a simpler Cymatics-inspired approach was chosen: high definition Cymascope images (see Figure 2) of individual frequencies were used as templates for the creation of twelve 3D Cymatic shapes, relating to each of the semitones within a musical octave. Figure 6 represents an image generated by CymaSense. Some of the properties of the Cymascope reference images have been preserved (translucence, symmetry) and new features were added: use of colour and particles emitted by the Cymatic shapes (Figure 7). Mapping The mapping between audio and visual attributes was based on validated associations presented earlier. The novelty of the visualisation paradigm also afforded experimentations with the less obvious aspects of the mapping. Amplitude to scale of Cymatic shape and particle size mapping amplitude to scale is commonly referred to in literature [12][18]. Pitch to Cymatic shape This is consistent with Cymatic shape behaviours observed. The 3D shapes created were inspired by Cymascope reference images (See Figure 7). Pitch to colour lightness - lightness of colour is affected by the relative MIDI note or audio frequency, thus implementing a pitch to lightness relationship, referred to in synesthesia and crossmodality literature [14][22]. The higher the pitch, the lighter the visual component is. This also aids in differentiating the same Cymatic shape over several octaves. Sound brightness to Cymatic shape surface quality colour is commonly associated with timbre in audiovisual mappings, but colour was used for other purposes in the application. Therefore, we decided to experiment with surface qualities as a means of representing the spectral qualities of a sound. The Cymatic shapes generated for a given frequency were modified using a 3D morphing technique as follows: the shapes of bright sounds were made to appear sharper, while dark sounds were transformed to appear more rounded. Implementation The application was implemented in Cycling 74 Max [3] for real-time audio and MIDI processing, and Unity for real-time 3D Graphics generation [20]. The Open Sound Control (OSC) protocol provides the data communication channel between the two environments. Consequently, the implemented CymaSense prototype comprises of: (1) an interface to control audio input 272
4 Figure 7: CymaSense shapes Figure 8: CymaSense user interface Figure 9: Audio input analysis and visual output for single or multi-user interaction (Figure 8); and (2) a separate output screen (Figure 6). The sound analysis process is represented in Figure 9: if a MIDI input is chosen, both MIDI data and audio data are analysed MIDI data can include note number, velocity, note on/off and bend. Audio data is analysed for its fundamental frequency, its partial (or harmonic) frequencies and the amplitude of the signal. Audio spectral analysis is carried out using the iana~ object, which is part of IRCAM s Max Sound Box [8]. The processed audio data is sent via OSC protocol [15] to Unity where it is analysed and triggers appropriate visual output (Figure 6). In addition to the implementation of the mapping presented above, the tool includes several options that allow the user to customize the visual output: for example, the default Cymatic shape and particle colours can be modified by the user. A mode in which random rotations of the shapes are enabled is also available. This is consistent with observations made on real-world Cymatic shapes created in water. Conclusions and Future Work Possible improvements One of the challenges of the implementation is to keep latency to a minimum and maintain a high frame rate. This places limitations on the computation that can be performed per frame. However, being able to generate Cymatic shapes in real-time based on physically correct equations, rather than predefined shapes would make conceptual and aesthetic sense. The mapping between the audio and visual parameters of the system may also be improved. The mapping presented in this paper is currently being evaluated. Applications Potential outlets for CymaSense include use of the tool for musical creativity within commercial environments from projected audio-visual art installations, through to virtual or augmented reality applications. Additionally, CymaSense could be used as a therapeutic tool. Use of multi-sensory environments to improve experiences for sensory impaired users, including those with Autism Spectrum Condition (ASC), have been previously identified [17]. ASC is a lifelong neurodevelopmental condition where people share some of the following features in their diagnosis: difficulties in social communication and interaction; problems in the use of language and verbal communication. Music therapy is considered an effective approach for addressing language and communication skills for children with ASC and provides a non-verbal means of communication [10]. Music therapists use technology within their practice to achieve a greater sense of agency and stimulate the senses of autistic clients. Previous work has demonstrated that use of shared interfaces in a therapeutic setting can enhance communication and social interaction for autistic clients [21]. CymaSense is currently being evaluated as a means of augmenting music therapy for people with ASC in an 8-week study. References 1. Florent Berthaut, Myriam Desainte-Catherine, and Martin Hachet Interacting with 3D Reactive Widgets for Musical Performance. Journal of New Music Research 40, 3:
5 2. Meera M. Blattner, Denise A. Sumikawa, and Robert M. Greenberg Earcons and Icons: Their Structure and Common Design Principles. Human Computer Interaction 4, 1: Cycling Max. Retrieved February 14, 2016 from 4. Cymascope.com Physics :: Cymascope Research. Retrieved December 30, 2015 from l. 5. William W. Gaver Auditory Icons: Using Sound in Computer Interfaces. Human-Computer Interaction 2, 2: Kostas Giannakis A comparative evaluation of auditory-visual mappings for sound visualisation. Organised Sound 11, 3: Kostas Giannakis and Matt Smith Imaging Soundscapes : Identifying Cognitive Associations between Auditory and Visual Dimensions. Musical Imagery: Ircam IRCAM Forumnet Max Sound Box. Retrieved March 20, 2017 from 9. Hans Jenny CYMATICS. The Sciences 8, 7: Ronna S Kaplan and Anita Louise Steele An analysis of music therapy program goals and outcomes for clients with diagnoses on the autism spectrum. Journal of music therapy 42, 1: Robert Kosara Visualization criticism - The missing link between information visualization and art. Proceedings of the International Conference on Information Visualisation, Mats B. Küssner Shape, Drawing and Gesture: Cross-Modal Mappings of Sound and Music Scott D Lipscomb and Eugene M Kim Perceived Match Between Visual Parameters and Auditory Correlates : an Experimental Multimedia Investigation. Proceedings of the 8th International Conference on Music Perception & Cognition: Lawrence E Marks and John B Pierce of Sensory Dimensions. Psychological Bulletin 82, opensoundcontrol.org Introduction to OSC. Retrieved March 17, 2017 from Richard. Rastall The notation of western music : an introduction. Travis and Emery Music Bookshop, London. 17. Kathryn E. Ringland, Rodrigo Zalapa, Megan Neal, Lizbeth Escobedo, Monica Tentori, and Gillian R. Hayes SensoryPaint: A Multimodal Sensory Intervention for Children with Neurodevelopmental Disorders. Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing - UbiComp 14 Adjunct September: S.M. Smith and G.N. Williams A visualization of music. Proceedings. Visualization 97 (Cat. No. 97CB36155), IEEE, SoundSpectrum Inc WhiteCap Screenshots - highly reactive visuals for your tunes. Retrieved December 2, 2015 from hots.html#. 20. Unity Technologies Unity - Game Engine. Retrieved February 14, 2016 from Lilia Villafuerte, Milena Markova, and Sergi Jorda Acquisition of social abilities through musical tangible user interface. Proceedings of the 2012 ACM annual conference extended abstracts on Human Factors in Computing Systems Extended Abstracts - CHI EA 12, Mitchell Whitelaw Synesthesia and Cross- Modality in Contemporary Audiovisuals. The Senses & Society 3, 3:
VISUALIZING AND CONTROLLING SOUND WITH GRAPHICAL INTERFACES
VISUALIZING AND CONTROLLING SOUND WITH GRAPHICAL INTERFACES LIAM O SULLIVAN, FRANK BOLAND Dept. of Electronic & Electrical Engineering, Trinity College Dublin, Dublin 2, Ireland lmosulli@tcd.ie Developments
More informationVuzik: Music Visualization and Creation on an Interactive Surface
Vuzik: Music Visualization and Creation on an Interactive Surface Aura Pon aapon@ucalgary.ca Junko Ichino Graduate School of Information Systems University of Electrocommunications Tokyo, Japan ichino@is.uec.ac.jp
More informationGlasgow eprints Service
Brewster, S.A. and Wright, P.C. and Edwards, A.D.N. (1993) An evaluation of earcons for use in auditory human-computer interfaces. In, Ashlund, S., Eds. Conference on Human Factors in Computing Systems,
More informationAN ARTISTIC TECHNIQUE FOR AUDIO-TO-VIDEO TRANSLATION ON A MUSIC PERCEPTION STUDY
AN ARTISTIC TECHNIQUE FOR AUDIO-TO-VIDEO TRANSLATION ON A MUSIC PERCEPTION STUDY Eugene Mikyung Kim Department of Music Technology, Korea National University of Arts eugene@u.northwestern.edu ABSTRACT
More informationAnimating Timbre - A User Study
Animating Timbre - A User Study Sean Soraghan ROLI Centre for Digital Entertainment sean@roli.com ABSTRACT The visualisation of musical timbre requires an effective mapping strategy. Auditory-visual perceptual
More informationMaking Progress With Sounds - The Design & Evaluation Of An Audio Progress Bar
Making Progress With Sounds - The Design & Evaluation Of An Audio Progress Bar Murray Crease & Stephen Brewster Department of Computing Science, University of Glasgow, Glasgow, UK. Tel.: (+44) 141 339
More informationCommunicating graphical information to blind users using music : the role of context
Loughborough University Institutional Repository Communicating graphical information to blind users using music : the role of context This item was submitted to Loughborough University's Institutional
More informationSupporting Creative Confidence in a Musical Composition Workshop: Sound of Colour
Supporting Creative Confidence in a Musical Composition Workshop: Sound of Colour Jack Davenport Media Innovation Studio University of Central Lancashire Preston, PR1 2HE, UK jwdavenport@uclan.ac.uk Mark
More informationSound visualization through a swarm of fireflies
Sound visualization through a swarm of fireflies Ana Rodrigues, Penousal Machado, Pedro Martins, and Amílcar Cardoso CISUC, Deparment of Informatics Engineering, University of Coimbra, Coimbra, Portugal
More informationScoregram: Displaying Gross Timbre Information from a Score
Scoregram: Displaying Gross Timbre Information from a Score Rodrigo Segnini and Craig Sapp Center for Computer Research in Music and Acoustics (CCRMA), Center for Computer Assisted Research in the Humanities
More informationExploring Choreographers Conceptions of Motion Capture for Full Body Interaction
Exploring Choreographers Conceptions of Motion Capture for Full Body Interaction Marco Gillies, Max Worgan, Hestia Peppe, Will Robinson Department of Computing Goldsmiths, University of London New Cross,
More informationVisual and Aural: Visualization of Harmony in Music with Colour. Bojan Klemenc, Peter Ciuha, Lovro Šubelj and Marko Bajec
Visual and Aural: Visualization of Harmony in Music with Colour Bojan Klemenc, Peter Ciuha, Lovro Šubelj and Marko Bajec Faculty of Computer and Information Science, University of Ljubljana ABSTRACT Music
More informationComputational Parsing of Melody (CPM): Interface Enhancing the Creative Process during the Production of Music
Computational Parsing of Melody (CPM): Interface Enhancing the Creative Process during the Production of Music Andrew Blake and Cathy Grundy University of Westminster Cavendish School of Computer Science
More informationCTP431- Music and Audio Computing Musical Acoustics. Graduate School of Culture Technology KAIST Juhan Nam
CTP431- Music and Audio Computing Musical Acoustics Graduate School of Culture Technology KAIST Juhan Nam 1 Outlines What is sound? Physical view Psychoacoustic view Sound generation Wave equation Wave
More informationMusicGrip: A Writing Instrument for Music Control
MusicGrip: A Writing Instrument for Music Control The MIT Faculty has made this article openly available. Please share how this access benefits you. Your story matters. Citation As Published Publisher
More informationToward a Computationally-Enhanced Acoustic Grand Piano
Toward a Computationally-Enhanced Acoustic Grand Piano Andrew McPherson Electrical & Computer Engineering Drexel University 3141 Chestnut St. Philadelphia, PA 19104 USA apm@drexel.edu Youngmoo Kim Electrical
More informationRubato: Towards the Gamification of Music Pedagogy for Learning Outside of the Classroom
Rubato: Towards the Gamification of Music Pedagogy for Learning Outside of the Classroom Peter Washington Rice University Houston, TX 77005, USA peterwashington@alumni.rice.edu Permission to make digital
More informationThe Effects of Web Site Aesthetics and Shopping Task on Consumer Online Purchasing Behavior
The Effects of Web Site Aesthetics and Shopping Task on Consumer Online Purchasing Behavior Cai, Shun The Logistics Institute - Asia Pacific E3A, Level 3, 7 Engineering Drive 1, Singapore 117574 tlics@nus.edu.sg
More informationPerspectives on the Design of Musical Auditory Interfaces
Perspectives on the Design of Musical Auditory Interfaces Grégory Leplâtre and Stephen A. Brewster Department of Computing Science University of Glasgow Glasgow, UK Tel: (+44) 0141 339 8855 Fax: (+44)
More informationArts, Computers and Artificial Intelligence
Arts, Computers and Artificial Intelligence Sol Neeman School of Technology Johnson and Wales University Providence, RI 02903 Abstract Science and art seem to belong to different cultures. Science and
More informationEMERGENT SOUNDSCAPE COMPOSITION: REFLECTIONS ON VIRTUALITY
EMERGENT SOUNDSCAPE COMPOSITION: REFLECTIONS ON VIRTUALITY by Mark Christopher Brady Bachelor of Science (Honours), University of Cape Town, 1994 THESIS SUBMITTED IN PARTIAL FULFILLMENT OF THE REQUIREMENTS
More informationHarmony, the Union of Music and Art
DOI: http://dx.doi.org/10.14236/ewic/eva2017.32 Harmony, the Union of Music and Art Musical Forms UK www.samamara.com sama@musicalforms.com This paper discusses the creative process explored in the creation
More informationA PSYCHOACOUSTICAL INVESTIGATION INTO THE EFFECT OF WALL MATERIAL ON THE SOUND PRODUCED BY LIP-REED INSTRUMENTS
A PSYCHOACOUSTICAL INVESTIGATION INTO THE EFFECT OF WALL MATERIAL ON THE SOUND PRODUCED BY LIP-REED INSTRUMENTS JW Whitehouse D.D.E.M., The Open University, Milton Keynes, MK7 6AA, United Kingdom DB Sharp
More informationTherapeutic Function of Music Plan Worksheet
Therapeutic Function of Music Plan Worksheet Problem Statement: The client appears to have a strong desire to interact socially with those around him. He both engages and initiates in interactions. However,
More informationSYNTHESIS FROM MUSICAL INSTRUMENT CHARACTER MAPS
Published by Institute of Electrical Engineers (IEE). 1998 IEE, Paul Masri, Nishan Canagarajah Colloquium on "Audio and Music Technology"; November 1998, London. Digest No. 98/470 SYNTHESIS FROM MUSICAL
More informationDAT335 Music Perception and Cognition Cogswell Polytechnical College Spring Week 6 Class Notes
DAT335 Music Perception and Cognition Cogswell Polytechnical College Spring 2009 Week 6 Class Notes Pitch Perception Introduction Pitch may be described as that attribute of auditory sensation in terms
More informationImplementation of an 8-Channel Real-Time Spontaneous-Input Time Expander/Compressor
Implementation of an 8-Channel Real-Time Spontaneous-Input Time Expander/Compressor Introduction: The ability to time stretch and compress acoustical sounds without effecting their pitch has been an attractive
More informationA prototype system for rule-based expressive modifications of audio recordings
International Symposium on Performance Science ISBN 0-00-000000-0 / 000-0-00-000000-0 The Author 2007, Published by the AEC All rights reserved A prototype system for rule-based expressive modifications
More informationHowever, in studies of expressive timing, the aim is to investigate production rather than perception of timing, that is, independently of the listene
Beat Extraction from Expressive Musical Performances Simon Dixon, Werner Goebl and Emilios Cambouropoulos Austrian Research Institute for Artificial Intelligence, Schottengasse 3, A-1010 Vienna, Austria.
More informationReal-time composition of image and sound in the (re)habilitation of children with special needs: a case study of a child with cerebral palsy
Real-time composition of image and sound in the (re)habilitation of children with special needs: a case study of a child with cerebral palsy Abstract Maria Azeredo University of Porto, School of Psychology
More informationCymatic: a real-time tactile-controlled physical modelling musical instrument
19 th INTERNATIONAL CONGRESS ON ACOUSTICS MADRID, 2-7 SEPTEMBER 2007 Cymatic: a real-time tactile-controlled physical modelling musical instrument PACS: 43.75.-z Howard, David M; Murphy, Damian T Audio
More informationAbout Giovanni De Poli. What is Model. Introduction. di Poli: Methodologies for Expressive Modeling of/for Music Performance
Methodologies for Expressiveness Modeling of and for Music Performance by Giovanni De Poli Center of Computational Sonology, Department of Information Engineering, University of Padova, Padova, Italy About
More informationIntimacy and Embodiment: Implications for Art and Technology
Intimacy and Embodiment: Implications for Art and Technology Sidney Fels Dept. of Electrical and Computer Engineering University of British Columbia Vancouver, BC, Canada ssfels@ece.ubc.ca ABSTRACT People
More information24-29 April1993 lnliiirchr9
24-29 April1993 lnliiirchr9 An Evaluation of Earcons for Use in Auditory Human-Computer nterfaces Stephen A. Brewster, Peter C. Wright and Alistair D. N. Edwards Department of Computer Science University
More informationPOST-PROCESSING FIDDLE : A REAL-TIME MULTI-PITCH TRACKING TECHNIQUE USING HARMONIC PARTIAL SUBTRACTION FOR USE WITHIN LIVE PERFORMANCE SYSTEMS
POST-PROCESSING FIDDLE : A REAL-TIME MULTI-PITCH TRACKING TECHNIQUE USING HARMONIC PARTIAL SUBTRACTION FOR USE WITHIN LIVE PERFORMANCE SYSTEMS Andrew N. Robertson, Mark D. Plumbley Centre for Digital Music
More informationLian Loke and Toni Robertson (eds) ISBN:
The Body in Design Workshop at OZCHI 2011 Design, Culture and Interaction, The Australasian Computer Human Interaction Conference, November 28th, Canberra, Australia Lian Loke and Toni Robertson (eds)
More informationTHE SONIC ENHANCEMENT OF GRAPHICAL BUTTONS
THE SONIC ENHANCEMENT OF GRAPHICAL BUTTONS Stephen A. Brewster 1, Peter C. Wright, Alan J. Dix 3 and Alistair D. N. Edwards 1 VTT Information Technology, Department of Computer Science, 3 School of Computing
More informationReciprocal Transformations between Music and Architecture as a Real-Time Supporting Mechanism in Urban Design
Reciprocal Transformations between Music and Architecture as a Real-Time Supporting Mechanism in Urban Design Panagiotis Parthenios 1, Katerina Mania 2, Stefan Petrovski 3 1,2,3 Technical University of
More informationAn interdisciplinary approach to audio effect classification
An interdisciplinary approach to audio effect classification Vincent Verfaille, Catherine Guastavino Caroline Traube, SPCL / CIRMMT, McGill University GSLIS / CIRMMT, McGill University LIAM / OICM, Université
More informationANNOTATING MUSICAL SCORES IN ENP
ANNOTATING MUSICAL SCORES IN ENP Mika Kuuskankare Department of Doctoral Studies in Musical Performance and Research Sibelius Academy Finland mkuuskan@siba.fi Mikael Laurson Centre for Music and Technology
More informationThis full text version, available on TeesRep, is the post-print (final version prior to publication) of:
This full text version, available on TeesRep, is the post-print (final version prior to publication) of: Charles, F. et. al. (2007) 'Affective interactive narrative in the CALLAS Project', 4th international
More informationA Need for Universal Audio Terminologies and Improved Knowledge Transfer to the Consumer
A Need for Universal Audio Terminologies and Improved Knowledge Transfer to the Consumer Rob Toulson Anglia Ruskin University, Cambridge Conference 8-10 September 2006 Edinburgh University Summary Three
More informationThe Rhythm of a Pattern
Bridges Finland Conference Proceedings The Rhythm of a Pattern Sama Mara Artist England Musical Forms www.musicalforms.com E-mail: info@samamara.com Abstract This paper explores the relationship between
More informationEmbodied music cognition and mediation technology
Embodied music cognition and mediation technology Briefly, what it is all about: Embodied music cognition = Experiencing music in relation to our bodies, specifically in relation to body movements, both
More informationOutcome EN4-1A A student: responds to and composes texts for understanding, interpretation, critical analysis, imaginative expression and pleasure
------------------------------------------------------------------------- Building capacity with new syallabuses Teaching visual literacy and multimodal texts English syllabus continuum Stages 3 to 5 Outcome
More informationMusical Acoustics Lecture 15 Pitch & Frequency (Psycho-Acoustics)
1 Musical Acoustics Lecture 15 Pitch & Frequency (Psycho-Acoustics) Pitch Pitch is a subjective characteristic of sound Some listeners even assign pitch differently depending upon whether the sound was
More informationSpectral Sounds Summary
Marco Nicoli colini coli Emmanuel Emma manuel Thibault ma bault ult Spectral Sounds 27 1 Summary Y they listen to music on dozens of devices, but also because a number of them play musical instruments
More informationJam Tomorrow: Collaborative Music Generation in Croquet Using OpenAL
Jam Tomorrow: Collaborative Music Generation in Croquet Using OpenAL Florian Thalmann thalmann@students.unibe.ch Markus Gaelli gaelli@iam.unibe.ch Institute of Computer Science and Applied Mathematics,
More informationThe Tone Height of Multiharmonic Sounds. Introduction
Music-Perception Winter 1990, Vol. 8, No. 2, 203-214 I990 BY THE REGENTS OF THE UNIVERSITY OF CALIFORNIA The Tone Height of Multiharmonic Sounds ROY D. PATTERSON MRC Applied Psychology Unit, Cambridge,
More informationAcoustic Instrument Message Specification
Acoustic Instrument Message Specification v 0.4 Proposal June 15, 2014 Keith McMillen Instruments BEAM Foundation Created by: Keith McMillen - keith@beamfoundation.org With contributions from : Barry Threw
More informationAn Integrated Music Chromaticism Model
An Integrated Music Chromaticism Model DIONYSIOS POLITIS and DIMITRIOS MARGOUNAKIS Dept. of Informatics, School of Sciences Aristotle University of Thessaloniki University Campus, Thessaloniki, GR-541
More informationCSC475 Music Information Retrieval
CSC475 Music Information Retrieval Monophonic pitch extraction George Tzanetakis University of Victoria 2014 G. Tzanetakis 1 / 32 Table of Contents I 1 Motivation and Terminology 2 Psychacoustics 3 F0
More informationAfter Direct Manipulation - Direct Sonification
After Direct Manipulation - Direct Sonification Mikael Fernström, Caolan McNamara Interaction Design Centre, University of Limerick Ireland Abstract The effectiveness of providing multiple-stream audio
More informationCTP 431 Music and Audio Computing. Basic Acoustics. Graduate School of Culture Technology (GSCT) Juhan Nam
CTP 431 Music and Audio Computing Basic Acoustics Graduate School of Culture Technology (GSCT) Juhan Nam 1 Outlines What is sound? Generation Propagation Reception Sound properties Loudness Pitch Timbre
More informationImplementation of a Ten-Tone Equal Temperament System
Proceedings of the National Conference On Undergraduate Research (NCUR) 2014 University of Kentucky, Lexington, KY April 3-5, 2014 Implementation of a Ten-Tone Equal Temperament System Andrew Gula Music
More informationAnalysis of local and global timing and pitch change in ordinary
Alma Mater Studiorum University of Bologna, August -6 6 Analysis of local and global timing and pitch change in ordinary melodies Roger Watt Dept. of Psychology, University of Stirling, Scotland r.j.watt@stirling.ac.uk
More informationPerception and Sound Design
Centrale Nantes Perception and Sound Design ENGINEERING PROGRAMME PROFESSIONAL OPTION EXPERIMENTAL METHODOLOGY IN PSYCHOLOGY To present the experimental method for the study of human auditory perception
More informationAalborg Universitet. Flag beat Trento, Stefano; Serafin, Stefania. Published in: New Interfaces for Musical Expression (NIME 2013)
Aalborg Universitet Flag beat Trento, Stefano; Serafin, Stefania Published in: New Interfaces for Musical Expression (NIME 2013) Publication date: 2013 Document Version Early version, also known as pre-print
More informationMEMORY & TIMBRE MEMT 463
MEMORY & TIMBRE MEMT 463 TIMBRE, LOUDNESS, AND MELODY SEGREGATION Purpose: Effect of three parameters on segregating 4-note melody among distraction notes. Target melody and distractor melody utilized.
More informationMusic in Practice SAS 2015
Sample unit of work Contemporary music The sample unit of work provides teaching strategies and learning experiences that facilitate students demonstration of the dimensions and objectives of Music in
More informationCalifornia Content Standard Alignment: Hoopoe Teaching Stories: Visual Arts Grades Nine Twelve Proficient* DENDE MARO: THE GOLDEN PRINCE
Proficient* *The proficient level of achievement for students in grades nine through twelve can be attained at the end of one year of high school study within the discipline of the visual arts after the
More informationYARMI: an Augmented Reality Musical Instrument
YARMI: an Augmented Reality Musical Instrument Tomás Laurenzo Ernesto Rodríguez Universidad de la República Herrera y Reissig 565, 11300 Montevideo, Uruguay. laurenzo, erodrig, jfcastro@fing.edu.uy Juan
More informationOpening musical creativity to non-musicians
Opening musical creativity to non-musicians Fabio Morreale Experiential Music Lab Department of Information Engineering and Computer Science University of Trento, Italy Abstract. This paper gives an overview
More informationNext Generation Software Solution for Sound Engineering
Next Generation Software Solution for Sound Engineering HEARING IS A FASCINATING SENSATION ArtemiS SUITE ArtemiS SUITE Binaural Recording Analysis Playback Troubleshooting Multichannel Soundscape ArtemiS
More information1 Overview. 1.1 Nominal Project Requirements
15-323/15-623 Spring 2018 Project 5. Real-Time Performance Interim Report Due: April 12 Preview Due: April 26-27 Concert: April 29 (afternoon) Report Due: May 2 1 Overview In this group or solo project,
More informationMusic for Alto Saxophone & Computer
Music for Alto Saxophone & Computer by Cort Lippe 1997 for Stephen Duke 1997 Cort Lippe All International Rights Reserved Performance Notes There are four classes of multiphonics in section III. The performer
More informationinter.noise 2000 The 29th International Congress and Exhibition on Noise Control Engineering August 2000, Nice, FRANCE
Copyright SFA - InterNoise 2000 1 inter.noise 2000 The 29th International Congress and Exhibition on Noise Control Engineering 27-30 August 2000, Nice, FRANCE I-INCE Classification: 7.9 THE FUTURE OF SOUND
More informationSing a Song of Technology! Mary Ellen Pinzino (Association for Technology in Music Instruction 2003)
Sing a Song of Technology! Mary Ellen Pinzino (Association for Technology in Music Instruction 2003) The Come Children Sing Institute SONG LIBRARY is a new integrated multimedia software tool for Music
More informationA System for Generating Real-Time Visual Meaning for Live Indian Drumming
A System for Generating Real-Time Visual Meaning for Live Indian Drumming Philip Davidson 1 Ajay Kapur 12 Perry Cook 1 philipd@princeton.edu akapur@princeton.edu prc@princeton.edu Department of Computer
More informationCymatics Chladni Plate
Cymatics Chladni Plate Flow Visualization MCEN 4228/5228 Date 3/15/10 Group Project 1 Josh Stockwell Levey Tran Ilya Lisenker For our first group project we decided to create an experiment allowing us
More informationInstrument Recognition in Polyphonic Mixtures Using Spectral Envelopes
Instrument Recognition in Polyphonic Mixtures Using Spectral Envelopes hello Jay Biernat Third author University of Rochester University of Rochester Affiliation3 words jbiernat@ur.rochester.edu author3@ismir.edu
More information& Ψ. study guide. Music Psychology ... A guide for preparing to take the qualifying examination in music psychology.
& Ψ study guide Music Psychology.......... A guide for preparing to take the qualifying examination in music psychology. Music Psychology Study Guide In preparation for the qualifying examination in music
More informationA Perceptually Motivated Approach to Timbre Representation and Visualisation. Sean Soraghan
A Perceptually Motivated Approach to Timbre Representation and Visualisation Sean Soraghan A dissertation submitted in partial fulllment of the requirements for the degree of Engineering Doctorate Industrial
More informationTHE EFFECT OF EXPERTISE IN EVALUATING EMOTIONS IN MUSIC
THE EFFECT OF EXPERTISE IN EVALUATING EMOTIONS IN MUSIC Fabio Morreale, Raul Masu, Antonella De Angeli, Patrizio Fava Department of Information Engineering and Computer Science, University Of Trento, Italy
More informationHearing Loss and Sarcasm: The Problem is Conceptual NOT Perceptual
Hearing Loss and Sarcasm: The Problem is Conceptual NOT Perceptual Individuals with hearing loss often have difficulty detecting and/or interpreting sarcasm. These difficulties can be as severe as they
More informationDEMENTIA CARE CONFERENCE 2014
DEMENTIA CARE CONFERENCE 2014 My background Music Therapist for 24 years. Practiced in Vancouver, Halifax and here. Currently private practice Accessible Music Therapy. my practice includes seniors, adults
More informationA Basic Study on the Conversion of Sound into Color Image using both Pitch and Energy
International Journal of Fuzzy Logic and Intelligent Systems, vol. 2, no. 2, June 202, pp. 0-07 http://dx.doi.org/0.539/ijfis.202.2.2.0 pissn 598-2645 eissn 2093-744X A Basic Study on the Conversion of
More informationConsonance perception of complex-tone dyads and chords
Downloaded from orbit.dtu.dk on: Nov 24, 28 Consonance perception of complex-tone dyads and chords Rasmussen, Marc; Santurette, Sébastien; MacDonald, Ewen Published in: Proceedings of Forum Acusticum Publication
More informationAnalysis, Synthesis, and Perception of Musical Sounds
Analysis, Synthesis, and Perception of Musical Sounds The Sound of Music James W. Beauchamp Editor University of Illinois at Urbana, USA 4y Springer Contents Preface Acknowledgments vii xv 1. Analysis
More informationMAutoPitch. Presets button. Left arrow button. Right arrow button. Randomize button. Save button. Panic button. Settings button
MAutoPitch Presets button Presets button shows a window with all available presets. A preset can be loaded from the preset window by double-clicking on it, using the arrow buttons or by using a combination
More informationUNIVERSITY OF DUBLIN TRINITY COLLEGE
UNIVERSITY OF DUBLIN TRINITY COLLEGE FACULTY OF ENGINEERING & SYSTEMS SCIENCES School of Engineering and SCHOOL OF MUSIC Postgraduate Diploma in Music and Media Technologies Hilary Term 31 st January 2005
More informationITU-T Y Functional framework and capabilities of the Internet of things
I n t e r n a t i o n a l T e l e c o m m u n i c a t i o n U n i o n ITU-T Y.2068 TELECOMMUNICATION STANDARDIZATION SECTOR OF ITU (03/2015) SERIES Y: GLOBAL INFORMATION INFRASTRUCTURE, INTERNET PROTOCOL
More informationApproaching Aesthetics on User Interface and Interaction Design
Approaching Aesthetics on User Interface and Interaction Design Chen Wang* Kochi University of Technology Kochi, Japan i@wangchen0413.cn Sayan Sarcar University of Tsukuba, Japan sayans@slis.tsukuba.ac.jp
More informationVisual Arts Colorado Sample Graduation Competencies and Evidence Outcomes
Visual Arts Colorado Sample Graduation Competencies and Evidence Outcomes Visual Arts Graduation Competency 1 Recognize, articulate, and debate that the visual arts are a means for expression and meaning
More informationEssentials Skills for Music 1 st Quarter
1 st Quarter Kindergarten I can match 2 pitch melodies. I can maintain a steady beat. I can interpret rhythm patterns using iconic notation. I can recognize quarter notes and quarter rests by sound. I
More informationSecond Grade: National Visual Arts Core Standards
Second Grade: National Visual Arts Core Standards Connecting #VA:Cn10.1 Process Component: Interpret Anchor Standard: Synthesize and relate knowledge and personal experiences to make art. Enduring Understanding:
More informationGLOSSARY for National Core Arts: Visual Arts STANDARDS
GLOSSARY for National Core Arts: Visual Arts STANDARDS Visual Arts, as defined by the National Art Education Association, include the traditional fine arts, such as, drawing, painting, printmaking, photography,
More informationConfluence of Techné and Musical Thought: 3D-Composer, a Software for Micro- Composition
Ivan Zavada Confluence of Techné and Musical Thought: 3D-Composer, a Software for Micro- Composition EMS08 Electroacoacoustic Music Studies Network International Conference 3-7 juin 2008 (Paris) - INA-GRM
More informationTopic 10. Multi-pitch Analysis
Topic 10 Multi-pitch Analysis What is pitch? Common elements of music are pitch, rhythm, dynamics, and the sonic qualities of timbre and texture. An auditory perceptual attribute in terms of which sounds
More informationExpressive performance in music: Mapping acoustic cues onto facial expressions
International Symposium on Performance Science ISBN 978-94-90306-02-1 The Author 2011, Published by the AEC All rights reserved Expressive performance in music: Mapping acoustic cues onto facial expressions
More informationEnhancing Music Maps
Enhancing Music Maps Jakob Frank Vienna University of Technology, Vienna, Austria http://www.ifs.tuwien.ac.at/mir frank@ifs.tuwien.ac.at Abstract. Private as well as commercial music collections keep growing
More informationExpressive information
Expressive information 1. Emotions 2. Laban Effort space (gestures) 3. Kinestetic space (music performance) 4. Performance worm 5. Action based metaphor 1 Motivations " In human communication, two channels
More informationMusic Representations
Lecture Music Processing Music Representations Meinard Müller International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de Book: Fundamentals of Music Processing Meinard Müller Fundamentals
More informationHidden in Plain Sight
Hidden in Plain Sight Case study of a music therapist and a music educator in a public school Jacqueline C. Smith Background Brian, the K-12 Music Coordinator, invited me to his school district to help
More informationAuditory Interfaces A Design Platform
Auditory Interfaces A Design Platform Dan Gärdenfors gardenfors@hotmail.com 2001 Contents 1 Introduction 2 Background 2.1. Why Auditory Interfaces? 2.2 Hearing and Vision 2.3 The Potentials of Auditory
More informationThe CAITLIN Auralization System: Hierarchical Leitmotif Design as a Clue to Program Comprehension
The CAITLIN Auralization System: Hierarchical Leitmotif Design as a Clue to Program Comprehension James L. Alty LUTCHI Research Centre Department of Computer Studies Loughborough University Loughborough
More informationESP: Expression Synthesis Project
ESP: Expression Synthesis Project 1. Research Team Project Leader: Other Faculty: Graduate Students: Undergraduate Students: Prof. Elaine Chew, Industrial and Systems Engineering Prof. Alexandre R.J. François,
More informationLaugh when you re winning
Laugh when you re winning Harry Griffin for the ILHAIRE Consortium 26 July, 2013 ILHAIRE Laughter databases Laugh when you re winning project Concept & Design Architecture Multimodal analysis Overview
More informationSHORT TERM PITCH MEMORY IN WESTERN vs. OTHER EQUAL TEMPERAMENT TUNING SYSTEMS
SHORT TERM PITCH MEMORY IN WESTERN vs. OTHER EQUAL TEMPERAMENT TUNING SYSTEMS Areti Andreopoulou Music and Audio Research Laboratory New York University, New York, USA aa1510@nyu.edu Morwaread Farbood
More informationPerceptual Considerations in Designing and Fitting Hearing Aids for Music Published on Friday, 14 March :01
Perceptual Considerations in Designing and Fitting Hearing Aids for Music Published on Friday, 14 March 2008 11:01 The components of music shed light on important aspects of hearing perception. To make
More information