Temporal Envelope and Periodicity Cues on Musical Pitch Discrimination with Acoustic Simulation of Cochlear Implant
|
|
- Erica Bridges
- 5 years ago
- Views:
Transcription
1 Temporal Envelope and Periodicity Cues on Musical Pitch Discrimination with Acoustic Simulation of Cochlear Implant Lichuan Ping 1, 2, Meng Yuan 1, Qinglin Meng 1, 2 and Haihong Feng 1 1 Shanghai Acoustics Laboratory, Institute of Acoustics, Chinese Academy of Sciences, Shanghai, , China 2 Graduate University of Chinese Academy of Sciences, Beijing, , China pinglichuan@gmailcom Abstract The present study investigated musical pitch discrimination with acoustic simulation of cochlear implant A 4-channel noise-excited vocoder was used to simulate the signal processing of cochlear implants Eight normal-hearing subjects participated in this study Psychoacoustic experiments on pitch-direction discrimination test were carried out to examine the ability of detecting pitch-change direction Stimuli from four instruments (clarinet, trumpet, piano and violin) were utilized Experimental results showed that temporal envelope and periodicity information was important for musical pitch discrimination when the spectral information was limited 1 Introduction Cochlear implant (CI) has been widely used to restore hearing of patients with severe to profound hearing loss Although good speech understanding has been achieved with state-of-the-art CI devices in quiet environment, most of CI users still cannot understand speech in noise, perceive tone and music sounds [1] Many CI users describe music as an unpleasant and noisy sound Pitch and timbre are important features of music The discrimination of pitch-change direction is useful for music perception It reflects the ability of determining whether the pitch is changing higher or lower The perception of timbre is important for distinguishing different types of sound production, such as voices or musical instruments Previous studies demonstrated that the identification of pitch-change direction and the recognition of instrument timbre were much less accurate with CI users, compared with normal-hearing (NH) listeners [2-5] Gfeller et al tested 49 CI subjects with synthesized piano tone They found that the difference limens (DLs) of pitch-direction discrimination (PDD) were ranged from 1 semitone to 2 octaves (24 semitones), with the mean performance of 756 semitones In a recent study by Kang, 42 CI users were tested with synthesized complex tones [2] The DLs were ranged from 1 to 8 semitones, with the mean score of 3 semitones However, the DLs of PDD was approximately about 1 semitone for NH listeners [3-4] As for timbre, Gfeller et al tested CI users with an open-set timbre recognition task Their experimental results showed that the recognition performance was 47% correct [5] In Kang s study, timbre recognition was about 453% correct in a close-set task [4] Drennan and Rubinstein suggested that the poor pitch perception and timbre identification performance of CI users was probably caused by the limited spectral and temporal information delivered by the CI system [6] In current commercial CI devices, the signal processing strategies are all based on the vocodercentric method [7] In this method, the broad-band signal is filtered into several frequency bands (depending on the number of electrodes) The slowvarying envelope of the band-limited signal is extracted from each band and is used to modulate a fixed rate pulse carrier In such vocoder-centric signal processing strategies, spectral resolution is limited by the number of available electrodes (12-22) The temporal resolution is limited by the cutoff frequency (typically with 200 or 400 Hz) of the extracted envelope in each band Rosen proposed to divide the temporal information into three categories, depending on the rate of amplitude fluctuation: temporal envelope (below 50 Hz), periodicity (50 to 500 Hz), and fine structure (above 500 Hz) [8] In other studies, the temporal cues have been roughly divided into two parts: the temporal envelope and periodicity (2 to 500 Hz) component (TEPC), and the temporal fine structure (500 to Hz) component (TFSC) [9] /10/$ IEEE 710 ICALIP2010
2 Many studies have been carried out to investigate the importance of temporal information to speech recognition [8-12] It was shown that TEPC was important to tonal and non-tonal language perception when the spectral information was limited [10] However, to our knowledge, there has been no study investigating the effect of TEPC to pitch or timbre perception The aim of this study was to investigate the effect of TEPC on musical pitch perception A noiseexcited vocoder was used to simulate the standard CI processing strategy, continuous Interleaved Sampling (CIS) strategy [12] Psychoacoustic experiment was manipulated to NH subjects DLs of the stimuli from different instruments and base frequencies were compared The effect of TEPC on musical pitch discrimination was analyzed 2 Experiment Design 21 Subjects Eight subjects participated in the experiment aging from 22 to 28 (Mean = years; SD = 25 years) None of them had hearing disease before Their audiometric thresholds were better than 20 db HL at octave frequencies from 125 and 8000 Hz in both ears 22 Test materials The test stimuli included four instruments (clarinet, trumpet, piano and violin), representing different instrumental families They were synthesized by a professional MIDI-Keyboard The duration of all the stimuli was 350 ms with 25 ms on- and off-ramp, respectively Before signal processing, the intensity of all stimuli were balanced with (Root-Mean- Square) equalization 23 Signal processing A 4-channel noise-excited vocoder was used to simulate the CI sound processing [9-11] As shown in Figure 2, the original stimuli were first pre-amplified for spectral equalization by a 1st-order high-pass Butterworth filter with cutoff frequency of 1 khz Then the signal was band-pass filtered into 4 contiguous frequency channels (4th-order Butterworth filters) between 125 and 4000 Hz The filters were designed ns using Greenwood function [12] To avoid differences in group delay between filters, zero-phase digital filtering was performed The TEPCs were extracted by half-wave rectification and low-pass filtering (using a 4nd-order Butterworth filter) at 500 Hz The TEPCs were then used to amplitude modulate independent white-noise carriers Finally, acoustic stimuli were generated by combining the modulated signals from each band The acoustic simulation was programmed with MATLAB 24 Procedure The PDD test was implemented using a twoalternative forced-choice task (2AFC) with 3-up, 1- down adaptive tracking [13] In each presentation, one tone with the reference F0 (base frequency) and one target tone with higher F0 were played in random order The F0 difference between the reference tone and the target tone was determined by the adaptive step, the minimum adaptive step was 1 semitone The DLs for each reference tone were calculated by the mean of the last 6 reversals (totally 12 reversals) for each trial Two tones (D#2 at 7778Hz and D#4 at Hz) were used as reference tones to test the effect of base frequency Four instruments (trumpet, clarinet, violin and piano) were chosen to test the timbre effect The stimuli were played to the listeners through a Sennheiser HD650 headphone The presented loudness levels were then randomized in a range of 65 to 70dB SPL, to minimize the effect of loudness cue on pitch discrimination The experiment was carried out in a sound-proof booth A graphical user interface (GUI) in the laptop was used The test conditions included base frequency and timbre The test order of all the conditions was randomized across subjects 3 Result For each condition, the DLs of PDD test were evaluated over all subjects The best score that could be achieved was one semitone, since it was the minimal adaptive step Figure 3 show the DLs of PDD test (the black line in each box represents the median values of DLs for different base frequencies and timbres) The results for different timbres are displayed separately The mean DL under the piano with D #2 condition was consistently higher than other conditio 711
3 BPF1 BPF1 Input BPF1 Output White Noise Carrier Figure 2 Block diagram of acoustic simulation of CI sound processing NH subjects were found to be the low boundary (1 semitone) 4 Discussion Figure 3 PDD test results of NH subjects listening to acoustic simulation A two-way ANOVA was carried out to analyze the factors of base frequency (D#2 and D#4) and timbre (trumpet, piano, violin and clarinet) The analyses revealed significant main effects of both factors (p<005) The interactions among the three factors were shown to have significant main effects (p<005) Posthoc comparison revealed that only the piano with D#2 condition was significantly different from the other conditions (p<005) In the control session, the DLs for Acoustically, pitch can be measured in terms of F0, which quantifies the periodicity of the signal Perceiving the pitch of a complex tone requires the ability to extract F0-related information, including F0 and its harmonics Pitch perception is expected to be a combination of two mechanisms: place theory and temporal theory For place theory, pitch can be perceived from the resolved F0 and low-order harmonics in the spectrum For temporal theory, pitch can also be perceived from the amplitude fluctuation of the unresolved high-order harmonics [14] In this study, the spectral resolution was limited by the number of channels in the noise-excited vocoder (4 channels), which limited the pitch information delivered from resolved harmonics The temporal resolution was limited by the cut-off frequency of lowpass filter (500Hz), which includes the pitch-related periodicity in temporal fluctuations Such design was used to investigate the effect of the TEPC on the musical pitch perception The TEPC were expected to encompass F0 and some low-order harmonics In the present study, the piano with D#2 condition was significantly different from other condition It was indicated that the TEPCs of this particular condition did not contain enough useful information for pitch perception 712
4 Figure 4 The TEPCs (left) from the third channel (9344Hz- 1975Hz) and their corresponding spectrums (right) of clarinet, piano, trumpet and violin with lower F0 (D#2, 7778Hz), respectively Figure 5 The TEPCs (left) from the third channel (9344Hz- 1975Hz) and their corresponding spectrums (right) of clarinet, piano, trumpet and violin with higher F0 (D#4, 31113Hz), respectively Figure 4 and Figure 5 show the TEPCs and their corresponding spectrums from the third channel (9344Hz- 1975Hz) Four instruments, clarinet, piano, trumpet and violin, with lower F0 (D#2) were presented in Panel (A), (B), (C) and (D) of Figure 4 It was shown that the TEPC of piano with lower F0 was highly irregular compared from the other TEPCs The periodicity in TEPCs reflects the F0 information of the stimuli The F0 (D#2 at 7778Hz) and its low-order harmonics could be easily distinguished in the spectrums of clarinet, trumpet and violin However, no F0-related information was found in the piano spectrum Figure 5 presented four instruments, clarinet, piano, trumpet and violin, with higher F0 (D#4) in 713
5 Panel (A), (B), (C) and (D)The F0 (D#4, 31113Hz) could be easily distinguished in the spectrums of clarinet, trumpet and violin and piano The contribution of TEPC to speech recognition has been widely studied using acoustic simulation with NH subjects Shannon found that NH subjects could achieve good English language recognition scores in quiet with limited temporal envelope information (below 50 Hz) [15] Xu showed that, when increasing the cut-off frequency of the temporal envelope from 50 to 500 Hz, the Mandarin tone recognition performance was improved noticeably [16] Generally speaking, TEPC could provide F0-related information for good speech recognition in quiet However, music is far more complex than speech It requires much finer perception of pitch than speech Although the current study presented relatively good musical pitch discrimination with temporal information in most cases, this limited temporal cue may not be adequate for the music perception which is more complex than musical pitch discrimination Further investigations on the contribution of other important cues should be demonstrated 5 Conclusion In this study, the effect of TEPC on musical pitch discrimination was investigated with acoustic simulation of cochlear implant Our study results confirmed that (i) the characteristics of instruments influenced the pitch discrimination (ii) TEPC was important for musical pitch discrimination when the spectral cues are limited This indicates that limited spectral and temporal resolution provided in currently CIs may not support accurate musical pitch perception New design of the CI system may be required Acknowledgements We are grateful to all the NH listeners for participating in this study This work has been supported in part by the Chinese Academy of Sciences Pilot Project of the Knowledge Innovation Program (KGCX2-YX-607) and Key Projects in the National Science & Technology Pillar Program in the Eleventh Five-year Plan Period (2008BAI50B08) References [1] Zeng, F G, Rebscher, S, Harrison, W, Sun, X, Feng, H, Cochlear Implants: System Design, Integration, and Evaluation, IEEE Reviews in Biomedical Engineering, vol1, 2008, pp [2] Gfeller K, Turner C, Mehr M, Woodworth G, Fearn R, Knutson JF, Witt S, Stordahl J Recognition of familiar melodies by adult cochlear implant recipients and normalhearing adults, Cochlear Implants Int, vol3 (1), 2002,pp [3] Kang, R S, Nimmons, G L, Drennan, W R, et al, Development and validation of the University of Washington Clinical Assessment Of Music Perception test, Ear Hear, vol 30(4), 2009, pp411-8 [4] Gfeller K, Witt S, Woodworth G, Mehr MA, Knutson J, Effects of frequency, instrumental family, and cochlear implant type on timbre recognition and appraisal, Ann Otol Rhinol Laryngol, vol111, 2002, pp [5] Ward R Drennan and Jay T Rubinstein, Music perception in cochlear implant users and its relationship with psychophysical capabilities, J Rehabil Res Dev, vol 45(5), 2008, pp [6] Loizou, P, Speech processing in vocoder-centric cochlear implants, Adv Otorhinolaryngol Basel, Karger, vol64, 2006, pp [7] Rosen, S, Temporal information in speech: Acoustic, auditory and linguistic aspects, Philos Trans R Soc London, Ser B 336, 1992, pp [8] Kong, Y-Y, and Zeng, F-G, Temporal and spectral cues in Mandarin tone recognition, J Acoust Soc Am, vol120, 2006, pp [9] Meng Yuan, et at, Cantonese tone recognition with enhanced temporal periodicity cues J Acoust Soc Am, vol126 (1), 2009, pp [10] Green, T, Faulkner, A, and Rosen, S, Spectral and temporal cues to pitch in noise-excited vocoder simulations of continuous-interleaved sampling cochlear implants, J Acoust Soc Am, vol112, 2002, pp [11] Green, T, Faulkner, A, and Rosen, S, Enhancing temporal cues to voice pitch in continuous interleaved sampling cochlear implants, J Acoust Soc Am, vol116, 2004, pp [12] Greenwood, DD, A cochlear frequency-position function for several species 29 years later, 1990, J Acoust Soc Am, vol87 (6), pp [13] Levitt, H, Transformed up-down methods in psychoacoustics, J Acoust Soc Am, vol49, 1971, pp [14] Plack CJ, Oxenham AA, Fay RR, Popper AN Pitch: Neural coding and perception, New York: Springer, 2005, pp 7-55 [15] Shannon, RV, Zeng, F-G, Kamath, V, Wygonski, J, Ekelid, M, Speech recognition with primarily temporal cues, Science, vol270, 1995, pp [16] Xu, L, Tsai, Y, and Pfingst, B E, Features of stimulation affecting tonal-speech perception: Implications for cochlear prostheses, J Acoust Soc Am, vol112, 2002, pp
Music Perception with Combined Stimulation
Music Perception with Combined Stimulation Kate Gfeller 1,2,4, Virginia Driscoll, 4 Jacob Oleson, 3 Christopher Turner, 2,4 Stephanie Kliethermes, 3 Bruce Gantz 4 School of Music, 1 Department of Communication
More informationMusic for Cochlear Implant Recipients: C I Can!
Music for Cochlear Implant Recipients: C I Can! Valerie Looi British Academy of Audiology National Conference. Bournemouth, UK. 19-20 Nov 2014 Let s Put It In Context Outcomes Speech perception in quiet
More informationPitch. The perceptual correlate of frequency: the perceptual dimension along which sounds can be ordered from low to high.
Pitch The perceptual correlate of frequency: the perceptual dimension along which sounds can be ordered from low to high. 1 The bottom line Pitch perception involves the integration of spectral (place)
More informationThe Research of Controlling Loudness in the Timbre Subjective Perception Experiment of Sheng
The Research of Controlling Loudness in the Timbre Subjective Perception Experiment of Sheng S. Zhu, P. Ji, W. Kuang and J. Yang Institute of Acoustics, CAS, O.21, Bei-Si-huan-Xi Road, 100190 Beijing,
More informationDAT335 Music Perception and Cognition Cogswell Polytechnical College Spring Week 6 Class Notes
DAT335 Music Perception and Cognition Cogswell Polytechnical College Spring 2009 Week 6 Class Notes Pitch Perception Introduction Pitch may be described as that attribute of auditory sensation in terms
More informationUNIVERSITY OF DUBLIN TRINITY COLLEGE
UNIVERSITY OF DUBLIN TRINITY COLLEGE FACULTY OF ENGINEERING & SYSTEMS SCIENCES School of Engineering and SCHOOL OF MUSIC Postgraduate Diploma in Music and Media Technologies Hilary Term 31 st January 2005
More informationPitch Perception and Grouping. HST.723 Neural Coding and Perception of Sound
Pitch Perception and Grouping HST.723 Neural Coding and Perception of Sound Pitch Perception. I. Pure Tones The pitch of a pure tone is strongly related to the tone s frequency, although there are small
More informationExperiments on tone adjustments
Experiments on tone adjustments Jesko L. VERHEY 1 ; Jan HOTS 2 1 University of Magdeburg, Germany ABSTRACT Many technical sounds contain tonal components originating from rotating parts, such as electric
More informationPitch is one of the most common terms used to describe sound.
ARTICLES https://doi.org/1.138/s41562-17-261-8 Diversity in pitch perception revealed by task dependence Malinda J. McPherson 1,2 * and Josh H. McDermott 1,2 Pitch conveys critical information in speech,
More informationLOUDNESS EFFECT OF THE DIFFERENT TONES ON THE TIMBRE SUBJECTIVE PERCEPTION EXPERIMENT OF ERHU
The 21 st International Congress on Sound and Vibration 13-17 July, 2014, Beijing/China LOUDNESS EFFECT OF THE DIFFERENT TONES ON THE TIMBRE SUBJECTIVE PERCEPTION EXPERIMENT OF ERHU Siyu Zhu, Peifeng Ji,
More informationRelationship between spectrotemporal modulation detection and music perception in normal-hearing, hearing-impaired, and cochlear implant listeners
www.nature.com/scientificreports Received: 4 July 2017 Accepted: 21 November 2017 Published: xx xx xxxx OPEN Relationship between spectrotemporal modulation detection and music perception in normal-hearing,
More informationDominant Melody Enhancement in Cochlear Implants
Dominant Melody Enhancement in Cochlear Implants Drew Cappotto *, Wenye Xuan, Qinglin Meng *, Chaogang Zhang #, and Jan Schnupp * * Hearing Research Group, Biomedical Science Department, City University
More informationMusical Acoustics Lecture 15 Pitch & Frequency (Psycho-Acoustics)
1 Musical Acoustics Lecture 15 Pitch & Frequency (Psycho-Acoustics) Pitch Pitch is a subjective characteristic of sound Some listeners even assign pitch differently depending upon whether the sound was
More informationMeasurement of overtone frequencies of a toy piano and perception of its pitch
Measurement of overtone frequencies of a toy piano and perception of its pitch PACS: 43.75.Mn ABSTRACT Akira Nishimura Department of Media and Cultural Studies, Tokyo University of Information Sciences,
More informationProceedings of Meetings on Acoustics
Proceedings of Meetings on Acoustics Volume 19, 2013 http://acousticalsociety.org/ ICA 2013 Montreal Montreal, Canada 2-7 June 2013 Psychological and Physiological Acoustics Session 1pPPb: Psychoacoustics
More informationMEASURING LOUDNESS OF LONG AND SHORT TONES USING MAGNITUDE ESTIMATION
MEASURING LOUDNESS OF LONG AND SHORT TONES USING MAGNITUDE ESTIMATION Michael Epstein 1,2, Mary Florentine 1,3, and Søren Buus 1,2 1Institute for Hearing, Speech, and Language 2Communications and Digital
More informationInstrument Recognition in Polyphonic Mixtures Using Spectral Envelopes
Instrument Recognition in Polyphonic Mixtures Using Spectral Envelopes hello Jay Biernat Third author University of Rochester University of Rochester Affiliation3 words jbiernat@ur.rochester.edu author3@ismir.edu
More informationThe Tone Height of Multiharmonic Sounds. Introduction
Music-Perception Winter 1990, Vol. 8, No. 2, 203-214 I990 BY THE REGENTS OF THE UNIVERSITY OF CALIFORNIA The Tone Height of Multiharmonic Sounds ROY D. PATTERSON MRC Applied Psychology Unit, Cambridge,
More informationWe realize that this is really small, if we consider that the atmospheric pressure 2 is
PART 2 Sound Pressure Sound Pressure Levels (SPLs) Sound consists of pressure waves. Thus, a way to quantify sound is to state the amount of pressure 1 it exertsrelatively to a pressure level of reference.
More informationWhy are natural sounds detected faster than pips?
Why are natural sounds detected faster than pips? Clara Suied Department of Physiology, Development and Neuroscience, Centre for the Neural Basis of Hearing, Downing Street, Cambridge CB2 3EG, United Kingdom
More informationPitch perception for mixtures of spectrally overlapping harmonic complex tones
Pitch perception for mixtures of spectrally overlapping harmonic complex tones Christophe Micheyl, a Michael V. Keebler, and Andrew J. Oxenham Department of Psychology, University of Minnesota, Minneapolis,
More informationThe Development and Pilot Testing of a Music Quality Rating Test Battery for New Zealand and Australian MED-EL Cochlear Implant Recipients
The Development and Pilot Testing of a Music Quality Rating Test Battery for New Zealand and Australian MED-EL Cochlear Implant Recipients A thesis submitted in partial fulfilment of the requirements for
More informationHearing Research. Impaired perception of temporal fine structure and musical timbre in cochlear implant users
Hearing Research 280 (2011) 192e200 Contents lists available at ScienceDirect Hearing Research journal homepage: www.elsevier.com/locate/heares Research paper Impaired perception of temporal fine structure
More informationGerman Center for Music Therapy Research
Effects of music therapy for adult CI users on the perception of music, prosody in speech, subjective self-concept and psychophysiological arousal Research Network: E. Hutter, M. Grapp, H. Argstatter,
More informationI. INTRODUCTION. 1 place Stravinsky, Paris, France; electronic mail:
The lower limit of melodic pitch Daniel Pressnitzer, a) Roy D. Patterson, and Katrin Krumbholz Centre for the Neural Basis of Hearing, Department of Physiology, Downing Street, Cambridge CB2 3EG, United
More informationI. LISTENING. For most people, sound is background only. To the sound designer/producer, sound is everything.!tc 243 2
To use sound properly, and fully realize its power, we need to do the following: (1) listen (2) understand basics of sound and hearing (3) understand sound's fundamental effects on human communication
More informationModeling sound quality from psychoacoustic measures
Modeling sound quality from psychoacoustic measures Lena SCHELL-MAJOOR 1 ; Jan RENNIES 2 ; Stephan D. EWERT 3 ; Birger KOLLMEIER 4 1,2,4 Fraunhofer IDMT, Hör-, Sprach- und Audiotechnologie & Cluster of
More informationDo Zwicker Tones Evoke a Musical Pitch?
Do Zwicker Tones Evoke a Musical Pitch? Hedwig E. Gockel and Robert P. Carlyon Abstract It has been argued that musical pitch, i.e. pitch in its strictest sense, requires phase locking at the level of
More informationBrian C. J. Moore Department of Experimental Psychology, University of Cambridge, Downing Street, Cambridge CB2 3EB, England
Asymmetry of masking between complex tones and noise: Partial loudness Hedwig Gockel a) CNBH, Department of Physiology, University of Cambridge, Downing Street, Cambridge CB2 3EG, England Brian C. J. Moore
More informationinter.noise 2000 The 29th International Congress and Exhibition on Noise Control Engineering August 2000, Nice, FRANCE
Copyright SFA - InterNoise 2000 1 inter.noise 2000 The 29th International Congress and Exhibition on Noise Control Engineering 27-30 August 2000, Nice, FRANCE I-INCE Classification: 7.5 BALANCE OF CAR
More informationMusic Representations
Lecture Music Processing Music Representations Meinard Müller International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de Book: Fundamentals of Music Processing Meinard Müller Fundamentals
More informationSimple Harmonic Motion: What is a Sound Spectrum?
Simple Harmonic Motion: What is a Sound Spectrum? A sound spectrum displays the different frequencies present in a sound. Most sounds are made up of a complicated mixture of vibrations. (There is an introduction
More information1aAA14. The audibility of direct sound as a key to measuring the clarity of speech and music
1aAA14. The audibility of direct sound as a key to measuring the clarity of speech and music Session: Monday Morning, Oct 31 Time: 11:30 Author: David H. Griesinger Location: David Griesinger Acoustics,
More informationPOST-PROCESSING FIDDLE : A REAL-TIME MULTI-PITCH TRACKING TECHNIQUE USING HARMONIC PARTIAL SUBTRACTION FOR USE WITHIN LIVE PERFORMANCE SYSTEMS
POST-PROCESSING FIDDLE : A REAL-TIME MULTI-PITCH TRACKING TECHNIQUE USING HARMONIC PARTIAL SUBTRACTION FOR USE WITHIN LIVE PERFORMANCE SYSTEMS Andrew N. Robertson, Mark D. Plumbley Centre for Digital Music
More informationRobert Alexandru Dobre, Cristian Negrescu
ECAI 2016 - International Conference 8th Edition Electronics, Computers and Artificial Intelligence 30 June -02 July, 2016, Ploiesti, ROMÂNIA Automatic Music Transcription Software Based on Constant Q
More informationAN ARTISTIC TECHNIQUE FOR AUDIO-TO-VIDEO TRANSLATION ON A MUSIC PERCEPTION STUDY
AN ARTISTIC TECHNIQUE FOR AUDIO-TO-VIDEO TRANSLATION ON A MUSIC PERCEPTION STUDY Eugene Mikyung Kim Department of Music Technology, Korea National University of Arts eugene@u.northwestern.edu ABSTRACT
More informationConsonance perception of complex-tone dyads and chords
Downloaded from orbit.dtu.dk on: Nov 24, 28 Consonance perception of complex-tone dyads and chords Rasmussen, Marc; Santurette, Sébastien; MacDonald, Ewen Published in: Proceedings of Forum Acusticum Publication
More informationElectrical Stimulation of the Cochlea to Reduce Tinnitus. Richard S. Tyler, Ph.D. Overview
Electrical Stimulation of the Cochlea to Reduce Tinnitus Richard S., Ph.D. 1 Overview 1. Mechanisms of influencing tinnitus 2. Review of select studies 3. Summary of what is known 4. Next Steps 2 The University
More informationVoice segregation by difference in fundamental frequency: Effect of masker type
Voice segregation by difference in fundamental frequency: Effect of masker type Mickael L. D. Deroche a) Department of Otolaryngology, Johns Hopkins University School of Medicine, 818 Ross Research Building,
More informationMAutoPitch. Presets button. Left arrow button. Right arrow button. Randomize button. Save button. Panic button. Settings button
MAutoPitch Presets button Presets button shows a window with all available presets. A preset can be loaded from the preset window by double-clicking on it, using the arrow buttons or by using a combination
More information2 Autocorrelation verses Strobed Temporal Integration
11 th ISH, Grantham 1997 1 Auditory Temporal Asymmetry and Autocorrelation Roy D. Patterson* and Toshio Irino** * Center for the Neural Basis of Hearing, Physiology Department, Cambridge University, Downing
More informationResearch Article Music Engineering as a Novel Strategy for Enhancing Music Enjoyment in the Cochlear Implant Recipient
Hindawi Publishing Corporation Behavioural Neurology Volume 2015, Article ID 829680, 7 pages http://dx.doi.org/10.1155/2015/829680 Research Article Music Engineering as a Novel Strategy for Enhancing Music
More informationGlasgow eprints Service
Brewster, S.A. and Wright, P.C. and Edwards, A.D.N. (1993) An evaluation of earcons for use in auditory human-computer interfaces. In, Ashlund, S., Eds. Conference on Human Factors in Computing Systems,
More information9.35 Sensation And Perception Spring 2009
MIT OpenCourseWare http://ocw.mit.edu 9.35 Sensation And Perception Spring 29 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. Hearing Kimo Johnson April
More informationPerception of emotion in music in adults with cochlear implants
Butler University Digital Commons @ Butler University Undergraduate Honors Thesis Collection Undergraduate Scholarship 2018 Perception of emotion in music in adults with cochlear implants Delainey Spragg
More informationAural Rehabilitation of Music Perception and Enjoyment of Adult Cochlear Implant Users
Aural Rehabilitation of Music Perception and Enjoyment of Adult Cochlear Implant Users Kate Gfeller Iowa Cochlear Implant Research Center Maureen Mehr University of Iowa Hospitals and Clinics Shelley Witt
More informationUsing the new psychoacoustic tonality analyses Tonality (Hearing Model) 1
02/18 Using the new psychoacoustic tonality analyses 1 As of ArtemiS SUITE 9.2, a very important new fully psychoacoustic approach to the measurement of tonalities is now available., based on the Hearing
More informationAUD 6306 Speech Science
AUD 3 Speech Science Dr. Peter Assmann Spring semester 2 Role of Pitch Information Pitch contour is the primary cue for tone recognition Tonal languages rely on pitch level and differences to convey lexical
More informationPsychoacoustics. lecturer:
Psychoacoustics lecturer: stephan.werner@tu-ilmenau.de Block Diagram of a Perceptual Audio Encoder loudness critical bands masking: frequency domain time domain binaural cues (overview) Source: Brandenburg,
More informationDetection and demodulation of non-cooperative burst signal Feng Yue 1, Wu Guangzhi 1, Tao Min 1
International Conference on Applied Science and Engineering Innovation (ASEI 2015) Detection and demodulation of non-cooperative burst signal Feng Yue 1, Wu Guangzhi 1, Tao Min 1 1 China Satellite Maritime
More informationMUSICAL INSTRUMENT RECOGNITION WITH WAVELET ENVELOPES
MUSICAL INSTRUMENT RECOGNITION WITH WAVELET ENVELOPES PACS: 43.60.Lq Hacihabiboglu, Huseyin 1,2 ; Canagarajah C. Nishan 2 1 Sonic Arts Research Centre (SARC) School of Computer Science Queen s University
More informationThe mid-difference hump in forward-masked intensity discrimination a)
The mid-difference hump in forward-masked intensity discrimination a) Daniel Oberfeld b Department of Psychology, Johannes Gutenberg Universität Mainz, 55099 Mainz, Germany Received 6 March 2007; revised
More informationPSYCHOACOUSTICS & THE GRAMMAR OF AUDIO (By Steve Donofrio NATF)
PSYCHOACOUSTICS & THE GRAMMAR OF AUDIO (By Steve Donofrio NATF) "The reason I got into playing and producing music was its power to travel great distances and have an emotional impact on people" Quincey
More informationSpeech and Speaker Recognition for the Command of an Industrial Robot
Speech and Speaker Recognition for the Command of an Industrial Robot CLAUDIA MOISA*, HELGA SILAGHI*, ANDREI SILAGHI** *Dept. of Electric Drives and Automation University of Oradea University Street, nr.
More informationMusical Instrument Identification Using Principal Component Analysis and Multi-Layered Perceptrons
Musical Instrument Identification Using Principal Component Analysis and Multi-Layered Perceptrons Róisín Loughran roisin.loughran@ul.ie Jacqueline Walker jacqueline.walker@ul.ie Michael O Neill University
More informationLoudness and Sharpness Calculation
10/16 Loudness and Sharpness Calculation Psychoacoustics is the science of the relationship between physical quantities of sound and subjective hearing impressions. To examine these relationships, physical
More informationNoise evaluation based on loudness-perception characteristics of older adults
Noise evaluation based on loudness-perception characteristics of older adults Kenji KURAKATA 1 ; Tazu MIZUNAMI 2 National Institute of Advanced Industrial Science and Technology (AIST), Japan ABSTRACT
More informationPitch: The Perceptual Ends of the Periodicity; but Of What Periodicity?
Pitch: The Perceptual Ends of the Periodicity; but Of What Periodicity? 1 Minoru TSUZAKI ; Sawa HANADA 1,2 ; Junko SONODA 1,3 ; Satomi TANAKA 1,4 ; Toshio IRINO 5 1 Kyoto City University of Arts, Japan
More informationDYNAMIC AUDITORY CUES FOR EVENT IMPORTANCE LEVEL
DYNAMIC AUDITORY CUES FOR EVENT IMPORTANCE LEVEL Jonna Häkkilä Nokia Mobile Phones Research and Technology Access Elektroniikkatie 3, P.O.Box 50, 90571 Oulu, Finland jonna.hakkila@nokia.com Sami Ronkainen
More informationPHYSICS OF MUSIC. 1.) Charles Taylor, Exploring Music (Music Library ML3805 T )
REFERENCES: 1.) Charles Taylor, Exploring Music (Music Library ML3805 T225 1992) 2.) Juan Roederer, Physics and Psychophysics of Music (Music Library ML3805 R74 1995) 3.) Physics of Sound, writeup in this
More informationHidden melody in music playing motion: Music recording using optical motion tracking system
PROCEEDINGS of the 22 nd International Congress on Acoustics General Musical Acoustics: Paper ICA2016-692 Hidden melody in music playing motion: Music recording using optical motion tracking system Min-Ho
More informationMEASURING SENSORY CONSONANCE BY AUDITORY MODELLING. Dept. of Computer Science, University of Aarhus
MEASURING SENSORY CONSONANCE BY AUDITORY MODELLING Esben Skovenborg Dept. of Computer Science, University of Aarhus Åbogade 34, DK-8200 Aarhus N, Denmark esben@skovenborg.dk Søren H. Nielsen TC Electronic
More informationONLINE ACTIVITIES FOR MUSIC INFORMATION AND ACOUSTICS EDUCATION AND PSYCHOACOUSTIC DATA COLLECTION
ONLINE ACTIVITIES FOR MUSIC INFORMATION AND ACOUSTICS EDUCATION AND PSYCHOACOUSTIC DATA COLLECTION Travis M. Doll Ray V. Migneco Youngmoo E. Kim Drexel University, Electrical & Computer Engineering {tmd47,rm443,ykim}@drexel.edu
More informationCTP 431 Music and Audio Computing. Basic Acoustics. Graduate School of Culture Technology (GSCT) Juhan Nam
CTP 431 Music and Audio Computing Basic Acoustics Graduate School of Culture Technology (GSCT) Juhan Nam 1 Outlines What is sound? Generation Propagation Reception Sound properties Loudness Pitch Timbre
More informationTimbral Recognition and Appraisal by Adult Cochlear Implant Users and Normal-Hearing Adults
J Am Acad Audiol 9 : 1-19 (1998) Timbral Recognition and Appraisal by Adult Cochlear Implant Users and Normal-Hearing Adults Kate Gfeller* John F. Knutson, George Woodworth$ Shelley Witt,' Becky DeBus
More informationMUSICAL EAR TRAINING THROUGH ACTIVE MUSIC MAKING IN ADOLESCENT Cl USERS. The background ~
It's good news that more and more teenagers are being offered the option of cochlear implants. They are candidates who require information and support given in a way to meet their particular needs which
More informationProcessing Linguistic and Musical Pitch by English-Speaking Musicians and Non-Musicians
Proceedings of the 20th North American Conference on Chinese Linguistics (NACCL-20). 2008. Volume 1. Edited by Marjorie K.M. Chan and Hana Kang. Columbus, Ohio: The Ohio State University. Pages 139-145.
More informationTopics in Computer Music Instrument Identification. Ioanna Karydi
Topics in Computer Music Instrument Identification Ioanna Karydi Presentation overview What is instrument identification? Sound attributes & Timbre Human performance The ideal algorithm Selected approaches
More informationImplementation of an 8-Channel Real-Time Spontaneous-Input Time Expander/Compressor
Implementation of an 8-Channel Real-Time Spontaneous-Input Time Expander/Compressor Introduction: The ability to time stretch and compress acoustical sounds without effecting their pitch has been an attractive
More informationS I N E V I B E S FRACTION AUDIO SLICING WORKSTATION
S I N E V I B E S FRACTION AUDIO SLICING WORKSTATION INTRODUCTION Fraction is a plugin for deep on-the-fly remixing and mangling of sound. It features 8x independent slicers which record and repeat short
More information2018 Fall CTP431: Music and Audio Computing Fundamentals of Musical Acoustics
2018 Fall CTP431: Music and Audio Computing Fundamentals of Musical Acoustics Graduate School of Culture Technology, KAIST Juhan Nam Outlines Introduction to musical tones Musical tone generation - String
More informationFeatures for Audio and Music Classification
Features for Audio and Music Classification Martin F. McKinney and Jeroen Breebaart Auditory and Multisensory Perception, Digital Signal Processing Group Philips Research Laboratories Eindhoven, The Netherlands
More informationCSC475 Music Information Retrieval
CSC475 Music Information Retrieval Monophonic pitch extraction George Tzanetakis University of Victoria 2014 G. Tzanetakis 1 / 32 Table of Contents I 1 Motivation and Terminology 2 Psychacoustics 3 F0
More informationMEMORY & TIMBRE MEMT 463
MEMORY & TIMBRE MEMT 463 TIMBRE, LOUDNESS, AND MELODY SEGREGATION Purpose: Effect of three parameters on segregating 4-note melody among distraction notes. Target melody and distractor melody utilized.
More informationHugo Technology. An introduction into Rob Watts' technology
Hugo Technology An introduction into Rob Watts' technology Copyright Rob Watts 2014 About Rob Watts Audio chip designer both analogue and digital Consultant to silicon chip manufacturers Designer of Chord
More informationDetermination of Sound Quality of Refrigerant Compressors
Purdue University Purdue e-pubs International Compressor Engineering Conference School of Mechanical Engineering 1994 Determination of Sound Quality of Refrigerant Compressors S. Y. Wang Copeland Corporation
More informationTempo and Beat Tracking
Tutorial Automatisierte Methoden der Musikverarbeitung 47. Jahrestagung der Gesellschaft für Informatik Tempo and Beat Tracking Meinard Müller, Christof Weiss, Stefan Balke International Audio Laboratories
More informationMusic Complexity Descriptors. Matt Stabile June 6 th, 2008
Music Complexity Descriptors Matt Stabile June 6 th, 2008 Musical Complexity as a Semantic Descriptor Modern digital audio collections need new criteria for categorization and searching. Applicable to:
More informationProceedings of Meetings on Acoustics
Proceedings of Meetings on Acoustics Volume 19, 2013 http://acousticalsociety.org/ ICA 2013 Montreal Montreal, Canada 2-7 June 2013 Psychological and Physiological Acoustics Session 4aPPb: Binaural Hearing
More informationLEVEL ONE Provider Reference
LEVEL ONE Provider Reference Description The most widely used series in The Listening Program LEVEL ONE is flexible; offering a foundational to experienced level program for improving brain function and
More informationICaD 2013 DETERMINATION OF SUBJECTIVE TINNITUS CHARACTERISTICS BY MEANS OF SOUND SYNTHESIS CONTROLLED BY THE TOUCH SCREEN INTERFACE
ICaD 2013 6 10 july, 2013, Łódź, Poland international Conference on auditory Display DETERMINATION OF SUBJECTIVE TINNITUS CHARACTERISTICS BY MEANS OF SOUND SYNTHESIS CONTROLLED BY THE TOUCH SCREEN INTERFACE
More informationBeltone True TM with Tinnitus Breaker Pro
Beltone True TM with Tinnitus Breaker Pro Beltone True Tinnitus Breaker Pro tinnitus datasheet How to use tinnitus test results It is important to remember that tinnitus is a symptom, not a disease. It
More informationInformational Masking and Trained Listening. Undergraduate Honors Thesis
Informational Masking and Trained Listening Undergraduate Honors Thesis Presented in partial fulfillment of requirements for the Degree of Bachelor of the Arts by Erica Laughlin The Ohio State University
More informationQuarterly Progress and Status Report. An attempt to predict the masking effect of vowel spectra
Dept. for Speech, Music and Hearing Quarterly Progress and Status Report An attempt to predict the masking effect of vowel spectra Gauffin, J. and Sundberg, J. journal: STL-QPSR volume: 15 number: 4 year:
More informationA SEMANTIC DIFFERENTIAL STUDY OF LOW AMPLITUDE SUPERSONIC AIRCRAFT NOISE AND OTHER TRANSIENT SOUNDS
19 th INTERNATIONAL CONGRESS ON ACOUSTICS MADRID, 2-7 SEPTEMBER 2007 A SEMANTIC DIFFERENTIAL STUDY OF LOW AMPLITUDE SUPERSONIC AIRCRAFT NOISE AND OTHER TRANSIENT SOUNDS PACS: 43.28.Mw Marshall, Andrew
More informationSemi-automated extraction of expressive performance information from acoustic recordings of piano music. Andrew Earis
Semi-automated extraction of expressive performance information from acoustic recordings of piano music Andrew Earis Outline Parameters of expressive piano performance Scientific techniques: Fourier transform
More informationPitch-Matching Accuracy in Trained Singers and Untrained Individuals: The Impact of Musical Interference and Noise
Pitch-Matching Accuracy in Trained Singers and Untrained Individuals: The Impact of Musical Interference and Noise Julie M. Estis, Ashli Dean-Claytor, Robert E. Moore, and Thomas L. Rowell, Mobile, Alabama
More informationProceedings of Meetings on Acoustics
Proceedings of Meetings on Acoustics Volume 19, 2013 http://acousticalsociety.org/ ICA 2013 Montreal Montreal, Canada 2-7 June 2013 Psychological and Physiological Acoustics Session 5aPP: Recent Trends
More informationA prototype system for rule-based expressive modifications of audio recordings
International Symposium on Performance Science ISBN 0-00-000000-0 / 000-0-00-000000-0 The Author 2007, Published by the AEC All rights reserved A prototype system for rule-based expressive modifications
More informationPerceptual Considerations in Designing and Fitting Hearing Aids for Music Published on Friday, 14 March :01
Perceptual Considerations in Designing and Fitting Hearing Aids for Music Published on Friday, 14 March 2008 11:01 The components of music shed light on important aspects of hearing perception. To make
More informationDigital audio and computer music. COS 116, Spring 2012 Guest lecture: Rebecca Fiebrink
Digital audio and computer music COS 116, Spring 2012 Guest lecture: Rebecca Fiebrink Overview 1. Physics & perception of sound & music 2. Representations of music 3. Analyzing music with computers 4.
More informationEstimating the Time to Reach a Target Frequency in Singing
THE NEUROSCIENCES AND MUSIC III: DISORDERS AND PLASTICITY Estimating the Time to Reach a Target Frequency in Singing Sean Hutchins a and David Campbell b a Department of Psychology, McGill University,
More informationExperiments on musical instrument separation using multiplecause
Experiments on musical instrument separation using multiplecause models J Klingseisen and M D Plumbley* Department of Electronic Engineering King's College London * - Corresponding Author - mark.plumbley@kcl.ac.uk
More informationThe quality of potato chip sounds and crispness impression
PROCEEDINGS of the 22 nd International Congress on Acoustics Product Quality and Multimodal Interaction: Paper ICA2016-558 The quality of potato chip sounds and crispness impression M. Ercan Altinsoy Chair
More informationTopic 10. Multi-pitch Analysis
Topic 10 Multi-pitch Analysis What is pitch? Common elements of music are pitch, rhythm, dynamics, and the sonic qualities of timbre and texture. An auditory perceptual attribute in terms of which sounds
More informationWhat is proximity, how do early reflections and reverberation affect it, and can it be studied with LOC and existing binaural data?
PROCEEDINGS of the 22 nd International Congress on Acoustics Challenges and Solutions in Acoustical Measurement and Design: Paper ICA2016-379 What is proximity, how do early reflections and reverberation
More informationTinnitus Quick Guide
Tinnitus Quick Guide MADSEN Astera² offers a new module for tinnitus assessment. This new module is available free of charge in OTOsuite versions 4.65 and higher. Its objective is to assist clinicians
More informationCTP431- Music and Audio Computing Musical Acoustics. Graduate School of Culture Technology KAIST Juhan Nam
CTP431- Music and Audio Computing Musical Acoustics Graduate School of Culture Technology KAIST Juhan Nam 1 Outlines What is sound? Physical view Psychoacoustic view Sound generation Wave equation Wave
More information2. AN INTROSPECTION OF THE MORPHING PROCESS
1. INTRODUCTION Voice morphing means the transition of one speech signal into another. Like image morphing, speech morphing aims to preserve the shared characteristics of the starting and final signals,
More informationSound design strategy for enhancing subjective preference of EV interior sound
Sound design strategy for enhancing subjective preference of EV interior sound Doo Young Gwak 1, Kiseop Yoon 2, Yeolwan Seong 3 and Soogab Lee 4 1,2,3 Department of Mechanical and Aerospace Engineering,
More information