CTP 431 Music and Audio Computing. Basic Acoustics. Graduate School of Culture Technology (GSCT) Juhan Nam

Similar documents
2018 Fall CTP431: Music and Audio Computing Fundamentals of Musical Acoustics

CTP431- Music and Audio Computing Musical Acoustics. Graduate School of Culture Technology KAIST Juhan Nam

Creative Computing II

Math and Music: The Science of Sound

Musical Acoustics Lecture 15 Pitch & Frequency (Psycho-Acoustics)

Psychoacoustics. lecturer:

Sound energy and waves

GCT535- Sound Technology for Multimedia Timbre Analysis. Graduate School of Culture Technology KAIST Juhan Nam

August Acoustics and Psychoacoustics Barbara Crowe Music Therapy Director. Notes from BC s copyrighted materials for IHTP

9.35 Sensation And Perception Spring 2009

UNIVERSITY OF DUBLIN TRINITY COLLEGE

Music 170: Wind Instruments

Note on Posted Slides. Noise and Music. Noise and Music. Pitch. PHY205H1S Physics of Everyday Life Class 15: Musical Sounds

I. LISTENING. For most people, sound is background only. To the sound designer/producer, sound is everything.!tc 243 2

Simple Harmonic Motion: What is a Sound Spectrum?

Audio Editing. Developed by. Allama Iqbal Open University, Islamabad, Pakistan. In association with

Our Perceptions of Music: Why Does the Theme from Jaws Sound Like a Big Scary Shark?

Lecture 1: What we hear when we hear music

Pitch. The perceptual correlate of frequency: the perceptual dimension along which sounds can be ordered from low to high.

We realize that this is really small, if we consider that the atmospheric pressure 2 is

FPFV-285/585 PRODUCTION SOUND Fall 2018 CRITICAL LISTENING Assignment

DAT335 Music Perception and Cognition Cogswell Polytechnical College Spring Week 6 Class Notes

PSYCHOACOUSTICS & THE GRAMMAR OF AUDIO (By Steve Donofrio NATF)

Pitch Perception and Grouping. HST.723 Neural Coding and Perception of Sound

BBN ANG 141 Foundations of phonology Phonetics 3: Acoustic phonetics 1

The Physics Of Sound. Why do we hear what we hear? (Turn on your speakers)

Measurement of overtone frequencies of a toy piano and perception of its pitch

A Need for Universal Audio Terminologies and Improved Knowledge Transfer to the Consumer

Physics. Approximate Timeline. Students are expected to keep up with class work when absent.

UNIT 1: QUALITIES OF SOUND. DURATION (RHYTHM)

Sound ASSIGNMENT. (i) Only... bodies produce sound. EDULABZ. (ii) Sound needs a... medium for its propagation.

Quest Chapter 26. Flying bees buzz. What could they be doing that generates sound? What type of wave is sound?

NEW DEVELOPMENTS IN THE TREATMENT OF TINNITUS THE AUREX-3 FOR TINNITUS

Harmonic Analysis of the Soprano Clarinet

CHAPTER 20.2 SPEECH AND MUSICAL SOUNDS

HST 725 Music Perception & Cognition Assignment #1 =================================================================

Spectral Sounds Summary

Music Representations

Music Representations

Welcome to Vibrationdata

CSC475 Music Information Retrieval

Ch. 1: Audio/Image/Video Fundamentals Multimedia Systems. School of Electrical Engineering and Computer Science Oregon State University

The Cocktail Party Effect. Binaural Masking. The Precedence Effect. Music 175: Time and Space

Calculation of Unsteady Loudness in the Presence of Gaps Through Application of the Multiple Look Theory

Music for the Hearing Care Professional Published on Sunday, 14 March :24

MODELING OF GESTURE-SOUND RELATIONSHIP IN RECORDER

EE513 Audio Signals and Systems. Introduction Kevin D. Donohue Electrical and Computer Engineering University of Kentucky

12/7/2018 E-1 1

Digital music synthesis using DSP

ADSR AMP. ENVELOPE. Moog Music s Guide To Analog Synthesized Percussion. The First Step COMMON VOLUME ENVELOPES

MODIFICATIONS TO THE POWER FUNCTION FOR LOUDNESS

Concert halls conveyors of musical expressions

Analog Code MicroPlug Manual. Attacker

A PEDAGOGICAL UTILISATION OF THE ACCORDION TO STUDY THE VIBRATION BEHAVIOUR OF FREE REEDS

APPLICATION OF A PHYSIOLOGICAL EAR MODEL TO IRRELEVANCE REDUCTION IN AUDIO CODING

THE PSYCHOACOUSTICS OF MULTICHANNEL AUDIO. J. ROBERT STUART Meridian Audio Ltd Stonehill, Huntingdon, PE18 6ED England

Available online at International Journal of Current Research Vol. 9, Issue, 08, pp , August, 2017

Sound From Wikipedia, the free encyclopedia

EUROPA I PREAMPLIFIER QUICK START GUIDE Dave Hill Designs version

Acoustical correlates of flute performance technique

arxiv: v1 [physics.class-ph] 22 Mar 2012

Using the new psychoacoustic tonality analyses Tonality (Hearing Model) 1

Advance Certificate Course In Audio Mixing & Mastering.

Beethoven s Fifth Sine -phony: the science of harmony and discord

LOUDNESS EFFECT OF THE DIFFERENT TONES ON THE TIMBRE SUBJECTIVE PERCEPTION EXPERIMENT OF ERHU

Quarterly Progress and Status Report. An attempt to predict the masking effect of vowel spectra

Inhibition of Oscillation in a Plastic Neural Network Model of Tinnitus Therapy Using Noise Stimulus

1aAA14. The audibility of direct sound as a key to measuring the clarity of speech and music

Class Notes November 7. Reed instruments; The woodwinds

Syllabus: PHYS 1300 Introduction to Musical Acoustics Fall 20XX

Quarterly Progress and Status Report. Violin timbre and the picket fence

Vocal-tract Influence in Trombone Performance

Topic 10. Multi-pitch Analysis

UNIT 1: THE ART OF SOUND

LASER INTERFEROMETER GRAVITATIONAL WAVE OBSERVATORY - LIGO - CALIFORNIA INSTITUTE OF TECHNOLOGY MASSACHUSETTS INSTITUTE OF TECHNOLOGY

Lecture 7: Music

Laboratory Assignment 3. Digital Music Synthesis: Beethoven s Fifth Symphony Using MATLAB

Digital audio and computer music. COS 116, Spring 2012 Guest lecture: Rebecca Fiebrink

THE KARLSON REPRODUCER

Instruments. Of the. Orchestra

Sound design strategy for enhancing subjective preference of EV interior sound

Physics and Neurophysiology of Hearing

Psychoacoustic Evaluation of Fan Noise

The Tone Height of Multiharmonic Sounds. Introduction

ACME Audio. Opticom XLA-3 Plugin Manual. Powered by

AN ARTISTIC TECHNIQUE FOR AUDIO-TO-VIDEO TRANSLATION ON A MUSIC PERCEPTION STUDY

Linear Time Invariant (LTI) Systems

Analysis, Synthesis, and Perception of Musical Sounds

Methods to measure stage acoustic parameters: overview and future research

Amplitude and Loudness 1

VCE VET MUSIC TECHNICAL PRODUCTION

BACHELOR THESIS. Placing of Subwoofers. Measurements of common setups with 2-4 subwoofers for an even sound

Analog Code MicroPlug Manual. Attacker Plus

A few white papers on various. Digital Signal Processing algorithms. used in the DAC501 / DAC502 units

The characterisation of Musical Instruments by means of Intensity of Acoustic Radiation (IAR)

Physical Modelling of Musical Instruments Using Digital Waveguides: History, Theory, Practice

The Research of Controlling Loudness in the Timbre Subjective Perception Experiment of Sheng

Toward a Computationally-Enhanced Acoustic Grand Piano

Making music with voice. Distinguished lecture, CIRMMT Jan 2009, Copyright Johan Sundberg

Visit for notes and important question. Visit for notes and important question

Transcription:

CTP 431 Music and Audio Computing Basic Acoustics Graduate School of Culture Technology (GSCT) Juhan Nam 1

Outlines What is sound? Generation Propagation Reception Sound properties Loudness Pitch Timbre 2

What Is Sound? Vibration of air molecules Compression and rarefaction Wave Sound wave propagates but the air molecules stay in place Transmits energy without transmitting the matter Longitudinal wave Animation demo http://www.acs.psu.edu/drussell/demos/waves-intro/waves-intro.html 3

Three Stages of Sound Generation Vibration of sound objects Propagation Traveling of the vibration through the air Reception Sensation of the air vibration via ears

Sound Generation Excitation Drive force on sound objects Oscillation Vibration by restoration force Modes: complex tones Resonance Amplify or modify the volume of oscillation 5

Oscillation: Simple Harmonic Motion A mass-spring model Newton s second law 1 F = kx = m d 2 x dt 2 Restora0on force by Hooke s law k m x 0.5 0 0.5 1 0 1 2 3 4 5 6 7 8 x 10 3 Practical model: damping is added T = 1 f Generate a sinusoid oscillation Pure tone: x = Asin(ωt) = Asin(2π ft) ω = k / m f = ω / 2π T =1/ f angular frequency frequency period 6

Complex Oscillation in Musical Instruments Depending on the type of instruments E.g. strings, air-filled pipe, membrane, bar Common elements Excitation: initial conditions or driving force Wave propagation (on the solid objects): wave equation Reflection, superposition and standing wave: boundary conditions Generate modes Each mode correspond to a sinusoidal oscillation Complex tone: sinusoids are often harmonically related 7

Sound as Wave Propagation Described by wave equation Reflection Fixed-end or open-ended Superposition Constructive or destructive sum Standing wave Nodes and anti-nodes Animation demo http://www.acs.psu.edu/drussell/demos/reflect/reflect.html http://www.acs.psu.edu/drussell/demos/swr/swr.html 8

Complex Oscillation in Strings Excitation Plucking, striking or bowing Modes Transverse wave Generate harmonic sounds Pitch is determined by the distance between two ends Animation demo https://www.youtube.com/watch?v=_x72on6csl0 9

Modes in Strings Plucked String (ini0al condi0on) Plucked String (modes) λ = 2L, L, 2L 3, L 2,... f = c 2L, c L, 3c 2L, 2c L,... c L λ speed of vibra0on Length of string wavelength 10

Complex Oscillation in Pipes Excitation Blowing Reed: clarinet, oboe Modes Longitudinal pressure wave that travels in air column Generate harmonic sounds Open-pipe (e.g. flute): full harmonics Semi-open pipe (e.g. clarinet): odd-numbered harmonics Animation demo http://newt.phys.unsw.edu.au/jw/flutes.v.clarinets.html 11

Complex Oscillation in Membrane Excitation Striking Modes Transverse wave 2-D circular member or plate Generate inharmonic sounds Animation demo http://www.acs.psu.edu/drussell/demos/membranecircle/ Circle.html 12

Resonance Forced oscillation The excitation force is continuous Amplify or modify the volume of the oscillation Extreme case: https://www.youtube.com/watch?v=j-zczjxsxnw Oscillation in pipe Coupled with vibration of reed or blowing Oscillation in cavity Guitar body Tube resonators in xylophone and marimba Bass reflex in woofer Vocal Tract 13

Some Interesting Videos Visualizing standing waves http://www.nigelstanford.com/cymatics/ (Chladni plates) The visual microphone Capturing vibration using video: http://people.csail.mit.edu/mrub/visualmic/ 14

Sound Reception Human ear: a series of highly sensitive transducers Outer to middle: air vibration to mechanical vibration Middle to inner: mechanical vibration to fluid vibration Inner to auditory nerve: fluid vibration to nerve firings (Cook, 1999) 15

Outer Ear Pinnae Collect sounds http://www.douglas-self.com/museum/comms/ear/ear.htm Related to recognize the direction of sound c.f. Head-related transfer function (HRTF) Auditory canal Protect ear drums Quarter-wave resonance: boost the vibration around 3kHz by 15-20 db Ear drum Membrane that transduces air vibration to mechanical vibration Malleus (hammer) is attached to it 16

Middle Ear Ossicles malleus (hammer), incus (anvil) and stapes(stirrup) The smallest bones in human body Impedance matching: between air pressure (outer) and fluid (inner) Without ossicles, only about 1/30 of the sound energy would have been transferred to inner ears Amplification Work as a lever: membrane size changes from the large (ear drum) to the small (oval windows) Muscles Reduce the sound transmission in response to loud sounds 17

Inner ears Cochlea: transduces fluid vibration to nerve firing Basilar membrane Fluctuate at different positions selectively according to the frequency of incoming vibration Similar to a bank of band-pass filters http://acousticslab.org/psychoacoustics/pmfiles/module03a.htm Frequency resolution becomes worse as frequency increases Organ of Corti One row of inner hair-cell: fire neural spikes Three rows of outer hair-cell: gain control Oval window Round window (Cook, 1999) 18

Auditory Transduction Video Auditory Transduction http://www.youtube.com/watch?v=petrigtenoc 19

Sound Properties Loudness, Pitch, Timbre These are psychological (or perceptual) properties of sound They are associated with various physical properties: e.g. amplitude (or pressure), fundamental frequency, spectrum, envelope and duration 20

Loudness Perceptual correlate of pressure (or amplitude) Attribute of auditory sensation in terms of the order on a scale extending from quiet to loud (ANSI, 1994) Based on subjective measure Loudness depends on not only sound intensity but also frequency, bandwidth and duration 21

Sound Pressure Level Objective measures of sound strength Sound pressure is a physically measured amplitude of sound Decibel scale Relative quantity to a reference. Sound Pressure Level (SPL): 20 log 10 (P / P 0 ) P 0 = 20µPa : threshold of human hearing Source: hip://www.audioholics.com/home- theater- connec0on/basic- home- theater- setup- guide/splmeter500x332.jpg/image_view_fullscreen SPL meter 22

Equal-Loudness Curve Loudness depends on frequency 1kH is used as a reference Most sensitive to 2-5KHz tones due to resonance in ears EQ curve by ears is a flipped version of the equal-loudness curve? See the threshold of hearing Do your own test: hip://newt.phys.unsw.edu.au/jw/hearing.html 23

Pitch Perceptual correlate of fundamental frequency (F0) Auditory attribute of sound according to which sounds can be ordered on a scale from low and high (ANSI, 1994) Measured by subjective test Pitch is mainly determined by fundamental frequency. However it also depends on pressure, spectrum, envelope and duration. Pitch and fundamental frequency are often exchangeable used However, note that they are actually different! 24

Pitch Perception Audible pitch range 20Hz to 20kHz Upper limits gradually decreases with age and also how much you are exposed to strong noises Pitch resolution Just noticeable difference (JND) depends on the frequency, the sound level, the duration of the tone. This is related to pitch scale 25

Pitch Scale Human ears are sensitive to frequency changes in a log scale Mel scale: pitch ratio of tones Bark scale: critical band measurement Musical pitch scale Music note (m) and frequency (f) in Hz f m =12log 2 ( )+ 69, 440 f = 440 2 (m 69) 12 26

Timbre Attribute of sensation by which a listener can judge two sounds having the same loudness and pitch are dissimilar (ANSI) Tone color or quality that defines a particular sound Class: piano, guitar, singing voice, engine sound Identity: Steinway, Fender Stratocaster, MJ, Harley Davisson Timbre is a very vague concept There is no single quantitative scale like loudness or pitch 27

Timbre Perception Determined by multiple physical attributes Harmonicity: ratio between tonal and noise-like characteristics Time envelope (ADSR) Spectral envelope Changes of spectral envelope and fundamental frequency The onset of a sound differing notably from the sustained vibration ADSR Changes of spectral envelope 28

Timbre Perception Determined by multiple parameters 29