Short-Time Fourier Transform
|
|
- Natalie Wilson
- 5 years ago
- Views:
Transcription
1 @ SNHCC, TIGP April, 2018 Short-Time Fourier Transform Yi-Hsuan Yang Ph.D. Music & Audio Computing Lab, Research Center for IT Innovation, Academia Sinica
2 Sampling Rate Def: number of samples per second Why: analog to digital Examples EEG signal: 128 Hz Telephone audio: 8k Hz Music audio: 44k HZ MATLAB code ephalogram-eeg-brainwaves/ [a,sr] = wavread( ) % sr = sampling rate length(a) % length of the signal in number of samples length(a)/sr % length of the signal in seconds 2
3 Sampling Rate (Cont ) MATLAB code a2 = downsample(a,2); sr2 = sr/2; length(a2) % length of the signal in number of samples length(a2)/sr2 % length of the signal in seconds wavwrite(a2,sr2, test.wav') 3
4 Sinusoids MATLAB code sr = 200; t = 0:1/sr:1; f0 = 10; % frequency a = 1; % amplitude y = a*sin(2*pi*f0*t + pi/2); stem(t,y) Why? sin(2*pi*f0*t + pi/2) = 1, when t = 1/f0, 2/f0, 3/f0, 4/f0, frequency = inverse of the period 4
5 Nyquist Shannon Sampling Theorem A signal must be sampled at least twice as fast as the bandwidth of the signal to accurately reconstruct the waveform; otherwise, the high-frequency content will alias at a frequency inside the spectrum of interest Sampling freq > 2* the highest freq in the signal 01/siggenhelp/fund_nyquist_and_shannon_theorems/ 5
6 Nyquist Shannon Sampling Theorem f0 = 10 y = sin(2*pi*f0*t) 6
7 Nyquist Shannon Sampling Theorem Telephone audio: 8k Hz Via phone, we cannot hear frequency higher than 4k Hz Question: With sr=128 Hz, we assume that we don t need to care freq higher than Hz in brain waves 7
8 Nyquist Shannon Sampling Theorem Question: With sr=128 Hz, we assume that we don t need to care freq higher than 64 Hz in brain waves 8
9 Fourier Transform To get the spectrum of a signal MATLAB code doc fft Y = abs(fft(y)); 9
10 Fourier Transform MATLAB code x1 = 0.7*sin(2*pi*50*t); x2 = sin(2*pi*120*t); 10
11 Fourier Transform Problem: cannot localize signal of interest 11
12 Fourier Transform Problem: cannot localize signal of interest 12
13 Short Time Fourier Transform (STFT) Windowed version of the Fourier Transform Output: a time-frequency representation MATLAB code html doc spectrogram spectrogram(y,window,noverlap,nfft) spectrogram(y,100,50,100,sr,'yaxis') 13
14 Short Time Fourier Transform (STFT) 14
15 Short Time Fourier Transform (STFT) 15
16 Short Time Fourier Transform (STFT) window size =
17 Short Time Fourier Transform (STFT) window size =
18 Short Time Fourier Transform (STFT) Hop size hop_size = win_size hop_size = 0.5*win_size hop_size = 0.1*win_size 18
19 Quiz Time 1. When the sampling rate (sr) is 1k Hz, what would be the time interval (in seconds) between two neighboring samples? t 2. When the sr=1k Hz, if we use a window size of 100 samples for the STFT, what is the actual duration of the window (in seconds)? 19
20 Quiz Time 3. When the sr=1k Hz and we use we use a STFT a STFT window window size of 100 size of samples 100 samples with no with no overlaps between consecutive windows, how many how many times times do we do need we to move need to the move window the to cover a window signal with to cover 300 samples? a signal with 300 samples? 4. And, if there is 50% overlaps between windows, how many times do we need to move the window? 20
21 Quiz Time 5. Given the following spectrogrms, try to draw the corresponding waveforms 21
22 Quiz Time 5. Given the following spectrogrms, try to draw the corresponding waveforms (SOLUTION) 22
23 Quiz Time 6. Given the following spectrogrms, try to draw the corresponding the spectra computed by Fourier Transform 23
24 Quiz Time 6. Given the following spectrogrms, try to draw the corresponding the spectra computed by Fourier Transform (SOLUTION) 24
25 Quiz Time MATLAB code for (c) sr = 1e3; f = 100; t1 = 1/sr:1/sr:1; t2 = 1/sr:1/sr:0.5; y1 = [sin(2*pi*f*t2) zeros(1,1.5*sr)]; y2 = [zeros(1,sr) sin(2*pi*f/2*t1)]; y = [y1+y2]; figure(1), spectrogram(y,256,250,256,1e3,'yaxis') figure(2), plot(t,y) figure(3), NFFT = 2^nextpow2(length(y)); Y = fft(y,nfft)/length(y); ff = sr/2*linspace(0,1,nfft/2+1); plot(ff,2*abs(y(1:nfft/2+1))) 25
26 Understanding STFT Different window size (win_size = 50, 100, 150) size: 26 x 39 size: 51 x 19 size: 76 x 12 26
27 Understanding STFT Shorter window worse frequency resolu on Longer window worse temporal resolution size: 26 x 39 size: 51 x 19 size: 76 x 12 27
28 Understanding STFT f_max = sr/2 sampling freq > 2* the highest freq in the signal (Nyquist Shannon sampling theorem) size: 26 x 39 size: 51 x 19 size: 76 x 12 28
29 Understanding STFT freq_resolution = sr/win_size longer window better frequency resolution freq_resolution = 20, 10, (Hz), respectively size: 26 x 39 size: 51 x 19 size: 76 x 12 29
30 Understanding STFT freq_resolution = sr/win_size longer window be er frequency resolu on freq_resolution = 20, 10, (Hz), respectively 30
31 Understanding STFT temporal_resolution: hop_size longer window worse temporal resolution temp_resolution = 25, 50, 75 (ms), respectively 31
32 Trade-off Between Temp/Freq Resolution sr = 1000; hop_size = win_size/2; win_size (sample) freq_resolution (hz) temp_resolution (ms) Shorter window worse frequency resolution win_size = 150 can distinguish two frequency components that differ by 8 Hz, but others cannot Longer window worse temporal resolution win_size = 50 can distinguish two neighboring events that differ in time by 40ms, but others cannot 32
33 Quiz Time 1. The figure on the top-right is the spectrogram of a signal. What is the sampling rate of this signal? 2. The figure on the bottom-right is a zoom-in of the above figure. We can see that the frequency resolution is 20 Hz. What is the window size (in samples)? 3. The temporal resolution is close to 6.6 ms. What s the hop size (in samples), approximately? 33
34 Quiz Time 4. Given an EEG headset that samples signals at 128 Hz, if we want to be able to discriminate frequency components that differ by 0.5 Hz in frequency, what is the minimal window size (in samples) we need to use? What is the length of such a window in seconds then? 5. Following the previous question, if we further want to discriminate events that differ in time by 0.5 second, what is the maximal hop size (in samples) we need to use? 34
35 Quiz Time 6. Given a music signal with sr = 44,100 Hz, when we use a window size of 1,024 samples, what would be the frequency resolution? 7. According to the figure on the right, we know that the fundamental frequency (f0) of A1 is 55 Hz, that of A 1 is Hz, etc. Following the previous question, which notes does the first frequency bin in the STFT cover? 35
36 Quiz Time 6. Given a music signal with sr = 44,100 Hz, when we use a window size of 1,024 samples, what would be the frequency resolution? Sol: 43.1 Hz 7. According to the figure on the right, we know that the fundamental frequency (f0) of A1 is 55 Hz, that of A 1 is Hz, etc. Following the previous question, which notes does the first frequency bin in the STFT cover? [0, 43.1) [43.1, 86.2) [86.2, 129.3) [129.3, 172.4) [172.4, 215.5) 36
37 Quiz Time 8. Given a music signal with sr = 44,100 Hz, how if we use a window size of 4,096 samples? [0, 10.8) [10.8, 21.5) [21.5, 32.3) [32.3, 43.1) [43.1, 53.8) [21.5, 32.3) [32.3, 43.1) [43.1, 53.8) 9. Following the previous question, now the STFT can distinguish musical notes after the F 3 note.
38 Mel-Spectrogram The mel scale is a perceptual scale of pitches judged by listeners to be equal in distance from one another Finer resolution in the low-frequency range Dimension reduction linear scale mel scale 38
39 Feature Extraction Spectrogram mel-spectrogram MFCC ( mbre) Spectrogram CQT chroma feature (harmony) Feature learning and deep architectures: new directions for music informatics, J Intell Inf Syst (2013) 39
40 Feature Learning by Convolutional Layers Deep learning and music adversaries, IEEE Trans. Multimedia (2015) 40
Digital Signal. Continuous. Continuous. amplitude. amplitude. Discrete-time Signal. Analog Signal. Discrete. Continuous. time. time.
Discrete amplitude Continuous amplitude Continuous amplitude Digital Signal Analog Signal Discrete-time Signal Continuous time Discrete time Digital Signal Discrete time 1 Digital Signal contd. Analog
More informationLecture 10 Harmonic/Percussive Separation
10420CS 573100 音樂資訊檢索 Music Information Retrieval Lecture 10 Harmonic/Percussive Separation Yi-Hsuan Yang Ph.D. http://www.citi.sinica.edu.tw/pages/yang/ yang@citi.sinica.edu.tw Music & Audio Computing
More informationLecture 9 Source Separation
10420CS 573100 音樂資訊檢索 Music Information Retrieval Lecture 9 Source Separation Yi-Hsuan Yang Ph.D. http://www.citi.sinica.edu.tw/pages/yang/ yang@citi.sinica.edu.tw Music & Audio Computing Lab, Research
More informationSupplementary Course Notes: Continuous vs. Discrete (Analog vs. Digital) Representation of Information
Supplementary Course Notes: Continuous vs. Discrete (Analog vs. Digital) Representation of Information Introduction to Engineering in Medicine and Biology ECEN 1001 Richard Mihran In the first supplementary
More informationPitch. The perceptual correlate of frequency: the perceptual dimension along which sounds can be ordered from low to high.
Pitch The perceptual correlate of frequency: the perceptual dimension along which sounds can be ordered from low to high. 1 The bottom line Pitch perception involves the integration of spectral (place)
More informationExperiments on musical instrument separation using multiplecause
Experiments on musical instrument separation using multiplecause models J Klingseisen and M D Plumbley* Department of Electronic Engineering King's College London * - Corresponding Author - mark.plumbley@kcl.ac.uk
More informationBook: Fundamentals of Music Processing. Audio Features. Book: Fundamentals of Music Processing. Book: Fundamentals of Music Processing
Book: Fundamentals of Music Processing Lecture Music Processing Audio Features Meinard Müller International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de Meinard Müller Fundamentals
More informationTempo and Beat Analysis
Advanced Course Computer Science Music Processing Summer Term 2010 Meinard Müller, Peter Grosche Saarland University and MPI Informatik meinard@mpi-inf.mpg.de Tempo and Beat Analysis Musical Properties:
More informationCZT vs FFT: Flexibility vs Speed. Abstract
CZT vs FFT: Flexibility vs Speed Abstract Bluestein s Fast Fourier Transform (FFT), commonly called the Chirp-Z Transform (CZT), is a little-known algorithm that offers engineers a high-resolution FFT
More informationCSC475 Music Information Retrieval
CSC475 Music Information Retrieval Monophonic pitch extraction George Tzanetakis University of Victoria 2014 G. Tzanetakis 1 / 32 Table of Contents I 1 Motivation and Terminology 2 Psychacoustics 3 F0
More informationRobert Alexandru Dobre, Cristian Negrescu
ECAI 2016 - International Conference 8th Edition Electronics, Computers and Artificial Intelligence 30 June -02 July, 2016, Ploiesti, ROMÂNIA Automatic Music Transcription Software Based on Constant Q
More informationMIE 402: WORKSHOP ON DATA ACQUISITION AND SIGNAL PROCESSING Spring 2003
MIE 402: WORKSHOP ON DATA ACQUISITION AND SIGNAL PROCESSING Spring 2003 OBJECTIVE To become familiar with state-of-the-art digital data acquisition hardware and software. To explore common data acquisition
More informationDr. David A. Clifton Group Leader Computational Health Informatics (CHI) Lab Lecturer in Engineering Science, Balliol College
Dr. David A. Clifton Group Leader Computational Health Informatics (CHI) Lab Lecturer in Engineering Science, Balliol College 1. Introduction to Fourier analysis, the Fourier series 2. Sampling and Aliasing
More informationReal-time spectrum analyzer. Gianfranco Miele, Ph.D
Real-time spectrum analyzer Gianfranco Miele, Ph.D www.eng.docente.unicas.it/gianfranco_miele g.miele@unicas.it The evolution of RF signals Nowadays we can assist to the increasingly widespread success
More informationSampling. Sampling. CS 450: Introduction to Digital Signal and Image Processing. Bryan Morse BYU Computer Science
Sampling CS 450: Introduction to Digital Signal and Image Processing Bryan Morse BYU Computer Science Introduction Sampling f(t) Continuous t f(t) Discrete t Introduction Sampling Sampling a continuous
More informationCh. 1: Audio/Image/Video Fundamentals Multimedia Systems. School of Electrical Engineering and Computer Science Oregon State University
Ch. 1: Audio/Image/Video Fundamentals Multimedia Systems Prof. Ben Lee School of Electrical Engineering and Computer Science Oregon State University Outline Computer Representation of Audio Quantization
More informationQUIZ. Explain in your own words the two types of changes that a signal experiences while propagating. Give examples!
QUIZ Explain in your own words the two types of changes that a signal experiences while propagating. Give examples! QUIZ Explain why it s bad for technical standards to be developed: too early too late
More informationni.com Digital Signal Processing for Every Application
Digital Signal Processing for Every Application Digital Signal Processing is Everywhere High-Volume Image Processing Production Test Structural Sound Health and Vibration Monitoring RF WiMAX, and Microwave
More informationPlease feel free to download the Demo application software from analogarts.com to help you follow this seminar.
Hello, welcome to Analog Arts spectrum analyzer tutorial. Please feel free to download the Demo application software from analogarts.com to help you follow this seminar. For this presentation, we use a
More informationFFT Laboratory Experiments for the HP Series Oscilloscopes and HP 54657A/54658A Measurement Storage Modules
FFT Laboratory Experiments for the HP 54600 Series Oscilloscopes and HP 54657A/54658A Measurement Storage Modules By: Michael W. Thompson, PhD. EE Dept. of Electrical Engineering Colorado State University
More informationLab 5 Linear Predictive Coding
Lab 5 Linear Predictive Coding 1 of 1 Idea When plain speech audio is recorded and needs to be transmitted over a channel with limited bandwidth it is often necessary to either compress or encode the audio
More informationLaboratory Assignment 3. Digital Music Synthesis: Beethoven s Fifth Symphony Using MATLAB
Laboratory Assignment 3 Digital Music Synthesis: Beethoven s Fifth Symphony Using MATLAB PURPOSE In this laboratory assignment, you will use MATLAB to synthesize the audio tones that make up a well-known
More informationA Parametric Autoregressive Model for the Extraction of Electric Network Frequency Fluctuations in Audio Forensic Authentication
Journal of Energy and Power Engineering 10 (2016) 504-512 doi: 10.17265/1934-8975/2016.08.007 D DAVID PUBLISHING A Parametric Autoregressive Model for the Extraction of Electric Network Frequency Fluctuations
More informationLab P-6: Synthesis of Sinusoidal Signals A Music Illusion. A k cos.! k t C k / (1)
DSP First, 2e Signal Processing First Lab P-6: Synthesis of Sinusoidal Signals A Music Illusion Pre-Lab: Read the Pre-Lab and do all the exercises in the Pre-Lab section prior to attending lab. Verification:
More informationGCT535- Sound Technology for Multimedia Timbre Analysis. Graduate School of Culture Technology KAIST Juhan Nam
GCT535- Sound Technology for Multimedia Timbre Analysis Graduate School of Culture Technology KAIST Juhan Nam 1 Outlines Timbre Analysis Definition of Timbre Timbre Features Zero-crossing rate Spectral
More informationMusic Segmentation Using Markov Chain Methods
Music Segmentation Using Markov Chain Methods Paul Finkelstein March 8, 2011 Abstract This paper will present just how far the use of Markov Chains has spread in the 21 st century. We will explain some
More informationMUSIC/AUDIO ANALYSIS IN PYTHON. Vivek Jayaram
MUSIC/AUDIO ANALYSIS IN PYTHON Vivek Jayaram WHY AUDIO SIGNAL PROCESSING? My background as a DJ and CS student Music is everywhere! So many possibilities Many parallels to computer vision SOME APPLICATIONS
More informationA Matlab toolbox for. Characterisation Of Recorded Underwater Sound (CHORUS) USER S GUIDE
Centre for Marine Science and Technology A Matlab toolbox for Characterisation Of Recorded Underwater Sound (CHORUS) USER S GUIDE Version 5.0b Prepared for: Centre for Marine Science and Technology Prepared
More informationCourse Web site:
The University of Texas at Austin Spring 2018 EE 445S Real- Time Digital Signal Processing Laboratory Prof. Evans Solutions for Homework #1 on Sinusoids, Transforms and Transfer Functions 1. Transfer Functions.
More informationELEC 691X/498X Broadcast Signal Transmission Fall 2015
ELEC 691X/498X Broadcast Signal Transmission Fall 2015 Instructor: Dr. Reza Soleymani, Office: EV 5.125, Telephone: 848 2424 ext.: 4103. Office Hours: Wednesday, Thursday, 14:00 15:00 Time: Tuesday, 2:45
More informationReal-Time Spectrogram (RTS tm )
Real-Time Spectrogram (RTS tm ) View, edit and measure digital sound files The Real-Time Spectrogram (RTS tm ) displays the time-aligned spectrogram and waveform of a continuous sound file. The RTS can
More informationCAP240 First semester 1430/1431. Sheet 4
King Saud University College of Computer and Information Sciences Department of Information Technology CAP240 First semester 1430/1431 Sheet 4 Multiple choice Questions 1-Unipolar, bipolar, and polar encoding
More informationDIGITAL COMMUNICATION
10EC61 DIGITAL COMMUNICATION UNIT 3 OUTLINE Waveform coding techniques (continued), DPCM, DM, applications. Base-Band Shaping for Data Transmission Discrete PAM signals, power spectra of discrete PAM signals.
More informationModule 1: Digital Video Signal Processing Lecture 3: Characterisation of Video raster, Parameters of Analog TV systems, Signal bandwidth
The Lecture Contains: Analog Video Raster Interlaced Scan Characterization of a video Raster Analog Color TV systems Signal Bandwidth Digital Video Parameters of a digital video Pixel Aspect Ratio file:///d
More informationBrain-Computer Interface (BCI)
Brain-Computer Interface (BCI) Christoph Guger, Günter Edlinger, g.tec Guger Technologies OEG Herbersteinstr. 60, 8020 Graz, Austria, guger@gtec.at This tutorial shows HOW-TO find and extract proper signal
More informationEffects of acoustic degradations on cover song recognition
Signal Processing in Acoustics: Paper 68 Effects of acoustic degradations on cover song recognition Julien Osmalskyj (a), Jean-Jacques Embrechts (b) (a) University of Liège, Belgium, josmalsky@ulg.ac.be
More informationVoice Controlled Car System
Voice Controlled Car System 6.111 Project Proposal Ekin Karasan & Driss Hafdi November 3, 2016 1. Overview Voice controlled car systems have been very important in providing the ability to drivers to adjust
More informationSINGING PITCH EXTRACTION BY VOICE VIBRATO/TREMOLO ESTIMATION AND INSTRUMENT PARTIAL DELETION
th International Society for Music Information Retrieval Conference (ISMIR ) SINGING PITCH EXTRACTION BY VOICE VIBRATO/TREMOLO ESTIMATION AND INSTRUMENT PARTIAL DELETION Chao-Ling Hsu Jyh-Shing Roger Jang
More informationMusical Acoustics Lecture 15 Pitch & Frequency (Psycho-Acoustics)
1 Musical Acoustics Lecture 15 Pitch & Frequency (Psycho-Acoustics) Pitch Pitch is a subjective characteristic of sound Some listeners even assign pitch differently depending upon whether the sound was
More informationAN ARTISTIC TECHNIQUE FOR AUDIO-TO-VIDEO TRANSLATION ON A MUSIC PERCEPTION STUDY
AN ARTISTIC TECHNIQUE FOR AUDIO-TO-VIDEO TRANSLATION ON A MUSIC PERCEPTION STUDY Eugene Mikyung Kim Department of Music Technology, Korea National University of Arts eugene@u.northwestern.edu ABSTRACT
More informationECE438 - Laboratory 4: Sampling and Reconstruction of Continuous-Time Signals
Purdue University: ECE438 - Digital Signal Processing with Applications 1 ECE438 - Laboratory 4: Sampling and Reconstruction of Continuous-Time Signals October 6, 2010 1 Introduction It is often desired
More informationIntroduction to Data Conversion and Processing
Introduction to Data Conversion and Processing The proliferation of digital computing and signal processing in electronic systems is often described as "the world is becoming more digital every day." Compared
More informationDepartment of Communication Engineering Digital Communication Systems Lab CME 313-Lab
German Jordanian University Department of Communication Engineering Digital Communication Systems Lab CME 313-Lab Experiment 3 Pulse Code Modulation Eng. Anas Alashqar Dr. Ala' Khalifeh 1 Experiment 2Experiment
More informationDigital music synthesis using DSP
Digital music synthesis using DSP Rahul Bhat (124074002), Sandeep Bhagwat (123074011), Gaurang Naik (123079009), Shrikant Venkataramani (123079042) DSP Application Assignment, Group No. 4 Department of
More informationA Parametric Autoregressive Model for the Extraction of Electric Network Frequency Fluctuations in Audio Forensic Authentication
Proceedings of the 3 rd International Conference on Control, Dynamic Systems, and Robotics (CDSR 16) Ottawa, Canada May 9 10, 2016 Paper No. 110 DOI: 10.11159/cdsr16.110 A Parametric Autoregressive Model
More informationFigure 1: Feature Vector Sequence Generator block diagram.
1 Introduction Figure 1: Feature Vector Sequence Generator block diagram. We propose designing a simple isolated word speech recognition system in Verilog. Our design is naturally divided into two modules.
More informationMusic Genre Classification
Music Genre Classification chunya25 Fall 2017 1 Introduction A genre is defined as a category of artistic composition, characterized by similarities in form, style, or subject matter. [1] Some researchers
More informationSpectrum Analyser Basics
Hands-On Learning Spectrum Analyser Basics Peter D. Hiscocks Syscomp Electronic Design Limited Email: phiscock@ee.ryerson.ca June 28, 2014 Introduction Figure 1: GUI Startup Screen In a previous exercise,
More informationPS User Guide Series Seismic-Data Display
PS User Guide Series 2015 Seismic-Data Display Prepared By Choon B. Park, Ph.D. January 2015 Table of Contents Page 1. File 2 2. Data 2 2.1 Resample 3 3. Edit 4 3.1 Export Data 4 3.2 Cut/Append Records
More informationhit), and assume that longer incidental sounds (forest noise, water, wind noise) resemble a Gaussian noise distribution.
CS 229 FINAL PROJECT A SOUNDHOUND FOR THE SOUNDS OF HOUNDS WEAKLY SUPERVISED MODELING OF ANIMAL SOUNDS ROBERT COLCORD, ETHAN GELLER, MATTHEW HORTON Abstract: We propose a hybrid approach to generating
More information10:15-11 am Digital signal processing
1 10:15-11 am Digital signal processing Data Conversion & Sampling Sampled Data Systems Data Converters Analog to Digital converters (A/D ) Digital to Analog converters (D/A) with Zero Order Hold Signal
More informationFundamentals of DSP Chap. 1: Introduction
Fundamentals of DSP Chap. 1: Introduction Chia-Wen Lin Dept. CSIE, National Chung Cheng Univ. Chiayi, Taiwan Office: 511 Phone: #33120 Digital Signal Processing Signal Processing is to study how to represent,
More informationIntroduction to Digital Signal Processing (DSP)
Introduction to Digital Processing (DSP) Elena Punskaya www-sigproc.eng.cam.ac.uk/~op205 Some material adapted from courses by Prof. Simon Godsill, Dr. Arnaud Doucet, Dr. Malcolm Macleod and Prof. Peter
More informationEfficient Vocal Melody Extraction from Polyphonic Music Signals
http://dx.doi.org/1.5755/j1.eee.19.6.4575 ELEKTRONIKA IR ELEKTROTECHNIKA, ISSN 1392-1215, VOL. 19, NO. 6, 213 Efficient Vocal Melody Extraction from Polyphonic Music Signals G. Yao 1,2, Y. Zheng 1,2, L.
More informationRealizing Waveform Characteristics up to a Digitizer s Full Bandwidth Increasing the effective sampling rate when measuring repetitive signals
Realizing Waveform Characteristics up to a Digitizer s Full Bandwidth Increasing the effective sampling rate when measuring repetitive signals By Jean Dassonville Agilent Technologies Introduction The
More informationAgilent PN Time-Capture Capabilities of the Agilent Series Vector Signal Analyzers Product Note
Agilent PN 89400-10 Time-Capture Capabilities of the Agilent 89400 Series Vector Signal Analyzers Product Note Figure 1. Simplified block diagram showing basic signal flow in the Agilent 89400 Series VSAs
More informationLaboratory 5: DSP - Digital Signal Processing
Laboratory 5: DSP - Digital Signal Processing OBJECTIVES - Familiarize the students with Digital Signal Processing using software tools on the treatment of audio signals. - To study the time domain and
More informationExperiment P32: Sound Waves (Sound Sensor)
PASCO scientific Vol. 2 Physics Lab Manual P32-1 Experiment P32: (Sound Sensor) Concept Time SW Interface Macintosh file Windows file waves 45 m 700 P32 P32_SOUN.SWS EQUIPMENT NEEDED Interface musical
More informationDepartment of Electrical & Electronic Engineering Imperial College of Science, Technology and Medicine. Project: Real-Time Speech Enhancement
Department of Electrical & Electronic Engineering Imperial College of Science, Technology and Medicine Project: Real-Time Speech Enhancement Introduction Telephones are increasingly being used in noisy
More informationGG450 4/12/2010. Today s material comes from p in the text book. Please read and understand all of this material!
GG450 April 13, 2010 Seismic Reflection III Data Processing Today s material comes from p. 163-198 in the text book. Please read and understand all of this material! Reflection Processing We've been talking
More informationPolyphonic music transcription through dynamic networks and spectral pattern identification
Polyphonic music transcription through dynamic networks and spectral pattern identification Antonio Pertusa and José M. Iñesta Departamento de Lenguajes y Sistemas Informáticos Universidad de Alicante,
More informationMusic Genre Classification and Variance Comparison on Number of Genres
Music Genre Classification and Variance Comparison on Number of Genres Miguel Francisco, miguelf@stanford.edu Dong Myung Kim, dmk8265@stanford.edu 1 Abstract In this project we apply machine learning techniques
More informationIEEE Santa Clara ComSoc/CAS Weekend Workshop Event-based analog sensing
IEEE Santa Clara ComSoc/CAS Weekend Workshop Event-based analog sensing Theodore Yu theodore.yu@ti.com Texas Instruments Kilby Labs, Silicon Valley Labs September 29, 2012 1 Living in an analog world The
More informationAuto-Tune. Collection Editors: Navaneeth Ravindranath Tanner Songkakul Andrew Tam
Auto-Tune Collection Editors: Navaneeth Ravindranath Tanner Songkakul Andrew Tam Auto-Tune Collection Editors: Navaneeth Ravindranath Tanner Songkakul Andrew Tam Authors: Navaneeth Ravindranath Blaine
More informationWhat s New in Raven May 2006 This document briefly summarizes the new features that have been added to Raven since the release of Raven
What s New in Raven 1.3 16 May 2006 This document briefly summarizes the new features that have been added to Raven since the release of Raven 1.2.1. Extensible multi-channel audio input device support
More informationMUSIC TONALITY FEATURES FOR SPEECH/MUSIC DISCRIMINATION. Gregory Sell and Pascal Clark
214 IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP) MUSIC TONALITY FEATURES FOR SPEECH/MUSIC DISCRIMINATION Gregory Sell and Pascal Clark Human Language Technology Center
More informationOn Human Capability and Acoustic Cues for Discriminating Singing and Speaking Voices
On Human Capability and Acoustic Cues for Discriminating Singing and Speaking Voices Yasunori Ohishi 1 Masataka Goto 3 Katunobu Itou 2 Kazuya Takeda 1 1 Graduate School of Information Science, Nagoya University,
More informationFeatures for Audio and Music Classification
Features for Audio and Music Classification Martin F. McKinney and Jeroen Breebaart Auditory and Multisensory Perception, Digital Signal Processing Group Philips Research Laboratories Eindhoven, The Netherlands
More informationDAT335 Music Perception and Cognition Cogswell Polytechnical College Spring Week 6 Class Notes
DAT335 Music Perception and Cognition Cogswell Polytechnical College Spring 2009 Week 6 Class Notes Pitch Perception Introduction Pitch may be described as that attribute of auditory sensation in terms
More informationSinging Pitch Extraction and Singing Voice Separation
Singing Pitch Extraction and Singing Voice Separation Advisor: Jyh-Shing Roger Jang Presenter: Chao-Ling Hsu Multimedia Information Retrieval Lab (MIR) Department of Computer Science National Tsing Hua
More informationDrum Source Separation using Percussive Feature Detection and Spectral Modulation
ISSC 25, Dublin, September 1-2 Drum Source Separation using Percussive Feature Detection and Spectral Modulation Dan Barry φ, Derry Fitzgerald^, Eugene Coyle φ and Bob Lawlor* φ Digital Audio Research
More informationA prototype system for rule-based expressive modifications of audio recordings
International Symposium on Performance Science ISBN 0-00-000000-0 / 000-0-00-000000-0 The Author 2007, Published by the AEC All rights reserved A prototype system for rule-based expressive modifications
More informationTopic 10. Multi-pitch Analysis
Topic 10 Multi-pitch Analysis What is pitch? Common elements of music are pitch, rhythm, dynamics, and the sonic qualities of timbre and texture. An auditory perceptual attribute in terms of which sounds
More informationA Survey of Audio-Based Music Classification and Annotation
A Survey of Audio-Based Music Classification and Annotation Zhouyu Fu, Guojun Lu, Kai Ming Ting, and Dengsheng Zhang IEEE Trans. on Multimedia, vol. 13, no. 2, April 2011 presenter: Yin-Tzu Lin ( 阿孜孜 ^.^)
More informationAnalysis, Synthesis, and Perception of Musical Sounds
Analysis, Synthesis, and Perception of Musical Sounds The Sound of Music James W. Beauchamp Editor University of Illinois at Urbana, USA 4y Springer Contents Preface Acknowledgments vii xv 1. Analysis
More informationSpectral toolkit: practical music technology for spectralism-curious composers MICHAEL NORRIS
Spectral toolkit: practical music technology for spectralism-curious composers MICHAEL NORRIS Programme Director, Composition & Sonic Art New Zealand School of Music, Te Kōkī Victoria University of Wellington
More informationREPORT DOCUMENTATION PAGE
REPORT DOCUMENTATION PAGE Form Approved OMB No. 0704-0188 Public reporting burden for this collection of information is estimated to average 1 hour per response, including the time for reviewing instructions,
More information1 Overview. 1.1 Digital Images GEORGIA INSTITUTE OF TECHNOLOGY. ECE 2026 Summer 2018 Lab #5: Sampling: A/D and D/A & Aliasing
GEORGIA INSTITUTE OF TECHNOLOGY SCHOOL of ELECTRICAL and COMPUTER ENGINEERING ECE 2026 Summer 2018 Lab #5: Sampling: A/D and D/A & Aliasing Date: 21 June 2018 Pre-Lab: You should read the Pre-Lab section
More informationCalibrate, Characterize and Emulate Systems Using RFXpress in AWG Series
Calibrate, Characterize and Emulate Systems Using RFXpress in AWG Series Introduction System designers and device manufacturers so long have been using one set of instruments for creating digitally modulated
More informationExperiment 2: Sampling and Quantization
ECE431, Experiment 2, 2016 Communications Lab, University of Toronto Experiment 2: Sampling and Quantization Bruno Korst - bkf@comm.utoronto.ca Abstract In this experiment, you will see the effects caused
More informationAudio spectrogram representations for processing with Convolutional Neural Networks
Audio spectrogram representations for processing with Convolutional Neural Networks Lonce Wyse 1 1 National University of Singapore arxiv:1706.09559v1 [cs.sd] 29 Jun 2017 One of the decisions that arise
More informationVirtual Vibration Analyzer
Virtual Vibration Analyzer Vibration/industrial systems LabVIEW DAQ by Ricardo Jaramillo, Manager, Ricardo Jaramillo y Cía; Daniel Jaramillo, Engineering Assistant, Ricardo Jaramillo y Cía The Challenge:
More informationThe Effect of Time-Domain Interpolation on Response Spectral Calculations. David M. Boore
The Effect of Time-Domain Interpolation on Response Spectral Calculations David M. Boore This note confirms Norm Abrahamson s finding that the straight line interpolation between sampled points used in
More informationDigital Fundamentals. Introduction to Digital Signal Processing
Digital Fundamentals Introduction to Digital Signal Processing 1 Objectives List the essential elements in a digital signal processing system Explain how analog signals are converted to digital form Discuss
More information1 Overview. 1.1 Digital Images GEORGIA INSTITUTE OF TECHNOLOGY. ECE 2026 Summer 2016 Lab #6: Sampling: A/D and D/A & Aliasing
GEORGIA INSTITUTE OF TECHNOLOGY SCHOOL of ELECTRICAL and COMPUTER ENGINEERING ECE 2026 Summer 2016 Lab #6: Sampling: A/D and D/A & Aliasing Date: 30 June 2016 Pre-Lab: You should read the Pre-Lab section
More informationQuery By Humming: Finding Songs in a Polyphonic Database
Query By Humming: Finding Songs in a Polyphonic Database John Duchi Computer Science Department Stanford University jduchi@stanford.edu Benjamin Phipps Computer Science Department Stanford University bphipps@stanford.edu
More informationA NEW LOOK AT FREQUENCY RESOLUTION IN POWER SPECTRAL DENSITY ESTIMATION. Sudeshna Pal, Soosan Beheshti
A NEW LOOK AT FREQUENCY RESOLUTION IN POWER SPECTRAL DENSITY ESTIMATION Sudeshna Pal, Soosan Beheshti Electrical and Computer Engineering Department, Ryerson University, Toronto, Canada spal@ee.ryerson.ca
More informationSupervised Learning in Genre Classification
Supervised Learning in Genre Classification Introduction & Motivation Mohit Rajani and Luke Ekkizogloy {i.mohit,luke.ekkizogloy}@gmail.com Stanford University, CS229: Machine Learning, 2009 Now that music
More information2. AN INTROSPECTION OF THE MORPHING PROCESS
1. INTRODUCTION Voice morphing means the transition of one speech signal into another. Like image morphing, speech morphing aims to preserve the shared characteristics of the starting and final signals,
More informationPERCEPTUAL QUALITY COMPARISON BETWEEN SINGLE-LAYER AND SCALABLE VIDEOS AT THE SAME SPATIAL, TEMPORAL AND AMPLITUDE RESOLUTIONS. Yuanyi Xue, Yao Wang
PERCEPTUAL QUALITY COMPARISON BETWEEN SINGLE-LAYER AND SCALABLE VIDEOS AT THE SAME SPATIAL, TEMPORAL AND AMPLITUDE RESOLUTIONS Yuanyi Xue, Yao Wang Department of Electrical and Computer Engineering Polytechnic
More informationAdaptive Key Frame Selection for Efficient Video Coding
Adaptive Key Frame Selection for Efficient Video Coding Jaebum Jun, Sunyoung Lee, Zanming He, Myungjung Lee, and Euee S. Jang Digital Media Lab., Hanyang University 17 Haengdang-dong, Seongdong-gu, Seoul,
More informationUnderstanding. FFT Overlap Processing. A Tektronix Real-Time Spectrum Analyzer Primer
Understanding FFT Overlap Processing A Tektronix Real-Time Spectrum Analyzer Contents Introduction....................................................................................3 The Need for Seeing
More informationChapter 2 Signals. 2.1 Signals in the Wild One-Dimensional Continuous Time Signals
Chapter 2 Signals Lasciate ogni speranza, voi ch entrate. Dante Alighieri, The Divine Comedy We all send and receive signals. A letter or a phone call, a raised hand, a hunger cry signals are our information
More informationNanoGiant Oscilloscope/Function-Generator Program. Getting Started
Getting Started Page 1 of 17 NanoGiant Oscilloscope/Function-Generator Program Getting Started This NanoGiant Oscilloscope program gives you a small impression of the capabilities of the NanoGiant multi-purpose
More informationEE-217 Final Project The Hunt for Noise (and All Things Audible)
EE-217 Final Project The Hunt for Noise (and All Things Audible) 5-7-14 Introduction Noise is in everything. All modern communication systems must deal with noise in one way or another. Different types
More informationCS229 Project Report Polyphonic Piano Transcription
CS229 Project Report Polyphonic Piano Transcription Mohammad Sadegh Ebrahimi Stanford University Jean-Baptiste Boin Stanford University sadegh@stanford.edu jbboin@stanford.edu 1. Introduction In this project
More informationAudio Processing Exercise
Name: Date : Audio Processing Exercise In this exercise you will learn to load, playback, modify, and plot audio files. Commands for loading and characterizing an audio file To load an audio file (.wav)
More information1. INTRODUCTION. Index Terms Video Transcoding, Video Streaming, Frame skipping, Interpolation frame, Decoder, Encoder.
Video Streaming Based on Frame Skipping and Interpolation Techniques Fadlallah Ali Fadlallah Department of Computer Science Sudan University of Science and Technology Khartoum-SUDAN fadali@sustech.edu
More informationMUSIC TRANSCRIPTION USING INSTRUMENT MODEL
MUSIC TRANSCRIPTION USING INSTRUMENT MODEL YIN JUN (MSc. NUS) A THESIS SUBMITTED FOR THE DEGREE OF MASTER OF COMPUTER SCIENCE DEPARTMENT OF SCHOOL OF COMPUTING NATIONAL UNIVERSITY OF SINGAPORE 4 Acknowledgements
More informationAdaptive Resampling - Transforming From the Time to the Angle Domain
Adaptive Resampling - Transforming From the Time to the Angle Domain Jason R. Blough, Ph.D. Assistant Professor Mechanical Engineering-Engineering Mechanics Department Michigan Technological University
More information