Data Driven Music Understanding

Size: px
Start display at page:

Download "Data Driven Music Understanding"

Transcription

1 ata riven Music Understanding an Ellis Laboratory for Recognition and Organization of Speech and udio ept. Electrical Engineering, olumbia University, NY US 1. Motivation: What is Music? 2. Eigenrhythms 3. Melodic-Harmonic Fragments 4. Example pplications ata-riven Music Understanding - an Ellis /31

2 LabROS : Machine Listening Extracting useful information from sound escribe utomatic Narration Emotion Music Recommendation lassify Environment wareness SR Music Transcription Sound Intelligence V Speech/Music Environmental Sound Speech ectect Task... like (we) animals do ata-riven Music Understanding - an Ellis Music omain /31

3 1. Motivation: What is music? What does music evoke in a listener s mind?? Which are the things that we call music? ata-riven Music Understanding - an Ellis /31

4 Oodles of Music Bertin-Mahieux et al. 09 What can you do with a million tracks? ata-riven Music Understanding - an Ellis /31

5 Re-use in Music Serrà et al What are the most popular chord progressions in pop music? ata-riven Music Understanding - an Ellis /31

6 Potential pplications ompression lassification Manipulation ata-riven Music Understanding - an Ellis /31

7 2. Eigenrhythms: rum Track Structure To first order, all pop music has the same beat: Ellis & rroyo 04 an we learn this from examples? ata-riven Music Understanding - an Ellis /31

8 Basis Sets ombine a few basic patterns to make a larger dataset data weights X = W H patterns 1 = 0-1 ata-riven Music Understanding - an Ellis /31

9 rum Pattern ata Tempo normalization + downbeat alignment ata-riven Music Understanding - an Ellis /31

10 NMF Eigenrhythms Posirhythm 1 Posirhythm 2 HH HH SN SN B B Posirhythm 3 Posirhythm 4 HH HH SN SN B B Posirhythm 5 Posirhythm 6 HH HH SN SN B B samples (@ beats (@ 120 Nonnegative: only add beat-weight ata-riven Music Understanding - an Ellis /31

11 Eigenrhythm BeatBox Resynthesize rhythms from eigen-space ata-riven Music Understanding - an Ellis /31

12 3. Melodic-Harmonic Fragments How similar are two pieces? an we find all the pop-music clichés? ata-riven Music Understanding - an Ellis /31

13 MF Features Used in speech recognition Let It Be (LIB-1) - log-freq specgram freq / Hz MFs oefficient Noise excited MF resynthesis (LIB-2) freq / Hz time / sec ata-riven Music Understanding - an Ellis /31

14 hroma Features Idea: Project onto 12 semitones regardless of octave Fujishima 1999 chroma F freq / khz chroma F fft bin time / sec time / frame M X = mapping signal chroma ata-riven Music Understanding - an Ellis /31

15 hroma Features To capture musical content Let It Be - log-freq specgram (LIB-1) freq / Hz chroma bin B E hroma features Shepard tone resynthesis of chroma (LIB-3) freq / Hz MF-filtered shepard tones (LIB-4) freq / Hz time / sec ata-riven Music Understanding - an Ellis /31

16 Beat-Synchronous hroma ompact representation of harmonies Let It Be - log-freq specgram (LIB-1) freq / Hz Onset envelope + beat times chroma bin B E Beat-synchronous chroma Beat-synchronous chroma + Shepard resynthesis (LIB-6) freq / Hz time / sec ata-riven Music Understanding - an Ellis /31

17 hord Recognition chroma bin E Beat synchronous chroma look like chords E- B-- --E ---F... can we transcribe them? time / sec Two approaches manual templates (prior knowledge) learned models (from training data) ata-riven Music Understanding - an Ellis /31

18 hord Recognition System nalogous to speech recognition aussian models of features for each chord Hidden Markov Models for chord transitions Sheh & Ellis 2003 Ellis & Weller 2010 Beat track udio Hz BPF hroma beat-synchronous chroma features HMM Viterbi chord labels test train Hz BPF hroma Root normalize aussian Unnormalize 24 auss models B E B E maj E B c min Labels Resample b E B a g ount transitions 24x24 transition matrix f e d c B F E E F B c d e f g a b ata-riven Music Understanding - an Ellis /31

19 hord Recognition Often works: udio freq / Hz Let It Be/06-Let It Be 240 round truth chord Beatsynchronous chroma Recognized E F B :min :min/b7 F:maj7 F:maj6 F :min a F F a :min/b7 F:maj But only 60-80% of the time ata-riven Music Understanding - an Ellis /31

20 What did the models learn? hord model centers (means) indicate chord templates : PP_ROT family model means (train18) IM OM7 MJ MIN MIN E F B (for -root chords) ata-riven Music Understanding - an Ellis /31

21 freq / khz Finding over Songs Little similarity in surface audio... Let It Be - The Beatles Let It Be / Beatles / verse 1 freq / khz Ellis & Poliner 07 Ravuri & Ellis 10 Let It Be - Nick ave Let It Be / Nick ave / verse time / sec time / se.. but appears in beat-chroma Beat-sync chroma features Beat-sync chroma features chroma F chroma F beats beat ata-riven Music Understanding - an Ellis /31

22 Large-Scale over Recognition 2 Fourier Transform Magnitude (2FTM) fixed-size feature to capture essence of chromagram: Bertin-Mahieux & Ellis 12 First results on finding covers in 1M songs verage rank meanp random 500, jumpcodes 2 308, FTM (50 P) 137, ata-riven Music Understanding - an Ellis /31

23 Finding ommon Fragments luster beat-synchronous chroma patches chroma bins F F F F # instances # instances # instances # instances # instances # instances # instances a20-top10x5-cp4-4p0 # instances time / beats ata-riven Music Understanding - an Ellis /31

24 lustered Fragments chroma bins F depeche mode 13-Ice Machine s roxette 03-Fireworks s F roxette 04-Waiting For The Rain s tori amos 11-Playboy Mommy s time / beats... for a dictionary of common themes? ata-riven Music Understanding - an Ellis /31

25 4. Example pplications: Music iscovery Berenzweig & Ellis 03 onnecting listeners to musicians ata-riven Music Understanding - an Ellis /31

26 Playlist eneration Mandel, Poliner, Ellis 06 Incremental learning of listeners preferences ata-riven Music Understanding - an Ellis /31

27 MajorMiner: Music Tagging escribe music using words Mandel & Ellis 07, 08 ata-riven Music Understanding - an Ellis /31

28 lassification Results lassifiers trained from top 50 tags 01 Soul Eyes freq / Hz _90s club trance end drum_bass singing horns punk samples silence quiet noise solo strings indie house alternative r_b funk soft ambient british distortion drum_machine country keyboard saxophone fast instrumental electronica 80s voice beat slow rap hip_hop jazz piano techno dance female bass vocal pop electronic rock synth male guitar drum time / s ata-riven Music Understanding - an Ellis /

29 Music Transcription feature representation Poliner & Ellis 05, 06, 07 feature vector Training data and features: MII, multi-track recordings, playback piano, & resampled audio (less than 28 mins of train audio). Normalized magnitude STFT. classification posteriors lassification: N-binary SVMs (one for ea. note). Independent frame-level classification on 10 ms grid. ist. to class bndy as posterior. hmm smoothing Temporal Smoothing: Two state (on/off) independent HMM for ea. note. Parameters learned from training data. Find Viterbi sequence for ea. note. ata-riven Music Understanding - an Ellis /31

30 MEPsoft Music Engineering rt Projects collaboration between EE and omputer Music enter with ouglas Repetto, Ron Weiss, and the rest of the MEP team ata-riven Music Understanding - an Ellis /31

31 onclusions Low-level features lassification and Similarity browsing discovery production Music audio Melody and notes Key and chords Tempo and beat Music Structure iscovery modeling generation curiosity Lots of data + noisy transcription + weak clustering musical insights? ata-riven Music Understanding - an Ellis /31

Data Driven Music Understanding

Data Driven Music Understanding Data Driven Music Understanding Dan Ellis Laboratory for Recognition and Organization of Speech and Audio Dept. Electrical Engineering, Columbia University, NY USA http://labrosa.ee.columbia.edu/ 1. Motivation:

More information

Music Information Retrieval for Jazz

Music Information Retrieval for Jazz Music Information Retrieval for Jazz Dan Ellis Laboratory for Recognition and Organization of Speech and Audio Dept. Electrical Eng., Columbia Univ., NY USA {dpwe,thierry}@ee.columbia.edu http://labrosa.ee.columbia.edu/

More information

Lecture 11: Chroma and Chords

Lecture 11: Chroma and Chords LN 4896 MUSI SINL PROSSIN Lecture 11: hroma and hords 1. eatures for Music udio 2. hroma eatures 3. hord Recognition an llis ept. lectrical ngineering, olumbia University dpwe@ee.columbia.edu http://www.ee.columbia.edu/~dpwe/e4896/

More information

Lecture 15: Research at LabROSA

Lecture 15: Research at LabROSA ELEN E4896 MUSIC SIGNAL PROCESSING Lecture 15: Research at LabROSA 1. Sources, Mixtures, & Perception 2. Spatial Filtering 3. Time-Frequency Masking 4. Model-Based Separation Dan Ellis Dept. Electrical

More information

Searching for Similar Phrases in Music Audio

Searching for Similar Phrases in Music Audio Searching for Similar Phrases in Music udio an Ellis Laboratory for Recognition and Organization of Speech and udio ept. Electrical Engineering, olumbia University, NY US http://labrosa.ee.columbia.edu/

More information

Extracting Information from Music Audio

Extracting Information from Music Audio Extracting Information from Music Audio Dan Ellis Laboratory for Recognition and Organization of Speech and Audio Dept. Electrical Engineering, Columbia University, NY USA http://labrosa.ee.columbia.edu/

More information

Extracting and Using Music Audio Information

Extracting and Using Music Audio Information Extracting and Using Music Audio Information Dan Ellis Laboratory for Recognition and Organization of Speech and Audio Dept. Electrical Engineering, Columbia University, NY USA http://labrosa.ee.columbia.edu/

More information

Chord Recognition. Aspects of Music. Musical Chords. Harmony: The Basis of Music. Musical Chords. Musical Chords. Music Processing.

Chord Recognition. Aspects of Music. Musical Chords. Harmony: The Basis of Music. Musical Chords. Musical Chords. Music Processing. dvanced ourse omputer Science Music Processing Summer Term 2 Meinard Müller, Verena Konz Saarland University and MPI Informatik meinard@mpi-inf.mpg.de hord Recognition spects of Music Melody Piece of music

More information

Effects of acoustic degradations on cover song recognition

Effects of acoustic degradations on cover song recognition Signal Processing in Acoustics: Paper 68 Effects of acoustic degradations on cover song recognition Julien Osmalskyj (a), Jean-Jacques Embrechts (b) (a) University of Liège, Belgium, josmalsky@ulg.ac.be

More information

Aspects of Music. Chord Recognition. Musical Chords. Harmony: The Basis of Music. Musical Chords. Musical Chords. Piece of music. Rhythm.

Aspects of Music. Chord Recognition. Musical Chords. Harmony: The Basis of Music. Musical Chords. Musical Chords. Piece of music. Rhythm. Aspects of Music Lecture Music Processing Piece of music hord Recognition Meinard Müller International Audio Laboratories rlangen meinard.mueller@audiolabs-erlangen.de Melody Rhythm Harmony Harmony: The

More information

Music Alignment and Applications. Introduction

Music Alignment and Applications. Introduction Music Alignment and Applications Roger B. Dannenberg Schools of Computer Science, Art, and Music Introduction Music information comes in many forms Digital Audio Multi-track Audio Music Notation MIDI Structured

More information

Topic 11. Score-Informed Source Separation. (chroma slides adapted from Meinard Mueller)

Topic 11. Score-Informed Source Separation. (chroma slides adapted from Meinard Mueller) Topic 11 Score-Informed Source Separation (chroma slides adapted from Meinard Mueller) Why Score-informed Source Separation? Audio source separation is useful Music transcription, remixing, search Non-satisfying

More information

Beat-Synchronous Chroma Representations for Music Analysis

Beat-Synchronous Chroma Representations for Music Analysis Beat-Synchronous hroma Representations for Music nalysis an Ellis Laboratory for Recognition and Organization of Speech and udio ept. Electrical Eng., olumbia Univ., NY US dpwe@ee.columbia.edu http://labrosa.ee.columbia.edu/

More information

EE391 Special Report (Spring 2005) Automatic Chord Recognition Using A Summary Autocorrelation Function

EE391 Special Report (Spring 2005) Automatic Chord Recognition Using A Summary Autocorrelation Function EE391 Special Report (Spring 25) Automatic Chord Recognition Using A Summary Autocorrelation Function Advisor: Professor Julius Smith Kyogu Lee Center for Computer Research in Music and Acoustics (CCRMA)

More information

Topic 10. Multi-pitch Analysis

Topic 10. Multi-pitch Analysis Topic 10 Multi-pitch Analysis What is pitch? Common elements of music are pitch, rhythm, dynamics, and the sonic qualities of timbre and texture. An auditory perceptual attribute in terms of which sounds

More information

MUSI-6201 Computational Music Analysis

MUSI-6201 Computational Music Analysis MUSI-6201 Computational Music Analysis Part 9.1: Genre Classification alexander lerch November 4, 2015 temporal analysis overview text book Chapter 8: Musical Genre, Similarity, and Mood (pp. 151 155)

More information

Lecture 10 Harmonic/Percussive Separation

Lecture 10 Harmonic/Percussive Separation 10420CS 573100 音樂資訊檢索 Music Information Retrieval Lecture 10 Harmonic/Percussive Separation Yi-Hsuan Yang Ph.D. http://www.citi.sinica.edu.tw/pages/yang/ yang@citi.sinica.edu.tw Music & Audio Computing

More information

Music Information Retrieval

Music Information Retrieval CTP 431 Music and Audio Computing Music Information Retrieval Graduate School of Culture Technology (GSCT) Juhan Nam 1 Introduction ü Instrument: Piano ü Composer: Chopin ü Key: E-minor ü Melody - ELO

More information

CTP431- Music and Audio Computing Music Information Retrieval. Graduate School of Culture Technology KAIST Juhan Nam

CTP431- Music and Audio Computing Music Information Retrieval. Graduate School of Culture Technology KAIST Juhan Nam CTP431- Music and Audio Computing Music Information Retrieval Graduate School of Culture Technology KAIST Juhan Nam 1 Introduction ü Instrument: Piano ü Genre: Classical ü Composer: Chopin ü Key: E-minor

More information

Lecture 12: Alignment and Matching

Lecture 12: Alignment and Matching ELEN E4896 MUSIC SIGNAL PROCESSING Lecture 12: Alignment and Matching 1. Music Alignment 2. Cover Song Detection 3. Echo Nest Analyze Dan Ellis Dept. Electrical Engineering, Columbia University dpwe@ee.columbia.edu

More information

Week 14 Query-by-Humming and Music Fingerprinting. Roger B. Dannenberg Professor of Computer Science, Art and Music Carnegie Mellon University

Week 14 Query-by-Humming and Music Fingerprinting. Roger B. Dannenberg Professor of Computer Science, Art and Music Carnegie Mellon University Week 14 Query-by-Humming and Music Fingerprinting Roger B. Dannenberg Professor of Computer Science, Art and Music Overview n Melody-Based Retrieval n Audio-Score Alignment n Music Fingerprinting 2 Metadata-based

More information

THE importance of music content analysis for musical

THE importance of music content analysis for musical IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 15, NO. 1, JANUARY 2007 333 Drum Sound Recognition for Polyphonic Audio Signals by Adaptation and Matching of Spectrogram Templates With

More information

Sparse Representation Classification-Based Automatic Chord Recognition For Noisy Music

Sparse Representation Classification-Based Automatic Chord Recognition For Noisy Music Journal of Information Hiding and Multimedia Signal Processing c 2018 ISSN 2073-4212 Ubiquitous International Volume 9, Number 2, March 2018 Sparse Representation Classification-Based Automatic Chord Recognition

More information

NCEA Level 2 Music (91275) 2012 page 1 of 6. Assessment Schedule 2012 Music: Demonstrate aural understanding through written representation (91275)

NCEA Level 2 Music (91275) 2012 page 1 of 6. Assessment Schedule 2012 Music: Demonstrate aural understanding through written representation (91275) NCEA Level 2 Music (91275) 2012 page 1 of 6 Assessment Schedule 2012 Music: Demonstrate aural understanding through written representation (91275) Evidence Statement Question with Merit with Excellence

More information

Content-based music retrieval

Content-based music retrieval Music retrieval 1 Music retrieval 2 Content-based music retrieval Music information retrieval (MIR) is currently an active research area See proceedings of ISMIR conference and annual MIREX evaluations

More information

A CHROMA-BASED SALIENCE FUNCTION FOR MELODY AND BASS LINE ESTIMATION FROM MUSIC AUDIO SIGNALS

A CHROMA-BASED SALIENCE FUNCTION FOR MELODY AND BASS LINE ESTIMATION FROM MUSIC AUDIO SIGNALS A CHROMA-BASED SALIENCE FUNCTION FOR MELODY AND BASS LINE ESTIMATION FROM MUSIC AUDIO SIGNALS Justin Salamon Music Technology Group Universitat Pompeu Fabra, Barcelona, Spain justin.salamon@upf.edu Emilia

More information

ALIGNING SEMI-IMPROVISED MUSIC AUDIO WITH ITS LEAD SHEET

ALIGNING SEMI-IMPROVISED MUSIC AUDIO WITH ITS LEAD SHEET 12th International Society for Music Information Retrieval Conference (ISMIR 2011) LIGNING SEMI-IMPROVISED MUSIC UDIO WITH ITS LED SHEET Zhiyao Duan and Bryan Pardo Northwestern University Department of

More information

MELODY EXTRACTION BASED ON HARMONIC CODED STRUCTURE

MELODY EXTRACTION BASED ON HARMONIC CODED STRUCTURE 12th International Society for Music Information Retrieval Conference (ISMIR 2011) MELODY EXTRACTION BASED ON HARMONIC CODED STRUCTURE Sihyun Joo Sanghun Park Seokhwan Jo Chang D. Yoo Department of Electrical

More information

Can Song Lyrics Predict Genre? Danny Diekroeger Stanford University

Can Song Lyrics Predict Genre? Danny Diekroeger Stanford University Can Song Lyrics Predict Genre? Danny Diekroeger Stanford University danny1@stanford.edu 1. Motivation and Goal Music has long been a way for people to express their emotions. And because we all have a

More information

Lecture 9 Source Separation

Lecture 9 Source Separation 10420CS 573100 音樂資訊檢索 Music Information Retrieval Lecture 9 Source Separation Yi-Hsuan Yang Ph.D. http://www.citi.sinica.edu.tw/pages/yang/ yang@citi.sinica.edu.tw Music & Audio Computing Lab, Research

More information

Chord Classification of an Audio Signal using Artificial Neural Network

Chord Classification of an Audio Signal using Artificial Neural Network Chord Classification of an Audio Signal using Artificial Neural Network Ronesh Shrestha Student, Department of Electrical and Electronic Engineering, Kathmandu University, Dhulikhel, Nepal ---------------------------------------------------------------------***---------------------------------------------------------------------

More information

Music Genre Classification and Variance Comparison on Number of Genres

Music Genre Classification and Variance Comparison on Number of Genres Music Genre Classification and Variance Comparison on Number of Genres Miguel Francisco, miguelf@stanford.edu Dong Myung Kim, dmk8265@stanford.edu 1 Abstract In this project we apply machine learning techniques

More information

A System for Automatic Chord Transcription from Audio Using Genre-Specific Hidden Markov Models

A System for Automatic Chord Transcription from Audio Using Genre-Specific Hidden Markov Models A System for Automatic Chord Transcription from Audio Using Genre-Specific Hidden Markov Models Kyogu Lee Center for Computer Research in Music and Acoustics Stanford University, Stanford CA 94305, USA

More information

Chord Recognition with Stacked Denoising Autoencoders

Chord Recognition with Stacked Denoising Autoencoders Chord Recognition with Stacked Denoising Autoencoders Author: Nikolaas Steenbergen Supervisors: Prof. Dr. Theo Gevers Dr. John Ashley Burgoyne A thesis submitted in fulfilment of the requirements for the

More information

Tempo and Beat Analysis

Tempo and Beat Analysis Advanced Course Computer Science Music Processing Summer Term 2010 Meinard Müller, Peter Grosche Saarland University and MPI Informatik meinard@mpi-inf.mpg.de Tempo and Beat Analysis Musical Properties:

More information

A CLASSIFICATION APPROACH TO MELODY TRANSCRIPTION

A CLASSIFICATION APPROACH TO MELODY TRANSCRIPTION A CLASSIFICATION APPROACH TO MELODY TRANSCRIPTION Graham E. Poliner and Daniel P.W. Ellis LabROSA, Dept. of Electrical Engineering Columbia University, New York NY 127 USA {graham,dpwe}@ee.columbia.edu

More information

Jazz Melody Generation and Recognition

Jazz Melody Generation and Recognition Jazz Melody Generation and Recognition Joseph Victor December 14, 2012 Introduction In this project, we attempt to use machine learning methods to study jazz solos. The reason we study jazz in particular

More information

Preview Only. Legal Use Requires Purchase. Emily JAZZ. Music by JOHNNY MANDEL Words by JOHNNY MERCER Arranged by LISA DeSPAIN INSTRUMENTATION

Preview Only. Legal Use Requires Purchase. Emily JAZZ. Music by JOHNNY MANDEL Words by JOHNNY MERCER Arranged by LISA DeSPAIN INSTRUMENTATION a division of Alfred JAZZ Emily Music by JOHNNY MANDEL Words by JOHNNY MERCER Arranged by LISA DeSPAIN INSTRUMENTATION Conductor 1st Eb Alto Saxophone 2nd Eb Alto Saxophone 1st Bb Tenor Saxophone 2nd Bb

More information

Classification-Based Melody Transcription

Classification-Based Melody Transcription Classification-Based Melody Transcription Daniel P.W. Ellis and Graham E. Poliner LabROSA, Dept. of Electrical Engineering Columbia University, New York NY 10027 USA {dpwe,graham}@ee.columbia.edu February

More information

MUSIC/AUDIO ANALYSIS IN PYTHON. Vivek Jayaram

MUSIC/AUDIO ANALYSIS IN PYTHON. Vivek Jayaram MUSIC/AUDIO ANALYSIS IN PYTHON Vivek Jayaram WHY AUDIO SIGNAL PROCESSING? My background as a DJ and CS student Music is everywhere! So many possibilities Many parallels to computer vision SOME APPLICATIONS

More information

A PERPLEXITY BASED COVER SONG MATCHING SYSTEM FOR SHORT LENGTH QUERIES

A PERPLEXITY BASED COVER SONG MATCHING SYSTEM FOR SHORT LENGTH QUERIES 12th International Society for Music Information Retrieval Conference (ISMIR 2011) A PERPLEXITY BASED COVER SONG MATCHING SYSTEM FOR SHORT LENGTH QUERIES Erdem Unal 1 Elaine Chew 2 Panayiotis Georgiou

More information

1/18/17. MUSIC 232: Fundamentals of Music Teaching GB: Loops Only Project

1/18/17. MUSIC 232: Fundamentals of Music Teaching GB: Loops Only Project 1 2 3 MUSIC 232: Fundamentals of Music Teaching GB: Loops Only Project The purpose of the GB: Loops Only project is for course participants to demonstrate skills in arranging and manipulating loops using

More information

MUSIC CONTENT ANALYSIS : KEY, CHORD AND RHYTHM TRACKING IN ACOUSTIC SIGNALS

MUSIC CONTENT ANALYSIS : KEY, CHORD AND RHYTHM TRACKING IN ACOUSTIC SIGNALS MUSIC CONTENT ANALYSIS : KEY, CHORD AND RHYTHM TRACKING IN ACOUSTIC SIGNALS ARUN SHENOY KOTA (B.Eng.(Computer Science), Mangalore University, India) A THESIS SUBMITTED FOR THE DEGREE OF MASTER OF SCIENCE

More information

AUTOMASHUPPER: AN AUTOMATIC MULTI-SONG MASHUP SYSTEM

AUTOMASHUPPER: AN AUTOMATIC MULTI-SONG MASHUP SYSTEM AUTOMASHUPPER: AN AUTOMATIC MULTI-SONG MASHUP SYSTEM Matthew E. P. Davies, Philippe Hamel, Kazuyoshi Yoshii and Masataka Goto National Institute of Advanced Industrial Science and Technology (AIST), Japan

More information

Computational Modelling of Harmony

Computational Modelling of Harmony Computational Modelling of Harmony Simon Dixon Centre for Digital Music, Queen Mary University of London, Mile End Rd, London E1 4NS, UK simon.dixon@elec.qmul.ac.uk http://www.elec.qmul.ac.uk/people/simond

More information

Make Music Cards. Choose instruments, add sounds, and press keys to play music. scratch.mit.edu. Set of 9 cards

Make Music Cards. Choose instruments, add sounds, and press keys to play music. scratch.mit.edu. Set of 9 cards Make Music Cards Choose instruments, add sounds, and press keys to play music. Set of 9 cards Make Music Cards Try these cards in any order: Play a Drum Make a Rhythm Animate a Drum Make a Melody Play

More information

TOWARD AN INTELLIGENT EDITOR FOR JAZZ MUSIC

TOWARD AN INTELLIGENT EDITOR FOR JAZZ MUSIC TOWARD AN INTELLIGENT EDITOR FOR JAZZ MUSIC G.TZANETAKIS, N.HU, AND R.B. DANNENBERG Computer Science Department, Carnegie Mellon University 5000 Forbes Avenue, Pittsburgh, PA 15213, USA E-mail: gtzan@cs.cmu.edu

More information

MUSIC is a ubiquitous and vital part of the lives of billions

MUSIC is a ubiquitous and vital part of the lives of billions 1088 IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, VOL. 5, NO. 6, OCTOBER 2011 Signal Processing for Music Analysis Meinard Müller, Member, IEEE, Daniel P. W. Ellis, Senior Member, IEEE, Anssi

More information

DAY 1. Intelligent Audio Systems: A review of the foundations and applications of semantic audio analysis and music information retrieval

DAY 1. Intelligent Audio Systems: A review of the foundations and applications of semantic audio analysis and music information retrieval DAY 1 Intelligent Audio Systems: A review of the foundations and applications of semantic audio analysis and music information retrieval Jay LeBoeuf Imagine Research jay{at}imagine-research.com Rebecca

More information

Recognition and Summarization of Chord Progressions and Their Application to Music Information Retrieval

Recognition and Summarization of Chord Progressions and Their Application to Music Information Retrieval Recognition and Summarization of Chord Progressions and Their Application to Music Information Retrieval Yi Yu, Roger Zimmermann, Ye Wang School of Computing National University of Singapore Singapore

More information

Year 8 revision booklet 2017

Year 8 revision booklet 2017 Year 8 revision booklet 2017 Woodkirk Academy Music Department Name Form Dynamics How loud or quiet the music is Key Word Symbol Definition Pianissimo PP Very Quiet Piano P Quiet Forte F Loud Fortissimo

More information

http://www.xkcd.com/655/ Audio Retrieval David Kauchak cs160 Fall 2009 Thanks to Doug Turnbull for some of the slides Administrative CS Colloquium vs. Wed. before Thanksgiving producers consumers 8M artists

More information

Automatic Piano Music Transcription

Automatic Piano Music Transcription Automatic Piano Music Transcription Jianyu Fan Qiuhan Wang Xin Li Jianyu.Fan.Gr@dartmouth.edu Qiuhan.Wang.Gr@dartmouth.edu Xi.Li.Gr@dartmouth.edu 1. Introduction Writing down the score while listening

More information

WHAT MAKES FOR A HIT POP SONG? WHAT MAKES FOR A POP SONG?

WHAT MAKES FOR A HIT POP SONG? WHAT MAKES FOR A POP SONG? WHAT MAKES FOR A HIT POP SONG? WHAT MAKES FOR A POP SONG? NICHOLAS BORG AND GEORGE HOKKANEN Abstract. The possibility of a hit song prediction algorithm is both academically interesting and industry motivated.

More information

J536 Composition. Composing to a set brief Own choice composition

J536 Composition. Composing to a set brief Own choice composition J536 Composition Composing to a set brief Own choice composition Composition starting point 1 AABA melody writing (to a template) Use the seven note Creative Task note patterns as a starting point teaches

More information

PERFORMING ARTS. Head of Music: Cinzia Cursaro. Year 7 MUSIC Core Component 1 Term

PERFORMING ARTS. Head of Music: Cinzia Cursaro. Year 7 MUSIC Core Component 1 Term PERFORMING ARTS Head of Music: Cinzia Cursaro Year 7 MUSIC Core Component 1 Term At Year 7, Music is taught to all students for one term as part of their core program. The main objective of Music at this

More information

Assessment Schedule 2017 Music: Demonstrate aural understanding through written representation (91275)

Assessment Schedule 2017 Music: Demonstrate aural understanding through written representation (91275) NC Level 2 Music (91275) 2017 page 1 of 7 ssessment Schedule 2017 Music: emonstrate aural understanding through written representation (91275) ssessment Criteria with with emonstrating aural understanding

More information

Classification-based melody transcription

Classification-based melody transcription DOI 10.1007/s10994-006-8373-9 Classification-based melody transcription Daniel P.W. Ellis Graham E. Poliner Received: 24 September 2005 / Revised: 16 February 2006 / Accepted: 20 March 2006 / Published

More information

A DISCRETE MIXTURE MODEL FOR CHORD LABELLING

A DISCRETE MIXTURE MODEL FOR CHORD LABELLING A DISCRETE MIXTURE MODEL FOR CHORD LABELLING Matthias Mauch and Simon Dixon Queen Mary, University of London, Centre for Digital Music. matthias.mauch@elec.qmul.ac.uk ABSTRACT Chord labels for recorded

More information

Week 14 Music Understanding and Classification

Week 14 Music Understanding and Classification Week 14 Music Understanding and Classification Roger B. Dannenberg Professor of Computer Science, Music & Art Overview n Music Style Classification n What s a classifier? n Naïve Bayesian Classifiers n

More information

Outline. Why do we classify? Audio Classification

Outline. Why do we classify? Audio Classification Outline Introduction Music Information Retrieval Classification Process Steps Pitch Histograms Multiple Pitch Detection Algorithm Musical Genre Classification Implementation Future Work Why do we classify

More information

Music Similarity and Cover Song Identification: The Case of Jazz

Music Similarity and Cover Song Identification: The Case of Jazz Music Similarity and Cover Song Identification: The Case of Jazz Simon Dixon and Peter Foster s.e.dixon@qmul.ac.uk Centre for Digital Music School of Electronic Engineering and Computer Science Queen Mary

More information

Drum Sound Identification for Polyphonic Music Using Template Adaptation and Matching Methods

Drum Sound Identification for Polyphonic Music Using Template Adaptation and Matching Methods Drum Sound Identification for Polyphonic Music Using Template Adaptation and Matching Methods Kazuyoshi Yoshii, Masataka Goto and Hiroshi G. Okuno Department of Intelligence Science and Technology National

More information

Analysing Musical Pieces Using harmony-analyser.org Tools

Analysing Musical Pieces Using harmony-analyser.org Tools Analysing Musical Pieces Using harmony-analyser.org Tools Ladislav Maršík Dept. of Software Engineering, Faculty of Mathematics and Physics Charles University, Malostranské nám. 25, 118 00 Prague 1, Czech

More information

Large-Scale Pattern Discovery in Music. Thierry Bertin-Mahieux

Large-Scale Pattern Discovery in Music. Thierry Bertin-Mahieux Large-Scale Pattern Discovery in Music Thierry Bertin-Mahieux Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in the Graduate School of Arts and Sciences COLUMBIA

More information

Features for Audio and Music Classification

Features for Audio and Music Classification Features for Audio and Music Classification Martin F. McKinney and Jeroen Breebaart Auditory and Multisensory Perception, Digital Signal Processing Group Philips Research Laboratories Eindhoven, The Netherlands

More information

APPLICATIONS OF A SEMI-AUTOMATIC MELODY EXTRACTION INTERFACE FOR INDIAN MUSIC

APPLICATIONS OF A SEMI-AUTOMATIC MELODY EXTRACTION INTERFACE FOR INDIAN MUSIC APPLICATIONS OF A SEMI-AUTOMATIC MELODY EXTRACTION INTERFACE FOR INDIAN MUSIC Vishweshwara Rao, Sachin Pant, Madhumita Bhaskar and Preeti Rao Department of Electrical Engineering, IIT Bombay {vishu, sachinp,

More information

Elements of Music David Scoggin OLLI Understanding Jazz Fall 2016

Elements of Music David Scoggin OLLI Understanding Jazz Fall 2016 Elements of Music David Scoggin OLLI Understanding Jazz Fall 2016 The two most fundamental dimensions of music are rhythm (time) and pitch. In fact, every staff of written music is essentially an X-Y coordinate

More information

Book: Fundamentals of Music Processing. Audio Features. Book: Fundamentals of Music Processing. Book: Fundamentals of Music Processing

Book: Fundamentals of Music Processing. Audio Features. Book: Fundamentals of Music Processing. Book: Fundamentals of Music Processing Book: Fundamentals of Music Processing Lecture Music Processing Audio Features Meinard Müller International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de Meinard Müller Fundamentals

More information

Piano Transcription MUMT611 Presentation III 1 March, Hankinson, 1/15

Piano Transcription MUMT611 Presentation III 1 March, Hankinson, 1/15 Piano Transcription MUMT611 Presentation III 1 March, 2007 Hankinson, 1/15 Outline Introduction Techniques Comb Filtering & Autocorrelation HMMs Blackboard Systems & Fuzzy Logic Neural Networks Examples

More information

Courtney Pine: Back in the Day Lady Day and (John Coltrane), Inner State (of Mind) and Love and Affection (for component 3: Appraising)

Courtney Pine: Back in the Day Lady Day and (John Coltrane), Inner State (of Mind) and Love and Affection (for component 3: Appraising) Courtney Pine: Back in the Day Lady Day and (John Coltrane), Inner State (of Mind) and Love and Affection (for component 3: Appraising) Background information and performance circumstances Courtney Pine

More information

A Survey of Audio-Based Music Classification and Annotation

A Survey of Audio-Based Music Classification and Annotation A Survey of Audio-Based Music Classification and Annotation Zhouyu Fu, Guojun Lu, Kai Ming Ting, and Dengsheng Zhang IEEE Trans. on Multimedia, vol. 13, no. 2, April 2011 presenter: Yin-Tzu Lin ( 阿孜孜 ^.^)

More information

MUSIC PERFORMANCE: GROUP

MUSIC PERFORMANCE: GROUP Victorian Certificate of Education 2002 SUPERVISOR TO ATTACH PROCESSING LABEL HERE Figures Words STUDENT NUMBER Letter MUSIC PERFORMANCE: GROUP Aural and written examination Friday 22 November 2002 Reading

More information

Deep feature learning for cover song identification

Deep feature learning for cover song identification DOI 10.1007/s11042-016-4107-6 Deep feature learning for cover song identification Jiunn-Tsair Fang 1 & Chi-Ting Day 2 & Pao-Chi Chang 2 Received: 2 October 2015 / Revised: 27 October 2016 / Accepted: 31

More information

Computational Models of Music Similarity. Elias Pampalk National Institute for Advanced Industrial Science and Technology (AIST)

Computational Models of Music Similarity. Elias Pampalk National Institute for Advanced Industrial Science and Technology (AIST) Computational Models of Music Similarity 1 Elias Pampalk National Institute for Advanced Industrial Science and Technology (AIST) Abstract The perceived similarity of two pieces of music is multi-dimensional,

More information

Audio. Meinard Müller. Beethoven, Bach, and Billions of Bytes. International Audio Laboratories Erlangen. International Audio Laboratories Erlangen

Audio. Meinard Müller. Beethoven, Bach, and Billions of Bytes. International Audio Laboratories Erlangen. International Audio Laboratories Erlangen Meinard Müller Beethoven, Bach, and Billions of Bytes When Music meets Computer Science Meinard Müller International Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de School of Mathematics University

More information

Music Representations. Beethoven, Bach, and Billions of Bytes. Music. Research Goals. Piano Roll Representation. Player Piano (1900)

Music Representations. Beethoven, Bach, and Billions of Bytes. Music. Research Goals. Piano Roll Representation. Player Piano (1900) Music Representations Lecture Music Processing Sheet Music (Image) CD / MP3 (Audio) MusicXML (Text) Beethoven, Bach, and Billions of Bytes New Alliances between Music and Computer Science Dance / Motion

More information

Instrument Recognition in Polyphonic Mixtures Using Spectral Envelopes

Instrument Recognition in Polyphonic Mixtures Using Spectral Envelopes Instrument Recognition in Polyphonic Mixtures Using Spectral Envelopes hello Jay Biernat Third author University of Rochester University of Rochester Affiliation3 words jbiernat@ur.rochester.edu author3@ismir.edu

More information

Transcription of the Singing Melody in Polyphonic Music

Transcription of the Singing Melody in Polyphonic Music Transcription of the Singing Melody in Polyphonic Music Matti Ryynänen and Anssi Klapuri Institute of Signal Processing, Tampere University Of Technology P.O.Box 553, FI-33101 Tampere, Finland {matti.ryynanen,

More information

Beethoven, Bach, and Billions of Bytes

Beethoven, Bach, and Billions of Bytes Lecture Music Processing Beethoven, Bach, and Billions of Bytes New Alliances between Music and Computer Science Meinard Müller International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de

More information

Data-Driven Solo Voice Enhancement for Jazz Music Retrieval

Data-Driven Solo Voice Enhancement for Jazz Music Retrieval Data-Driven Solo Voice Enhancement for Jazz Music Retrieval Stefan Balke1, Christian Dittmar1, Jakob Abeßer2, Meinard Müller1 1International Audio Laboratories Erlangen 2Fraunhofer Institute for Digital

More information

Music Synchronization. Music Synchronization. Music Data. Music Data. General Goals. Music Information Retrieval (MIR)

Music Synchronization. Music Synchronization. Music Data. Music Data. General Goals. Music Information Retrieval (MIR) Advanced Course Computer Science Music Processing Summer Term 2010 Music ata Meinard Müller Saarland University and MPI Informatik meinard@mpi-inf.mpg.de Music Synchronization Music ata Various interpretations

More information

Music Information Retrieval

Music Information Retrieval Music Information Retrieval When Music Meets Computer Science Meinard Müller International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de Berlin MIR Meetup 20.03.2017 Meinard Müller

More information

MUSIC GROUP PERFORMANCE

MUSIC GROUP PERFORMANCE Victorian Certificate of Education 2010 SUPERVISOR TO ATTACH PROCESSING LABEL HERE STUDENT NUMBER Letter Figures Words MUSIC GROUP PERFORMANCE Aural and written examination Monday 1 November 2010 Reading

More information

Studying the effects of bass estimation for chord segmentation in pop-rock music

Studying the effects of bass estimation for chord segmentation in pop-rock music Studying the effects of bass estimation for chord segmentation in pop-rock music Urbez Capablo Riazuelo MASTER THESIS UPF / 2014 Master in Sound and Music Computing Master thesis supervisor: Dr. Perfecto

More information

MUSIC PERFORMANCE: GROUP

MUSIC PERFORMANCE: GROUP Victorian Certificate of Education 2003 SUPERVISOR TO ATTACH PROCESSING LABEL HERE STUDENT NUMBER Letter Figures Words MUSIC PERFORMANCE: GROUP Aural and written examination Friday 21 November 2003 Reading

More information

Further Topics in MIR

Further Topics in MIR Tutorial Automatisierte Methoden der Musikverarbeitung 47. Jahrestagung der Gesellschaft für Informatik Further Topics in MIR Meinard Müller, Christof Weiss, Stefan Balke International Audio Laboratories

More information

2014 Music Performance GA 3: Aural and written examination

2014 Music Performance GA 3: Aural and written examination 2014 Music Performance GA 3: Aural and written examination GENERAL COMMENTS The format of the 2014 Music Performance examination was consistent with examination specifications and sample material on the

More information

/$ IEEE

/$ IEEE 564 IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 18, NO. 3, MARCH 2010 Source/Filter Model for Unsupervised Main Melody Extraction From Polyphonic Audio Signals Jean-Louis Durrieu,

More information

Sample Entrance Test for CR (BA in Popular Music)

Sample Entrance Test for CR (BA in Popular Music) Sample Entrance Test for CR125-129 (BA in Popular Music) A very exciting future awaits everybody who is or will be part of the Cork School of Music BA in Popular Music CR125 CR126 CR127 CR128 CR129 Electric

More information

Melody Extraction from Generic Audio Clips Thaminda Edirisooriya, Hansohl Kim, Connie Zeng

Melody Extraction from Generic Audio Clips Thaminda Edirisooriya, Hansohl Kim, Connie Zeng Melody Extraction from Generic Audio Clips Thaminda Edirisooriya, Hansohl Kim, Connie Zeng Introduction In this project we were interested in extracting the melody from generic audio files. Due to the

More information

Music Study Guide. Moore Public Schools. Definitions of Musical Terms

Music Study Guide. Moore Public Schools. Definitions of Musical Terms Music Study Guide Moore Public Schools Definitions of Musical Terms 1. Elements of Music: the basic building blocks of music 2. Rhythm: comprised of the interplay of beat, duration, and tempo 3. Beat:

More information

FINE ARTS Institutional (ILO), Program (PLO), and Course (SLO) Alignment

FINE ARTS Institutional (ILO), Program (PLO), and Course (SLO) Alignment FINE ARTS Institutional (ILO), Program (PLO), and Course (SLO) Program: Music Number of Courses: 52 Date Updated: 11.19.2014 Submitted by: V. Palacios, ext. 3535 ILOs 1. Critical Thinking Students apply

More information

Popular Music Theory Syllabus Guide

Popular Music Theory Syllabus Guide Popular Music Theory Syllabus Guide 2015-2018 www.rockschool.co.uk v1.0 Table of Contents 3 Introduction 6 Debut 9 Grade 1 12 Grade 2 15 Grade 3 18 Grade 4 21 Grade 5 24 Grade 6 27 Grade 7 30 Grade 8 33

More information

2016 HSC Music 1 Aural Skills Marking Guidelines Written Examination

2016 HSC Music 1 Aural Skills Marking Guidelines Written Examination 2016 HSC Music 1 Aural Skills Marking Guidelines Written Examination Question 1 Describes the structure of the excerpt with reference to the use of sound sources 6 Demonstrates a developed aural understanding

More information

Content-based Music Structure Analysis with Applications to Music Semantics Understanding

Content-based Music Structure Analysis with Applications to Music Semantics Understanding Content-based Music Structure Analysis with Applications to Music Semantics Understanding Namunu C Maddage,, Changsheng Xu, Mohan S Kankanhalli, Xi Shao, Institute for Infocomm Research Heng Mui Keng Terrace

More information

HarmonyMixer: Mixing the Character of Chords among Polyphonic Audio

HarmonyMixer: Mixing the Character of Chords among Polyphonic Audio HarmonyMixer: Mixing the Character of Chords among Polyphonic Audio Satoru Fukayama Masataka Goto National Institute of Advanced Industrial Science and Technology (AIST), Japan {s.fukayama, m.goto} [at]

More information

Credo Theory of Music training programme GRADE 4 By S. J. Cloete

Credo Theory of Music training programme GRADE 4 By S. J. Cloete - 56 - Credo Theory of Music training programme GRADE 4 By S. J. Cloete Sc.4 INDEX PAGE 1. Key signatures in the alto clef... 57 2. Major scales... 60 3. Harmonic minor scales... 61 4. Melodic minor scales...

More information

GRADE 11 NOVEMBER 2015 MUSIC P2

GRADE 11 NOVEMBER 2015 MUSIC P2 NATIONAL SENIOR CERTIFICATE GRADE 11 NOVEMBER 2015 MUSIC P2 MARKS: 30 NAME: TIME: 1½ hours GRADE: *IMUSCE* This question paper consists of 12 pages. 2 MUSIC P2 (EC/NOVEMBER 2015) INSTRUCTIONS AND INFORMATION

More information

A Robust Mid-level Representation for Harmonic Content in Music Signals

A Robust Mid-level Representation for Harmonic Content in Music Signals Robust Mid-level Representation for Harmonic Content in Music Signals Juan P. Bello and Jeremy Pickens Centre for igital Music Queen Mary, University of London London E 4NS, UK juan.bello-correa@elec.qmul.ac.uk

More information