Music Synchronization. Music Synchronization. Music Data. Music Data. General Goals. Music Information Retrieval (MIR)
|
|
- Jemima Horn
- 5 years ago
- Views:
Transcription
1 Advanced Course Computer Science Music Processing Summer Term 2010 Music ata Meinard Müller Saarland University and MPI Informatik Music Synchronization Music ata Various interpretations Beethoven s Fifth Bernstein Karajan Scherbakov (piano) (piano) General Goals Automated organization of complex and inhomogeneous music collections Generation of annotations and cross-links Tools and methods for multimodal search, navigation and interaction Music Information Retrieval (MIR) Music Synchronization Schematic view of various synchronization tasks Music Synchronization ( Alignment) Turetsky/Ellis (ISMIR 2003) Soulez/Rodet/Schwarz (ISMIR 2003) Arifi/Clausen/Kurth/Müller (ISMIR 2003) Hu/annenberg/Tzanetakis (WASPAA 2003) Müller/Kurth/Röder (ISMIR 2004) Raphael (ISMIR 2004) ixon/widmer (ISMIR 2005) Müller/Mattes/Kurth (ISMIR 2006) annenberg /Raphael (Special Issue ACM 2006) Kurth/Müller/Fremerey/Chang/Clausen (ISMIR 2007) Fujihara/Goto (ICASSP 2008) Wang/Iskandar/New/Shenoy (IEEE-TASLP 2008) Ewert/Müller/Grosche (ICASSP 2009)
2 Music Synchronization: - Music Synchronization: - Beethoven s Fifth Given: Two different audio recordings of the same underlying piece of music. Karajan Goal: Find for each position in one audio recording the musically corresponding position in the other audio recording. Scherbakov Music Synchronization: - Beethoven s Fifth Music Synchronization: - Bach Toccata Karajan Koopman Scherbakov Ruebsam Synchronization: Karajan Scherbakov Music Synchronization: - Bach Toccata Koopman Music Synchronization: - Transformation of audio recordings into sequences of feature vectors Ruebsam Fix cost measure Compute on the feature space cost matrix Synchronization: Koopman Ruebsam Compute cost-minimizing warping path from
3 Chroma Features Chroma Features Example: Bach Toccata Example: Bach Toccata Koopman Ruebsam Koopman Ruebsam Feature resolution: 10 Hz Feature resolution: 1 Hz Music Synchronization: - Music Synchronization: - Koopman Ruebsam = 12-dimensional normalized chroma vectors Local cost measure cost matrix Music Synchronization: - Cost-minimizing warping path Cost-Minimizing Warping Path Computation via dynamic programming ynamic Time Warping (TW) Memory requirements and running time: O(NM) Problem: Infeasible for large N and M Example: Feature resolution 10 Hz, pieces 15 min N, M ~ 10,000 N M ~ 100,000,000
4 Strategy: Global Constraints Strategy: Global Constraints Sakoe-Chiba band Itakura parallelogram Sakoe-Chiba band Itakura parallelogram Problem: Optimal warping path not in constraint region Compute optimal warping path on coarse level Project on fine level Specify constraint region Compute constrained optimal warping path
5 Suitable features? Resolution 4 Hz Resolution 2 Hz Resolution 1 Hz Suitable resolution levels? Size of constraint regions? Good trade-off between efficiency and robustness? Improve robustness by enhancing cost matrix Resolution 4 Hz Resolution 2 Hz Resolution 1 Hz Resolution 4 Hz Resolution 2 Hz Resolution 1 Hz Original Problem: Cost matrix may degenerate useless warping path Enhanced Improve robustness by enhancing cost matrix Resolution 4 Hz Resolution 2 Hz Resolution 1 Hz Chroma features at three levels: 0.33 Hz / 1 Hz / 10 Hz Enhanced Original
6 Chroma features at three levels: 0.33 Hz / 1 Hz / 10 Hz Music Synchronization: - Conclusions Chroma features Number of matrix entries needed for TW and MsTW: suited for harmony-based music Relatively coarse but good global alignments Multiscale approach: simple, robust, fast Music Synchronization: - System: Match (ixon) Applications Efficient music browsing Blending from one interpretation to another one Mixing and morphing different interpretations Tempo studies System: SyncPlayer/Switcher Music Synchronization: - Time
7 Music Synchronization: - Music Synchronization: - = meta data Automated annotation recording = reference (score) Tempo information recording Sonification of annotations Performance Analysis: Tempo Curves Performance Analysis: Tempo Curves Schumann: Träumerei What can be done if no reference is available? Musical tempo (B BPM) BPM) Musical tempo (B Musical time (measures) Musical time (measures) Music Synchronization: - Music Synchronization: Scan- Applications Automated audio annotation Accurate audio access after -based retrieval Automated tracking of note parameters during audio playback Performance Analysis
8 Music Synchronization: Scan- Music Synchronization: Scan- Scanned Sheet Music Scanned Sheet Music Symbolic Note Events OMR Correspondence Correspondence Recording Recording Music Synchronization: Scan- Music Synchronization: Scan- Scanned Sheet Music Symbolic Note Events Scanned Sheet Music High Qualtity OMR Correspondence Correspondence Recording OMR Symbolic Note Events irty but hidden High Qualtity Recording Application: Score Viewer Music Synchronization: Lyrics- ifficult task! [ECL 08, ICMI 08]
9 Music Synchronization: Lyrics- System: SyncPlayer/LyricsSeeker Lyrics- Lyrics- + - Normalized chroma features robust to changes in instrumentation and dynamics robust synchronization of reasonable overall quality rawback: low temporal alignment accuracy Idea: Integration of note onset information Normalized chroma features robust to changes in instrumentation and dynamics robust synchronization of reasonable overall quality rawback: low temporal alignment accuracy Idea: Integration of note onset information Example: - synchronization Chroma-Chroma: Chroma-Chroma + onset information: Example: C C C C Example: C C C C C C C C Cost-minimizing warping path
10 Example: C C C C Musically correct warping path Example: C C C C Musically correct warping path C C Cost-minimizing warping path C C Cost-minimizing warping path Problem: note onsets are not captured in feature representation Example: Beethoven s Fifth Example: Beethoven s Fifth Chroma representations Problem: note onsets are not captured in feature representation Example: Beethoven s Fifth Example: Beethoven s Fifth Cost matrix Cost matrix Warping path of poor local quality
11 General goal: etection of onsets of musical notes Magnitude spectrogram X Typical signal properties at note onset positions: increase in energy change of pitch change of spectral content high frequency content Frequency Idea: locate note onset candidates by measuring changes in spectral content Time Compressed spectrogram Y Spectral difference 3. ifferentiation Frequency Y = log( 1+ C X ) Frequency human sensation energy increase to be captured Time enhances low intensity values high frequency content reduces influence of amplitude modulation Time only positive values considered Spectral difference Frequency 3. ifferentiation 4. Accumulation Novelty Curve 3. ifferentiation 4. Accumulation Novelty Curve t
12 3. ifferentiation 4. Accumulation 5. Normalization 3. ifferentiation 4. Accumulation 5. Normalization Novelty Curve Substraction of local average Normalized novelty curve Normalized novelty curve 3. ifferentiation 4. Accumulation 5. Normalization 6. Peak picking Impulses 3. ifferentiation 4. Accumulation 5. Normalization 6. Peak picking ecaying impulses 3. ifferentiation 4. Accumulation 5. Normalization 6. Peak picking 7. ecay Filter Cost matrix based on impulses Cost matrix
13 Cost matrix based on decaying impulses Cost matrix based on decaying impulses Cost matrix Cost matrix Warping path based on onset information Ideas: Build up cost matrix with corridors of low cost ecaying strategy enforce corridor structure Each corridor corresponds to -audio pair of note onset candidates Warping path tends to run through corridors of low cost Impulses zoom ecaying impulses zoom note onset positions are likely to be aligned Cost matrix for decaying impulses Cost matrix for decaying impulses Corridor of low cost
14 Combination of two different types of cost matrices: Chroma cost matrix Onset cost matrix Cost matrix obtained from chroma features controls the global course of warping path robust synchronization Addition Cost matrix obtained from onset information controls the local course of warping path accurate alignment Conclusions: Music Synchronization Chroma cost matrix Onset cost matrix Various requirements Efficiency Addition Robustness Accuracy Variablity of music Conclusions: Music Synchronization Conclusions: Music Synchronization Combination of various strategies Feature level Local cost measure level Global alignment level Evidence pooling using competing strategies Offline vs. Online Online version: ixon/widmer (ISMIR 2005) Hidden Markov Models: Raphael (ISMIR 2004) Score-following Automatic accompaniment
15 Conclusions: Music Synchronization Presence of variations Instrumentation Musical structure Polyphony Musical key
Music Information Retrieval (MIR)
Ringvorlesung Perspektiven der Informatik Wintersemester 2011/2012 Meinard Müller Universität des Saarlandes und MPI Informatik meinard@mpi-inf.mpg.de Priv.-Doz. Dr. Meinard Müller 2007 Habilitation, Bonn
More informationMusic Information Retrieval (MIR)
Ringvorlesung Perspektiven der Informatik Sommersemester 2010 Meinard Müller Universität des Saarlandes und MPI Informatik meinard@mpi-inf.mpg.de Priv.-Doz. Dr. Meinard Müller 2007 Habilitation, Bonn 2007
More informationMusic Representations. Beethoven, Bach, and Billions of Bytes. Music. Research Goals. Piano Roll Representation. Player Piano (1900)
Music Representations Lecture Music Processing Sheet Music (Image) CD / MP3 (Audio) MusicXML (Text) Beethoven, Bach, and Billions of Bytes New Alliances between Music and Computer Science Dance / Motion
More informationBeethoven, Bach, and Billions of Bytes
Lecture Music Processing Beethoven, Bach, and Billions of Bytes New Alliances between Music and Computer Science Meinard Müller International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de
More informationMusic Information Retrieval
Music Information Retrieval When Music Meets Computer Science Meinard Müller International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de Berlin MIR Meetup 20.03.2017 Meinard Müller
More informationTempo and Beat Analysis
Advanced Course Computer Science Music Processing Summer Term 2010 Meinard Müller, Peter Grosche Saarland University and MPI Informatik meinard@mpi-inf.mpg.de Tempo and Beat Analysis Musical Properties:
More informationAudio Structure Analysis
Advanced Course Computer Science Music Processing Summer Term 2009 Meinard Müller Saarland University and MPI Informatik meinard@mpi-inf.mpg.de Music Structure Analysis Music segmentation pitch content
More informationBook: Fundamentals of Music Processing. Audio Features. Book: Fundamentals of Music Processing. Book: Fundamentals of Music Processing
Book: Fundamentals of Music Processing Lecture Music Processing Audio Features Meinard Müller International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de Meinard Müller Fundamentals
More informationAudio. Meinard Müller. Beethoven, Bach, and Billions of Bytes. International Audio Laboratories Erlangen. International Audio Laboratories Erlangen
Meinard Müller Beethoven, Bach, and Billions of Bytes When Music meets Computer Science Meinard Müller International Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de School of Mathematics University
More informationTempo and Beat Tracking
Tutorial Automatisierte Methoden der Musikverarbeitung 47. Jahrestagung der Gesellschaft für Informatik Tempo and Beat Tracking Meinard Müller, Christof Weiss, Stefan Balke International Audio Laboratories
More informationMusic Representations
Advanced Course Computer Science Music Processing Summer Term 00 Music Representations Meinard Müller Saarland University and MPI Informatik meinard@mpi-inf.mpg.de Music Representations Music Representations
More informationAudio Structure Analysis
Lecture Music Processing Audio Structure Analysis Meinard Müller International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de Music Structure Analysis Music segmentation pitch content
More informationCS 591 S1 Computational Audio
4/29/7 CS 59 S Computational Audio Wayne Snyder Computer Science Department Boston University Today: Comparing Musical Signals: Cross- and Autocorrelations of Spectral Data for Structure Analysis Segmentation
More informationBeethoven, Bach und Billionen Bytes
Meinard Müller Beethoven, Bach und Billionen Bytes Automatisierte Analyse von Musik und Klängen Meinard Müller Lehrerfortbildung in Informatik Dagstuhl, Dezember 2014 2001 PhD, Bonn University 2002/2003
More informationMeinard Müller. Beethoven, Bach, und Billionen Bytes. International Audio Laboratories Erlangen. International Audio Laboratories Erlangen
Beethoven, Bach, und Billionen Bytes Musik trifft Informatik Meinard Müller Meinard Müller 2007 Habilitation, Bonn 2007 MPI Informatik, Saarbrücken Senior Researcher Music Processing & Motion Processing
More informationMusic Processing Audio Retrieval Meinard Müller
Lecture Music Processing Audio Retrieval Meinard Müller International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de Book: Fundamentals of Music Processing Meinard Müller Fundamentals
More informationSHEET MUSIC-AUDIO IDENTIFICATION
SHEET MUSIC-AUDIO IDENTIFICATION Christian Fremerey, Michael Clausen, Sebastian Ewert Bonn University, Computer Science III Bonn, Germany {fremerey,clausen,ewerts}@cs.uni-bonn.de Meinard Müller Saarland
More informationMusic Processing Introduction Meinard Müller
Lecture Music Processing Introduction Meinard Müller International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de Music Music Information Retrieval (MIR) Sheet Music (Image) CD / MP3
More informationTopic 11. Score-Informed Source Separation. (chroma slides adapted from Meinard Mueller)
Topic 11 Score-Informed Source Separation (chroma slides adapted from Meinard Mueller) Why Score-informed Source Separation? Audio source separation is useful Music transcription, remixing, search Non-satisfying
More informationNew Developments in Music Information Retrieval
New Developments in Music Information Retrieval Meinard Müller 1 1 Saarland University and MPI Informatik, Campus E1.4, 66123 Saarbrücken, Germany Correspondence should be addressed to Meinard Müller (meinard@mpi-inf.mpg.de)
More informationChord Recognition. Aspects of Music. Musical Chords. Harmony: The Basis of Music. Musical Chords. Musical Chords. Music Processing.
dvanced ourse omputer Science Music Processing Summer Term 2 Meinard Müller, Verena Konz Saarland University and MPI Informatik meinard@mpi-inf.mpg.de hord Recognition spects of Music Melody Piece of music
More informationInformed Feature Representations for Music and Motion
Meinard Müller Informed Feature Representations for Music and Motion Meinard Müller 27 Habilitation, Bonn 27 MPI Informatik, Saarbrücken Senior Researcher Music Processing & Motion Processing Lorentz Workshop
More informationFurther Topics in MIR
Tutorial Automatisierte Methoden der Musikverarbeitung 47. Jahrestagung der Gesellschaft für Informatik Further Topics in MIR Meinard Müller, Christof Weiss, Stefan Balke International Audio Laboratories
More informationMusic Representations
Lecture Music Processing Music Representations Meinard Müller International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de Book: Fundamentals of Music Processing Meinard Müller Fundamentals
More informationRefinement Strategies for Music Synchronization
Refinement Strategies for Music Synchronization Sebastian wert and Meinard Müller Universität onn, Institut für Informatik III Römerstr. 6, 57 onn, ermany ewerts@cs.uni-bonn.de Max-Planck-Institut für
More informationA Multimodal Way of Experiencing and Exploring Music
, 138 53 A Multimodal Way of Experiencing and Exploring Music Meinard Müller and Verena Konz Saarland University and MPI Informatik, Saarbrücken, Germany Michael Clausen, Sebastian Ewert and Christian
More informationA MID-LEVEL REPRESENTATION FOR CAPTURING DOMINANT TEMPO AND PULSE INFORMATION IN MUSIC RECORDINGS
th International Society for Music Information Retrieval Conference (ISMIR 9) A MID-LEVEL REPRESENTATION FOR CAPTURING DOMINANT TEMPO AND PULSE INFORMATION IN MUSIC RECORDINGS Peter Grosche and Meinard
More informationTOWARDS AUTOMATED EXTRACTION OF TEMPO PARAMETERS FROM EXPRESSIVE MUSIC RECORDINGS
th International Society for Music Information Retrieval Conference (ISMIR 9) TOWARDS AUTOMATED EXTRACTION OF TEMPO PARAMETERS FROM EXPRESSIVE MUSIC RECORDINGS Meinard Müller, Verena Konz, Andi Scharfstein
More informationAUTOMATIC MAPPING OF SCANNED SHEET MUSIC TO AUDIO RECORDINGS
AUTOMATIC MAPPING OF SCANNED SHEET MUSIC TO AUDIO RECORDINGS Christian Fremerey, Meinard Müller,Frank Kurth, Michael Clausen Computer Science III University of Bonn Bonn, Germany Max-Planck-Institut (MPI)
More informationMusic Similarity and Cover Song Identification: The Case of Jazz
Music Similarity and Cover Song Identification: The Case of Jazz Simon Dixon and Peter Foster s.e.dixon@qmul.ac.uk Centre for Digital Music School of Electronic Engineering and Computer Science Queen Mary
More informationRobert Alexandru Dobre, Cristian Negrescu
ECAI 2016 - International Conference 8th Edition Electronics, Computers and Artificial Intelligence 30 June -02 July, 2016, Ploiesti, ROMÂNIA Automatic Music Transcription Software Based on Constant Q
More informationMUSI-6201 Computational Music Analysis
MUSI-6201 Computational Music Analysis Part 9.1: Genre Classification alexander lerch November 4, 2015 temporal analysis overview text book Chapter 8: Musical Genre, Similarity, and Mood (pp. 151 155)
More informationA SCORE-INFORMED PIANO TUTORING SYSTEM WITH MISTAKE DETECTION AND SCORE SIMPLIFICATION
A SCORE-INFORMED PIANO TUTORING SYSTEM WITH MISTAKE DETECTION AND SCORE SIMPLIFICATION Tsubasa Fukuda Yukara Ikemiya Katsutoshi Itoyama Kazuyoshi Yoshii Graduate School of Informatics, Kyoto University
More informationChroma Binary Similarity and Local Alignment Applied to Cover Song Identification
1138 IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 16, NO. 6, AUGUST 2008 Chroma Binary Similarity and Local Alignment Applied to Cover Song Identification Joan Serrà, Emilia Gómez,
More informationLecture 9 Source Separation
10420CS 573100 音樂資訊檢索 Music Information Retrieval Lecture 9 Source Separation Yi-Hsuan Yang Ph.D. http://www.citi.sinica.edu.tw/pages/yang/ yang@citi.sinica.edu.tw Music & Audio Computing Lab, Research
More informationMUSIC is a ubiquitous and vital part of the lives of billions
1088 IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, VOL. 5, NO. 6, OCTOBER 2011 Signal Processing for Music Analysis Meinard Müller, Member, IEEE, Daniel P. W. Ellis, Senior Member, IEEE, Anssi
More informationONE main goal of content-based music analysis and retrieval
IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL.??, NO.?, MONTH???? Towards Timbre-Invariant Audio eatures for Harmony-Based Music Meinard Müller, Member, IEEE, and Sebastian Ewert, Student
More informationScore-Informed Source Separation for Musical Audio Recordings: An Overview
Score-Informed Source Separation for Musical Audio Recordings: An Overview Sebastian Ewert Bryan Pardo Meinard Müller Mark D. Plumbley Queen Mary University of London, London, United Kingdom Northwestern
More informationAutomatic music transcription
Music transcription 1 Music transcription 2 Automatic music transcription Sources: * Klapuri, Introduction to music transcription, 2006. www.cs.tut.fi/sgn/arg/klap/amt-intro.pdf * Klapuri, Eronen, Astola:
More informationMAKE YOUR OWN ACCOMPANIMENT: ADAPTING FULL-MIX RECORDINGS TO MATCH SOLO-ONLY USER RECORDINGS
MAKE YOUR OWN ACCOMPANIMENT: ADAPTING FULL-MIX RECORDINGS TO MATCH SOLO-ONLY USER RECORDINGS TJ Tsai Harvey Mudd College Steve Tjoa Violin.io Meinard Müller International Audio Laboratories Erlangen ABSTRACT
More informationLEARNING AUDIO SHEET MUSIC CORRESPONDENCES. Matthias Dorfer Department of Computational Perception
LEARNING AUDIO SHEET MUSIC CORRESPONDENCES Matthias Dorfer Department of Computational Perception Short Introduction... I am a PhD Candidate in the Department of Computational Perception at Johannes Kepler
More informationAPPLICATIONS OF A SEMI-AUTOMATIC MELODY EXTRACTION INTERFACE FOR INDIAN MUSIC
APPLICATIONS OF A SEMI-AUTOMATIC MELODY EXTRACTION INTERFACE FOR INDIAN MUSIC Vishweshwara Rao, Sachin Pant, Madhumita Bhaskar and Preeti Rao Department of Electrical Engineering, IIT Bombay {vishu, sachinp,
More informationJOINT STRUCTURE ANALYSIS WITH APPLICATIONS TO MUSIC ANNOTATION AND SYNCHRONIZATION
ISMIR 8 Session 3c OMR, lignment and nnotation JOINT STRUTURE NLYSIS WITH PPLITIONS TO MUSI NNOTTION N SYNHRONIZTION Meinard Müller Saarland University and MPI Informatik ampus E 4, 663 Saarbrücken, Germany
More informationMusic Structure Analysis
Lecture Music Processing Music Structure Analysis Meinard Müller International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de Book: Fundamentals of Music Processing Meinard Müller Fundamentals
More informationAudio Content-Based Music Retrieval
Audio Content-Based Music Retrieval Peter Grosche 1, Meinard Müller *1, and Joan Serrà 2 1 Saarland University and MPI Informatik Campus E1-4, 66123 Saarbrücken, Germany pgrosche@mpi-inf.mpg.de, meinard@mpi-inf.mpg.de
More informationSearching for Similar Phrases in Music Audio
Searching for Similar Phrases in Music udio an Ellis Laboratory for Recognition and Organization of Speech and udio ept. Electrical Engineering, olumbia University, NY US http://labrosa.ee.columbia.edu/
More informationgresearch Focus Cognitive Sciences
Learning about Music Cognition by Asking MIR Questions Sebastian Stober August 12, 2016 CogMIR, New York City sstober@uni-potsdam.de http://www.uni-potsdam.de/mlcog/ MLC g Machine Learning in Cognitive
More informationTowards Automated Processing of Folk Song Recordings
Towards Automated Processing of Folk Song Recordings Meinard Müller, Peter Grosche, Frans Wiering 2 Saarland University and MPI Informatik Campus E-4, 6623 Saarbrücken, Germany meinard@mpi-inf.mpg.de,
More informationIntroductions to Music Information Retrieval
Introductions to Music Information Retrieval ECE 272/472 Audio Signal Processing Bochen Li University of Rochester Wish List For music learners/performers While I play the piano, turn the page for me Tell
More informationWeek 14 Query-by-Humming and Music Fingerprinting. Roger B. Dannenberg Professor of Computer Science, Art and Music Carnegie Mellon University
Week 14 Query-by-Humming and Music Fingerprinting Roger B. Dannenberg Professor of Computer Science, Art and Music Overview n Melody-Based Retrieval n Audio-Score Alignment n Music Fingerprinting 2 Metadata-based
More informationMAKE YOUR OWN ACCOMPANIMENT: ADAPTING FULL-MIX RECORDINGS TO MATCH SOLO-ONLY USER RECORDINGS
MAKE YOUR OWN ACCOMPANIMENT: ADAPTING FULL-MIX RECORDINGS TO MATCH SOLO-ONLY USER RECORDINGS TJ Tsai 1 Steven K. Tjoa 2 Meinard Müller 3 1 Harvey Mudd College, Claremont, CA 2 Galvanize, Inc., San Francisco,
More informationAUDIO MATCHING VIA CHROMA-BASED STATISTICAL FEATURES
AUDIO MATCHING VIA CHROMA-BASED STATISTICAL FEATURES Meinard Müller Frank Kurth Michael Clausen Universität Bonn, Institut für Informatik III Römerstr. 64, D-537 Bonn, Germany {meinard, frank, clausen}@cs.uni-bonn.de
More informationAUTOREGRESSIVE MFCC MODELS FOR GENRE CLASSIFICATION IMPROVED BY HARMONIC-PERCUSSION SEPARATION
AUTOREGRESSIVE MFCC MODELS FOR GENRE CLASSIFICATION IMPROVED BY HARMONIC-PERCUSSION SEPARATION Halfdan Rump, Shigeki Miyabe, Emiru Tsunoo, Nobukata Ono, Shigeki Sagama The University of Tokyo, Graduate
More informationVideo-based Vibrato Detection and Analysis for Polyphonic String Music
Video-based Vibrato Detection and Analysis for Polyphonic String Music Bochen Li, Karthik Dinesh, Gaurav Sharma, Zhiyao Duan Audio Information Research Lab University of Rochester The 18 th International
More informationFREISCHÜTZ DIGITAL: A CASE STUDY FOR REFERENCE-BASED AUDIO SEGMENTATION OF OPERAS
FREISCHÜTZ DIGITAL: A CASE STUDY FOR REFERENCE-BASED AUDIO SEGMENTATION OF OPERAS Thomas Prätzlich International Audio Laboratories Erlangen thomas.praetzlich@audiolabs-erlangen.de Meinard Müller International
More informationA Study of Synchronization of Audio Data with Symbolic Data. Music254 Project Report Spring 2007 SongHui Chon
A Study of Synchronization of Audio Data with Symbolic Data Music254 Project Report Spring 2007 SongHui Chon Abstract This paper provides an overview of the problem of audio and symbolic synchronization.
More informationNI GSM/EDGE Toolkit Specifications
NI GSM/EDGE Toolkit Specifications Version 1.0 Generation This document lists specifications for the NI GSM/EDGE Toolkit. These specifications are representative and cannot be guaranteed for different
More informationPolyphonic Audio Matching for Score Following and Intelligent Audio Editors
Polyphonic Audio Matching for Score Following and Intelligent Audio Editors Roger B. Dannenberg and Ning Hu School of Computer Science, Carnegie Mellon University email: dannenberg@cs.cmu.edu, ninghu@cs.cmu.edu,
More informationData Driven Music Understanding
Data Driven Music Understanding Dan Ellis Laboratory for Recognition and Organization of Speech and Audio Dept. Electrical Engineering, Columbia University, NY USA http://labrosa.ee.columbia.edu/ 1. Motivation:
More informationSoundprism: An Online System for Score-Informed Source Separation of Music Audio Zhiyao Duan, Student Member, IEEE, and Bryan Pardo, Member, IEEE
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, VOL. 5, NO. 6, OCTOBER 2011 1205 Soundprism: An Online System for Score-Informed Source Separation of Music Audio Zhiyao Duan, Student Member, IEEE,
More informationAUTOMASHUPPER: AN AUTOMATIC MULTI-SONG MASHUP SYSTEM
AUTOMASHUPPER: AN AUTOMATIC MULTI-SONG MASHUP SYSTEM Matthew E. P. Davies, Philippe Hamel, Kazuyoshi Yoshii and Masataka Goto National Institute of Advanced Industrial Science and Technology (AIST), Japan
More informationEffects of acoustic degradations on cover song recognition
Signal Processing in Acoustics: Paper 68 Effects of acoustic degradations on cover song recognition Julien Osmalskyj (a), Jean-Jacques Embrechts (b) (a) University of Liège, Belgium, josmalsky@ulg.ac.be
More informationMethods for the automatic structural analysis of music. Jordan B. L. Smith CIRMMT Workshop on Structural Analysis of Music 26 March 2010
1 Methods for the automatic structural analysis of music Jordan B. L. Smith CIRMMT Workshop on Structural Analysis of Music 26 March 2010 2 The problem Going from sound to structure 2 The problem Going
More informationA PERPLEXITY BASED COVER SONG MATCHING SYSTEM FOR SHORT LENGTH QUERIES
12th International Society for Music Information Retrieval Conference (ISMIR 2011) A PERPLEXITY BASED COVER SONG MATCHING SYSTEM FOR SHORT LENGTH QUERIES Erdem Unal 1 Elaine Chew 2 Panayiotis Georgiou
More informationAutomatic Extraction of Popular Music Ringtones Based on Music Structure Analysis
Automatic Extraction of Popular Music Ringtones Based on Music Structure Analysis Fengyan Wu fengyanyy@163.com Shutao Sun stsun@cuc.edu.cn Weiyao Xue Wyxue_std@163.com Abstract Automatic extraction of
More informationOBJECTIVE EVALUATION OF A MELODY EXTRACTOR FOR NORTH INDIAN CLASSICAL VOCAL PERFORMANCES
OBJECTIVE EVALUATION OF A MELODY EXTRACTOR FOR NORTH INDIAN CLASSICAL VOCAL PERFORMANCES Vishweshwara Rao and Preeti Rao Digital Audio Processing Lab, Electrical Engineering Department, IIT-Bombay, Powai,
More informationComputational Models of Music Similarity. Elias Pampalk National Institute for Advanced Industrial Science and Technology (AIST)
Computational Models of Music Similarity 1 Elias Pampalk National Institute for Advanced Industrial Science and Technology (AIST) Abstract The perceived similarity of two pieces of music is multi-dimensional,
More informationQuery By Humming: Finding Songs in a Polyphonic Database
Query By Humming: Finding Songs in a Polyphonic Database John Duchi Computer Science Department Stanford University jduchi@stanford.edu Benjamin Phipps Computer Science Department Stanford University bphipps@stanford.edu
More informationANALYZING MEASURE ANNOTATIONS FOR WESTERN CLASSICAL MUSIC RECORDINGS
ANALYZING MEASURE ANNOTATIONS FOR WESTERN CLASSICAL MUSIC RECORDINGS Christof Weiß 1 Vlora Arifi-Müller 1 Thomas Prätzlich 1 Rainer Kleinertz 2 Meinard Müller 1 1 International Audio Laboratories Erlangen,
More informationCase Study Beatles Songs What can be Learned from Unreliable Music Alignments?
Case Study Beatles Songs What can be Learned from Unreliable Music Alignments? Sebastian Ewert 1, Meinard Müller 2, Daniel Müllensiefen 3, Michael Clausen 1, Geraint Wiggins 3 1 Universität Bonn, Institut
More informationMATCH: A MUSIC ALIGNMENT TOOL CHEST
6th International Conference on Music Information Retrieval (ISMIR 2005) 1 MATCH: A MUSIC ALIGNMENT TOOL CHEST Simon Dixon Austrian Research Institute for Artificial Intelligence Freyung 6/6 Vienna 1010,
More informationSCORE-INFORMED VOICE SEPARATION FOR PIANO RECORDINGS
th International Society for Music Information Retrieval Conference (ISMIR ) SCORE-INFORMED VOICE SEPARATION FOR PIANO RECORDINGS Sebastian Ewert Computer Science III, University of Bonn ewerts@iai.uni-bonn.de
More informationSINGING PITCH EXTRACTION BY VOICE VIBRATO/TREMOLO ESTIMATION AND INSTRUMENT PARTIAL DELETION
th International Society for Music Information Retrieval Conference (ISMIR ) SINGING PITCH EXTRACTION BY VOICE VIBRATO/TREMOLO ESTIMATION AND INSTRUMENT PARTIAL DELETION Chao-Ling Hsu Jyh-Shing Roger Jang
More informationInstrument Recognition in Polyphonic Mixtures Using Spectral Envelopes
Instrument Recognition in Polyphonic Mixtures Using Spectral Envelopes hello Jay Biernat Third author University of Rochester University of Rochester Affiliation3 words jbiernat@ur.rochester.edu author3@ismir.edu
More informationMusic Structure Analysis
Overview Tutorial Music Structure Analysis Part I: Principles & Techniques (Meinard Müller) Coffee Break Meinard Müller International Audio Laboratories Erlangen Universität Erlangen-Nürnberg meinard.mueller@audiolabs-erlangen.de
More informationMUSICAL INSTRUMENT IDENTIFICATION BASED ON HARMONIC TEMPORAL TIMBRE FEATURES
MUSICAL INSTRUMENT IDENTIFICATION BASED ON HARMONIC TEMPORAL TIMBRE FEATURES Jun Wu, Yu Kitano, Stanislaw Andrzej Raczynski, Shigeki Miyabe, Takuya Nishimoto, Nobutaka Ono and Shigeki Sagayama The Graduate
More informationTOWARDS AN EFFICIENT ALGORITHM FOR AUTOMATIC SCORE-TO-AUDIO SYNCHRONIZATION
TOWARDS AN EFFICIENT ALGORITHM FOR AUTOMATIC SCORE-TO-AUDIO SYNCHRONIZATION Meinard Müller, Frank Kurth, Tido Röder Universität Bonn, Institut für Informatik III Römerstr. 164, D-53117 Bonn, Germany {meinard,
More informationFULL-AUTOMATIC DJ MIXING SYSTEM WITH OPTIMAL TEMPO ADJUSTMENT BASED ON MEASUREMENT FUNCTION OF USER DISCOMFORT
10th International Society for Music Information Retrieval Conference (ISMIR 2009) FULL-AUTOMATIC DJ MIXING SYSTEM WITH OPTIMAL TEMPO ADJUSTMENT BASED ON MEASUREMENT FUNCTION OF USER DISCOMFORT Hiromi
More informationAutomatic Piano Music Transcription
Automatic Piano Music Transcription Jianyu Fan Qiuhan Wang Xin Li Jianyu.Fan.Gr@dartmouth.edu Qiuhan.Wang.Gr@dartmouth.edu Xi.Li.Gr@dartmouth.edu 1. Introduction Writing down the score while listening
More informationOBSERVED DIFFERENCES IN RHYTHM BETWEEN PERFORMANCES OF CLASSICAL AND JAZZ VIOLIN STUDENTS
OBSERVED DIFFERENCES IN RHYTHM BETWEEN PERFORMANCES OF CLASSICAL AND JAZZ VIOLIN STUDENTS Enric Guaus, Oriol Saña Escola Superior de Música de Catalunya {enric.guaus,oriol.sana}@esmuc.cat Quim Llimona
More informationMusic Radar: A Web-based Query by Humming System
Music Radar: A Web-based Query by Humming System Lianjie Cao, Peng Hao, Chunmeng Zhou Computer Science Department, Purdue University, 305 N. University Street West Lafayette, IN 47907-2107 {cao62, pengh,
More informationDAY 1. Intelligent Audio Systems: A review of the foundations and applications of semantic audio analysis and music information retrieval
DAY 1 Intelligent Audio Systems: A review of the foundations and applications of semantic audio analysis and music information retrieval Jay LeBoeuf Imagine Research jay{at}imagine-research.com Rebecca
More informationStatistical Modeling and Retrieval of Polyphonic Music
Statistical Modeling and Retrieval of Polyphonic Music Erdem Unal Panayiotis G. Georgiou and Shrikanth S. Narayanan Speech Analysis and Interpretation Laboratory University of Southern California Los Angeles,
More informationAutomatic Music Clustering using Audio Attributes
Automatic Music Clustering using Audio Attributes Abhishek Sen BTech (Electronics) Veermata Jijabai Technological Institute (VJTI), Mumbai, India abhishekpsen@gmail.com Abstract Music brings people together,
More informationRefined Spectral Template Models for Score Following
Refined Spectral Template Models for Score Following Filip Korzeniowski, Gerhard Widmer Department of Computational Perception, Johannes Kepler University Linz {filip.korzeniowski, gerhard.widmer}@jku.at
More informationAudio Structure Analysis
Tutorial T3 A Basic Introduction to Audio-Related Music Information Retrieval Audio Structure Analysis Meinard Müller, Christof Weiß International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de,
More informationMusic Segmentation Using Markov Chain Methods
Music Segmentation Using Markov Chain Methods Paul Finkelstein March 8, 2011 Abstract This paper will present just how far the use of Markov Chains has spread in the 21 st century. We will explain some
More informationSCORE-INFORMED IDENTIFICATION OF MISSING AND EXTRA NOTES IN PIANO RECORDINGS
SCORE-INFORMED IDENTIFICATION OF MISSING AND EXTRA NOTES IN PIANO RECORDINGS Sebastian Ewert 1 Siying Wang 1 Meinard Müller 2 Mark Sandler 1 1 Centre for Digital Music (C4DM), Queen Mary University of
More informationTOWARD AN INTELLIGENT EDITOR FOR JAZZ MUSIC
TOWARD AN INTELLIGENT EDITOR FOR JAZZ MUSIC G.TZANETAKIS, N.HU, AND R.B. DANNENBERG Computer Science Department, Carnegie Mellon University 5000 Forbes Avenue, Pittsburgh, PA 15213, USA E-mail: gtzan@cs.cmu.edu
More informationMusic Alignment and Applications. Introduction
Music Alignment and Applications Roger B. Dannenberg Schools of Computer Science, Art, and Music Introduction Music information comes in many forms Digital Audio Multi-track Audio Music Notation MIDI Structured
More informationImproving Polyphonic and Poly-Instrumental Music to Score Alignment
Improving Polyphonic and Poly-Instrumental Music to Score Alignment Ferréol Soulez IRCAM Centre Pompidou 1, place Igor Stravinsky, 7500 Paris, France soulez@ircamfr Xavier Rodet IRCAM Centre Pompidou 1,
More informationSINGING EXPRESSION TRANSFER FROM ONE VOICE TO ANOTHER FOR A GIVEN SONG. Sangeon Yong, Juhan Nam
SINGING EXPRESSION TRANSFER FROM ONE VOICE TO ANOTHER FOR A GIVEN SONG Sangeon Yong, Juhan Nam Graduate School of Culture Technology, KAIST {koragon2, juhannam}@kaist.ac.kr ABSTRACT We present a vocal
More informationThe Effect of DJs Social Network on Music Popularity
The Effect of DJs Social Network on Music Popularity Hyeongseok Wi Kyung hoon Hyun Jongpil Lee Wonjae Lee Korea Advanced Institute Korea Advanced Institute Korea Advanced Institute Korea Advanced Institute
More informationAN ADAPTIVE KARAOKE SYSTEM THAT PLAYS ACCOMPANIMENT PARTS OF MUSIC AUDIO SIGNALS SYNCHRONOUSLY WITH USERS SINGING VOICES
AN ADAPTIVE KARAOKE SYSTEM THAT PLAYS ACCOMPANIMENT PARTS OF MUSIC AUDIO SIGNALS SYNCHRONOUSLY WITH USERS SINGING VOICES Yusuke Wada Yoshiaki Bando Eita Nakamura Katsutoshi Itoyama Kazuyoshi Yoshii Department
More informationThe H.26L Video Coding Project
The H.26L Video Coding Project New ITU-T Q.6/SG16 (VCEG - Video Coding Experts Group) standardization activity for video compression August 1999: 1 st test model (TML-1) December 2001: 10 th test model
More informationHUMMING METHOD FOR CONTENT-BASED MUSIC INFORMATION RETRIEVAL
12th International Society for Music Information Retrieval Conference (ISMIR 211) HUMMING METHOD FOR CONTENT-BASED MUSIC INFORMATION RETRIEVAL Cristina de la Bandera, Ana M. Barbancho, Lorenzo J. Tardón,
More informationSupervised Musical Source Separation from Mono and Stereo Mixtures based on Sinusoidal Modeling
Supervised Musical Source Separation from Mono and Stereo Mixtures based on Sinusoidal Modeling Juan José Burred Équipe Analyse/Synthèse, IRCAM burred@ircam.fr Communication Systems Group Technische Universität
More informationLecture 12: Alignment and Matching
ELEN E4896 MUSIC SIGNAL PROCESSING Lecture 12: Alignment and Matching 1. Music Alignment 2. Cover Song Detection 3. Echo Nest Analyze Dan Ellis Dept. Electrical Engineering, Columbia University dpwe@ee.columbia.edu
More informationTopic 10. Multi-pitch Analysis
Topic 10 Multi-pitch Analysis What is pitch? Common elements of music are pitch, rhythm, dynamics, and the sonic qualities of timbre and texture. An auditory perceptual attribute in terms of which sounds
More informationAUDIO-BASED MUSIC STRUCTURE ANALYSIS
11th International Society for Music Information Retrieval Conference (ISMIR 21) AUDIO-ASED MUSIC STRUCTURE ANALYSIS Jouni Paulus Fraunhofer Institute for Integrated Circuits IIS Erlangen, Germany jouni.paulus@iis.fraunhofer.de
More information