Audio Structure Analysis
|
|
- Pierce O’Brien’
- 5 years ago
- Views:
Transcription
1 Tutorial T3 A Basic Introduction to Audio-Related Music Information Retrieval Audio Structure Analysis Meinard Müller, Christof Weiß International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de, christof.weiss@audiolabs-erlangen.de
2 Book: Fundamentals of Music Processing Meinard Müller Fundamentals of Music Processing Audio, Analysis, Algorithms, Applications 483 p., 249 illus., hardcover ISBN: Springer, 2015 Accompanying website:
3 Book: Fundamentals of Music Processing Meinard Müller Fundamentals of Music Processing Audio, Analysis, Algorithms, Applications 483 p., 249 illus., hardcover ISBN: Springer, 2015 Accompanying website:
4 Book: Fundamentals of Music Processing Meinard Müller Fundamentals of Music Processing Audio, Analysis, Algorithms, Applications 483 p., 249 illus., hardcover ISBN: Springer, 2015 Accompanying website:
5 Chapter 4: Music Structure Analysis 4.1 General Principles 4.2 Self-Similarity Matrices 4.3 Audio Thumbnailing 4.4 Novelty-Based Segmentation 4.5 Evaluation 4.6 Further Notes In Chapter 4, we address a central and well-researched area within MIR known as music structure analysis. Given a music recording, the objective is to identify important structural elements and to temporally segment the recording according to these elements. Within this scenario, we discuss fundamental segmentation principles based on repetitions, homogeneity, and novelty principles that also apply to other types of multimedia beyond music. As an important technical tool, we study in detail the concept of self-similarity matrices and discuss their structural properties. Finally, we briefly touch the topic of evaluation, introducing the notions of precision, recall, and F-measure.
6 Music Structure Analysis Example: Zager & Evans In The Year 2525 Time (seconds)
7 Music Structure Analysis Example: Zager & Evans In The Year 2525 Time (seconds)
8 Music Structure Analysis Example: Zager & Evans In The Year 2525 I V1 V2 V3 V4 V5 V6 V7 B V8 O
9 Music Structure Analysis Example: Brahms Hungarian Dance No. 5 (Ormandy) A1 A2 B1 B2 C A3 B3 B4 Time (seconds)
10 Music Structure Analysis Example: Folk Song Field Recording (Nederlandse Liederenbank) Time (seconds)
11 Music Structure Analysis Example: Weber, Song (No. 4) from Der Freischütz Introduction Stanzas Dialogues Kleiber Time (seconds) Ackermann Time (seconds)
12 Music Structure Analysis General goal: Divide an audio recording into temporal segments corresponding to musical parts and group these segments into musically meaningful categories. Examples: Stanzas of a folk song Intro, verse, chorus, bridge, outro sections of a pop song Exposition, development, recapitulation, coda of a sonata Musical form ABACADA of a rondo
13 Music Structure Analysis General goal: Divide an audio recording into temporal segments corresponding to musical parts and group these segments into musically meaningful categories. Challenge: There are many different principles for creating relationships that form the basis for the musical structure. Homogeneity: Novelty: Repetition: Consistency in tempo, instrumentation, key, Sudden changes, surprising elements Repeating themes, motives, rhythmic patterns,
14 Music Structure Analysis Novelty Homogeneity Repetition
15 Overview Introduction Feature Representations Self-Similarity Matrices Novelty-Based Segmentation Thanks: Clausen, Ewert, Kurth, Grohganz, Dannenberg, Goto Grosche, Jiang Paulus, Klapuri Peeters, Kaiser, Serra, Gómez, Smith, Fujinaga, Wiering, Wand, Sunkel, Jansen
16 Overview Introduction Feature Representations Self-Similarity Matrices Novelty-Based Segmentation Thanks: Clausen, Ewert, Kurth, Grohganz, Dannenberg, Goto Grosche, Jiang Paulus, Klapuri Peeters, Kaiser, Serra, Gómez, Smith, Fujinaga, Wiering, Wand, Sunkel, Jansen
17 Feature Representation General goal: Convert an audio recording into a mid-level representation that captures certain musical properties while supressing other properties. Timbre / Instrumentation Tempo / Rhythm Pitch / Harmony
18 Feature Representation General goal: Convert an audio recording into a mid-level representation that captures certain musical properties while supressing other properties. Timbre / Instrumentation Tempo / Rhythm Pitch / Harmony
19 Feature Representation Example: Brahms Hungarian Dance No. 5 (Ormandy) A1 A2 B1 B2 C A3 B3 B4 Time (seconds)
20 Feature Representation Example: Brahms Hungarian Dance No. 5 (Ormandy) Chroma (Harmony) Feature extraction A1 A2 B1 B2 C A3 B3 B4 Time (seconds)
21 Feature Representation Example: Brahms Hungarian Dance No. 5 (Ormandy) B b G D Chroma (Harmony) G minor Feature extraction G minor A1 A2 B1 B2 C A3 B3 B4 Time (seconds)
22 Feature Representation Example: Brahms Hungarian Dance No. 5 (Ormandy) B G B b G Chroma (Harmony) Feature extraction D D G minor G major G minor A1 A2 B1 B2 C A3 B3 B4 Time (seconds)
23 Overview Introduction Feature Representations Self-Similarity Matrices Novelty-Based Segmentation
24 Self-Similarity Matrix (SSM) General idea: Compare each element of the feature sequence with each other element of the feature sequence based on a suitable similarity measure. Quadratic self-similarity matrix
25 Self-Similarity Matrix (SSM) Example: Brahms Hungarian Dance No. 5 (Ormandy)
26 Self-Similarity Matrix (SSM) Example: Brahms Hungarian Dance No. 5 (Ormandy)
27 Self-Similarity Matrix (SSM) Example: Brahms Hungarian Dance No. 5 (Ormandy)
28 Self-Similarity Matrix (SSM) Example: Brahms Hungarian Dance No. 5 (Ormandy)
29 Self-Similarity Matrix (SSM) Example: Brahms Hungarian Dance No. 5 (Ormandy)
30 Self-Similarity Matrix (SSM) Example: Brahms Hungarian Dance No. 5 (Ormandy)
31 Self-Similarity Matrix (SSM) Example: Brahms Hungarian Dance No. 5 (Ormandy) G major G major
32 Self-Similarity Matrix (SSM) Example: Brahms Hungarian Dance No. 5 (Ormandy)
33 Self-Similarity Matrix (SSM) Example: Brahms Hungarian Dance No. 5 (Ormandy)
34 Self-Similarity Matrix (SSM) Example: Brahms Hungarian Dance No. 5 (Ormandy)
35 Self-Similarity Matrix (SSM) Example: Brahms Hungarian Dance No. 5 (Ormandy)
36 Self-Similarity Matrix (SSM) Example: Brahms Hungarian Dance No. 5 (Ormandy) Faster Slower
37 Self-Similarity Matrix (SSM) Example: Brahms Hungarian Dance No. 5 (Ormandy) Faster Slower
38 Self-Similarity Matrix (SSM) Example: Brahms Hungarian Dance No. 5 (Ormandy) Idealized SSM
39 Self-Similarity Matrix (SSM) Example: Brahms Hungarian Dance No. 5 (Ormandy) Idealized SSM Blocks: Homogeneity Paths: Repetition Corners: Novelty
40 SSM Enhancement Challenge: Presence of musical variations Fragmented paths and gaps Paths of poor quality Regions of constant (low) cost Curved paths Idea: Enhancement of path structure
41 SSM Enhancement Path Enhancement Time (samples) Time (samples)
42 SSM Enhancement Path Enhancement Diagonal smoothing Time (samples) Time (samples)
43 SSM Enhancement Path Enhancement Diagonal smoothing Multiple filtering Time (samples) Time (samples)
44 SSM Enhancement Path Enhancement Diagonal smoothing Multiple filtering Thresholding (relative) Scaling & penalty Time (samples) Time (samples)
45 SSM Enhancement Further Processing Path extraction Time (samples) Time (samples)
46 SSM Enhancement Further Processing Path extraction Pairwise relations Time (samples) Time (samples) Time (samples)
47 SSM Enhancement Further Processing Path extraction Pairwise relations Grouping (transitivity) Time (samples) Time (samples) Time (samples)
48 SSM Enhancement Further Processing Path extraction Pairwise relations Grouping (transitivity) Time (samples) Time (samples) Time (samples) Time (samples)
49 SSM Enhancement Example: Zager & Evans In The Year 2525 I V1 V2 V3 V4 V5 V6 V7 B V8 O
50 SSM Enhancement Example: Zager & Evans In The Year 2525 Missing relations because of transposed sections
51 SSM Enhancement Example: Zager & Evans In The Year 2525 Idea: Cyclic shift of one of the chroma sequences One semitone up
52 SSM Enhancement Example: Zager & Evans In The Year 2525 Idea: Cyclic shift of one of the chroma sequences Two semitones up
53 SSM Enhancement Example: Zager & Evans In The Year 2525 Idea: Overlay & Maximize Transposition-invariant SSM
54 Overview Introduction Feature Representations Self-Similarity Matrices Novelty-Based Segmentation
55 Novelty-Based Segmentation General goals: Find instances where musical changes occur. Find transition between subsequent musical parts. Idea (Foote): Use checkerboard-like kernel function to detect corner points on main diagonal of SSM.
56 Novelty-Based Segmentation Idea (Foote): Use checkerboard-like kernel function to detect corner points on main diagonal of SSM.
57 Novelty-Based Segmentation Idea (Foote): Use checkerboard-like kernel function to detect corner points on main diagonal of SSM.
58 Novelty-Based Segmentation Idea (Foote): Use checkerboard-like kernel function to detect corner points on main diagonal of SSM.
59 Novelty-Based Segmentation Idea (Foote): Use checkerboard-like kernel function to detect corner points on main diagonal of SSM.
60 Novelty-Based Segmentation Idea (Foote): Use checkerboard-like kernel function to detect corner points on main diagonal of SSM. Novelty function using
61 Novelty-Based Segmentation Idea (Foote): Use checkerboard-like kernel function to detect corner points on main diagonal of SSM. Novelty function using Novelty function using
62 Conclusions Structure Analysis
63 Conclusions Score Audio MIDI Representations Structure Analysis
64 Conclusions Score Audio MIDI Representations Harmony Musical Aspects Timbre Structure Analysis Tempo
65 Conclusions Score Audio MIDI Representations Musical Aspects Structure Analysis Segmentation Principles Harmony Timbre Tempo Repetition Homogeneity Novelty
66 Conclusions Temporal and Hierarchical Context Score Audio MIDI Representations Musical Aspects Structure Analysis Segmentation Principles Harmony Timbre Tempo Repetition Homogeneity Novelty
67 Links SM Toolbox (MATLAB) MSAF: Music Structure Analysis Framework (Python) SALAMI Annotation Data LibROSA (Python) Evaluation: mir_eval (Python) Deep Learning: Boundary Detection Jan Schlüter (PhD thesis)
Music Structure Analysis
Lecture Music Processing Music Structure Analysis Meinard Müller International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de Book: Fundamentals of Music Processing Meinard Müller Fundamentals
More informationMusic Structure Analysis
Overview Tutorial Music Structure Analysis Part I: Principles & Techniques (Meinard Müller) Coffee Break Meinard Müller International Audio Laboratories Erlangen Universität Erlangen-Nürnberg meinard.mueller@audiolabs-erlangen.de
More informationMusic Structure Analysis
Tutorial Automatisierte Methoden der Musikverarbeitung 47. Jahrestagung der Gesellschaft für Informatik Music Structure Analysis Meinard Müller, Christof Weiss, Stefan Balke International Audio Laboratories
More informationAudio Structure Analysis
Lecture Music Processing Audio Structure Analysis Meinard Müller International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de Music Structure Analysis Music segmentation pitch content
More informationAudio Structure Analysis
Advanced Course Computer Science Music Processing Summer Term 2009 Meinard Müller Saarland University and MPI Informatik meinard@mpi-inf.mpg.de Music Structure Analysis Music segmentation pitch content
More informationAUTOMATED METHODS FOR ANALYZING MUSIC RECORDINGS IN SONATA FORM
AUTOMATED METHODS FOR ANALYZING MUSIC RECORDINGS IN SONATA FORM Nanzhu Jiang International Audio Laboratories Erlangen nanzhu.jiang@audiolabs-erlangen.de Meinard Müller International Audio Laboratories
More informationCS 591 S1 Computational Audio
4/29/7 CS 59 S Computational Audio Wayne Snyder Computer Science Department Boston University Today: Comparing Musical Signals: Cross- and Autocorrelations of Spectral Data for Structure Analysis Segmentation
More informationMusic Representations. Beethoven, Bach, and Billions of Bytes. Music. Research Goals. Piano Roll Representation. Player Piano (1900)
Music Representations Lecture Music Processing Sheet Music (Image) CD / MP3 (Audio) MusicXML (Text) Beethoven, Bach, and Billions of Bytes New Alliances between Music and Computer Science Dance / Motion
More informationMusic Processing Introduction Meinard Müller
Lecture Music Processing Introduction Meinard Müller International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de Music Music Information Retrieval (MIR) Sheet Music (Image) CD / MP3
More informationTempo and Beat Tracking
Tutorial Automatisierte Methoden der Musikverarbeitung 47. Jahrestagung der Gesellschaft für Informatik Tempo and Beat Tracking Meinard Müller, Christof Weiss, Stefan Balke International Audio Laboratories
More informationFurther Topics in MIR
Tutorial Automatisierte Methoden der Musikverarbeitung 47. Jahrestagung der Gesellschaft für Informatik Further Topics in MIR Meinard Müller, Christof Weiss, Stefan Balke International Audio Laboratories
More informationBook: Fundamentals of Music Processing. Audio Features. Book: Fundamentals of Music Processing. Book: Fundamentals of Music Processing
Book: Fundamentals of Music Processing Lecture Music Processing Audio Features Meinard Müller International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de Meinard Müller Fundamentals
More informationMusic Information Retrieval
Music Information Retrieval When Music Meets Computer Science Meinard Müller International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de Berlin MIR Meetup 20.03.2017 Meinard Müller
More informationAudio. Meinard Müller. Beethoven, Bach, and Billions of Bytes. International Audio Laboratories Erlangen. International Audio Laboratories Erlangen
Meinard Müller Beethoven, Bach, and Billions of Bytes When Music meets Computer Science Meinard Müller International Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de School of Mathematics University
More informationMethods for the automatic structural analysis of music. Jordan B. L. Smith CIRMMT Workshop on Structural Analysis of Music 26 March 2010
1 Methods for the automatic structural analysis of music Jordan B. L. Smith CIRMMT Workshop on Structural Analysis of Music 26 March 2010 2 The problem Going from sound to structure 2 The problem Going
More informationInformed Feature Representations for Music and Motion
Meinard Müller Informed Feature Representations for Music and Motion Meinard Müller 27 Habilitation, Bonn 27 MPI Informatik, Saarbrücken Senior Researcher Music Processing & Motion Processing Lorentz Workshop
More informationAUDIO-BASED MUSIC STRUCTURE ANALYSIS
11th International Society for Music Information Retrieval Conference (ISMIR 21) AUDIO-ASED MUSIC STRUCTURE ANALYSIS Jouni Paulus Fraunhofer Institute for Integrated Circuits IIS Erlangen, Germany jouni.paulus@iis.fraunhofer.de
More informationAUDIO-BASED MUSIC STRUCTURE ANALYSIS
AUDIO-ASED MUSIC STRUCTURE ANALYSIS Jouni Paulus Fraunhofer Institute for Integrated Circuits IIS Erlangen, Germany jouni.paulus@iis.fraunhofer.de Meinard Müller Saarland University and MPI Informatik
More informationGrouping Recorded Music by Structural Similarity Juan Pablo Bello New York University ISMIR 09, Kobe October 2009 marl music and audio research lab
Grouping Recorded Music by Structural Similarity Juan Pablo Bello New York University ISMIR 09, Kobe October 2009 Sequence-based analysis Structure discovery Cooper, M. & Foote, J. (2002), Automatic Music
More informationMusic Processing Audio Retrieval Meinard Müller
Lecture Music Processing Audio Retrieval Meinard Müller International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de Book: Fundamentals of Music Processing Meinard Müller Fundamentals
More informationTempo and Beat Analysis
Advanced Course Computer Science Music Processing Summer Term 2010 Meinard Müller, Peter Grosche Saarland University and MPI Informatik meinard@mpi-inf.mpg.de Tempo and Beat Analysis Musical Properties:
More informationMusic Information Retrieval (MIR)
Ringvorlesung Perspektiven der Informatik Sommersemester 2010 Meinard Müller Universität des Saarlandes und MPI Informatik meinard@mpi-inf.mpg.de Priv.-Doz. Dr. Meinard Müller 2007 Habilitation, Bonn 2007
More informationMeinard Müller. Beethoven, Bach, und Billionen Bytes. International Audio Laboratories Erlangen. International Audio Laboratories Erlangen
Beethoven, Bach, und Billionen Bytes Musik trifft Informatik Meinard Müller Meinard Müller 2007 Habilitation, Bonn 2007 MPI Informatik, Saarbrücken Senior Researcher Music Processing & Motion Processing
More informationA repetition-based framework for lyric alignment in popular songs
A repetition-based framework for lyric alignment in popular songs ABSTRACT LUONG Minh Thang and KAN Min Yen Department of Computer Science, School of Computing, National University of Singapore We examine
More informationMusic Information Retrieval (MIR)
Ringvorlesung Perspektiven der Informatik Wintersemester 2011/2012 Meinard Müller Universität des Saarlandes und MPI Informatik meinard@mpi-inf.mpg.de Priv.-Doz. Dr. Meinard Müller 2007 Habilitation, Bonn
More informationMusic Representations
Lecture Music Processing Music Representations Meinard Müller International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de Book: Fundamentals of Music Processing Meinard Müller Fundamentals
More informationFREISCHÜTZ DIGITAL: A CASE STUDY FOR REFERENCE-BASED AUDIO SEGMENTATION OF OPERAS
FREISCHÜTZ DIGITAL: A CASE STUDY FOR REFERENCE-BASED AUDIO SEGMENTATION OF OPERAS Thomas Prätzlich International Audio Laboratories Erlangen thomas.praetzlich@audiolabs-erlangen.de Meinard Müller International
More informationNew Developments in Music Information Retrieval
New Developments in Music Information Retrieval Meinard Müller 1 1 Saarland University and MPI Informatik, Campus E1.4, 66123 Saarbrücken, Germany Correspondence should be addressed to Meinard Müller (meinard@mpi-inf.mpg.de)
More informationThe song remains the same: identifying versions of the same piece using tonal descriptors
The song remains the same: identifying versions of the same piece using tonal descriptors Emilia Gómez Music Technology Group, Universitat Pompeu Fabra Ocata, 83, Barcelona emilia.gomez@iua.upf.edu Abstract
More informationTowards Supervised Music Structure Annotation: A Case-based Fusion Approach.
Towards Supervised Music Structure Annotation: A Case-based Fusion Approach. Giacomo Herrero MSc Thesis, Universitat Pompeu Fabra Supervisor: Joan Serrà, IIIA-CSIC September, 2014 Abstract Analyzing the
More informationA FORMALIZATION OF RELATIVE LOCAL TEMPO VARIATIONS IN COLLECTIONS OF PERFORMANCES
A FORMALIZATION OF RELATIVE LOCAL TEMPO VARIATIONS IN COLLECTIONS OF PERFORMANCES Jeroen Peperkamp Klaus Hildebrandt Cynthia C. S. Liem Delft University of Technology, Delft, The Netherlands jbpeperkamp@gmail.com
More informationTOWARD AN INTELLIGENT EDITOR FOR JAZZ MUSIC
TOWARD AN INTELLIGENT EDITOR FOR JAZZ MUSIC G.TZANETAKIS, N.HU, AND R.B. DANNENBERG Computer Science Department, Carnegie Mellon University 5000 Forbes Avenue, Pittsburgh, PA 15213, USA E-mail: gtzan@cs.cmu.edu
More informationMusic Radar: A Web-based Query by Humming System
Music Radar: A Web-based Query by Humming System Lianjie Cao, Peng Hao, Chunmeng Zhou Computer Science Department, Purdue University, 305 N. University Street West Lafayette, IN 47907-2107 {cao62, pengh,
More informationAUTOMATIC MAPPING OF SCANNED SHEET MUSIC TO AUDIO RECORDINGS
AUTOMATIC MAPPING OF SCANNED SHEET MUSIC TO AUDIO RECORDINGS Christian Fremerey, Meinard Müller,Frank Kurth, Michael Clausen Computer Science III University of Bonn Bonn, Germany Max-Planck-Institut (MPI)
More informationMATCHING MUSICAL THEMES BASED ON NOISY OCR AND OMR INPUT. Stefan Balke, Sanu Pulimootil Achankunju, Meinard Müller
MATCHING MUSICAL THEMES BASED ON NOISY OCR AND OMR INPUT Stefan Balke, Sanu Pulimootil Achankunju, Meinard Müller International Audio Laboratories Erlangen, Friedrich-Alexander-Universität (FAU), Germany
More informationMusic Alignment and Applications. Introduction
Music Alignment and Applications Roger B. Dannenberg Schools of Computer Science, Art, and Music Introduction Music information comes in many forms Digital Audio Multi-track Audio Music Notation MIDI Structured
More informationAUTOMATIC ACCOMPANIMENT OF VOCAL MELODIES IN THE CONTEXT OF POPULAR MUSIC
AUTOMATIC ACCOMPANIMENT OF VOCAL MELODIES IN THE CONTEXT OF POPULAR MUSIC A Thesis Presented to The Academic Faculty by Xiang Cao In Partial Fulfillment of the Requirements for the Degree Master of Science
More informationMUSIC SHAPELETS FOR FAST COVER SONG RECOGNITION
MUSIC SHAPELETS FOR FAST COVER SONG RECOGNITION Diego F. Silva Vinícius M. A. Souza Gustavo E. A. P. A. Batista Instituto de Ciências Matemáticas e de Computação Universidade de São Paulo {diegofsilva,vsouza,gbatista}@icmc.usp.br
More informationBeethoven, Bach und Billionen Bytes
Meinard Müller Beethoven, Bach und Billionen Bytes Automatisierte Analyse von Musik und Klängen Meinard Müller Lehrerfortbildung in Informatik Dagstuhl, Dezember 2014 2001 PhD, Bonn University 2002/2003
More informationPopular Song Summarization Using Chorus Section Detection from Audio Signal
Popular Song Summarization Using Chorus Section Detection from Audio Signal Sheng GAO 1 and Haizhou LI 2 Institute for Infocomm Research, A*STAR, Singapore 1 gaosheng@i2r.a-star.edu.sg 2 hli@i2r.a-star.edu.sg
More informationMusic Similarity and Cover Song Identification: The Case of Jazz
Music Similarity and Cover Song Identification: The Case of Jazz Simon Dixon and Peter Foster s.e.dixon@qmul.ac.uk Centre for Digital Music School of Electronic Engineering and Computer Science Queen Mary
More informationBeethoven, Bach, and Billions of Bytes
Lecture Music Processing Beethoven, Bach, and Billions of Bytes New Alliances between Music and Computer Science Meinard Müller International Audio Laboratories Erlangen meinard.mueller@audiolabs-erlangen.de
More informationRhythm related MIR tasks
Rhythm related MIR tasks Ajay Srinivasamurthy 1, André Holzapfel 1 1 MTG, Universitat Pompeu Fabra, Barcelona, Spain 10 July, 2012 Srinivasamurthy et al. (UPF) MIR tasks 10 July, 2012 1 / 23 1 Rhythm 2
More informationAspects of Music. Chord Recognition. Musical Chords. Harmony: The Basis of Music. Musical Chords. Musical Chords. Piece of music. Rhythm.
Aspects of Music Lecture Music Processing Piece of music hord Recognition Meinard Müller International Audio Laboratories rlangen meinard.mueller@audiolabs-erlangen.de Melody Rhythm Harmony Harmony: The
More informationA MID-LEVEL REPRESENTATION FOR CAPTURING DOMINANT TEMPO AND PULSE INFORMATION IN MUSIC RECORDINGS
th International Society for Music Information Retrieval Conference (ISMIR 9) A MID-LEVEL REPRESENTATION FOR CAPTURING DOMINANT TEMPO AND PULSE INFORMATION IN MUSIC RECORDINGS Peter Grosche and Meinard
More informationSHEET MUSIC-AUDIO IDENTIFICATION
SHEET MUSIC-AUDIO IDENTIFICATION Christian Fremerey, Michael Clausen, Sebastian Ewert Bonn University, Computer Science III Bonn, Germany {fremerey,clausen,ewerts}@cs.uni-bonn.de Meinard Müller Saarland
More informationShades of Music. Projektarbeit
Shades of Music Projektarbeit Tim Langer LFE Medieninformatik 28.07.2008 Betreuer: Dominikus Baur Verantwortlicher Hochschullehrer: Prof. Dr. Andreas Butz LMU Department of Media Informatics Projektarbeit
More informationLecture 12: Alignment and Matching
ELEN E4896 MUSIC SIGNAL PROCESSING Lecture 12: Alignment and Matching 1. Music Alignment 2. Cover Song Detection 3. Echo Nest Analyze Dan Ellis Dept. Electrical Engineering, Columbia University dpwe@ee.columbia.edu
More informationTowards Automated Processing of Folk Song Recordings
Towards Automated Processing of Folk Song Recordings Meinard Müller, Peter Grosche, Frans Wiering 2 Saarland University and MPI Informatik Campus E-4, 6623 Saarbrücken, Germany meinard@mpi-inf.mpg.de,
More informationAudio Feature Extraction for Corpus Analysis
Audio Feature Extraction for Corpus Analysis Anja Volk Sound and Music Technology 5 Dec 2017 1 Corpus analysis What is corpus analysis study a large corpus of music for gaining insights on general trends
More informationMUSI-6201 Computational Music Analysis
MUSI-6201 Computational Music Analysis Part 9.1: Genre Classification alexander lerch November 4, 2015 temporal analysis overview text book Chapter 8: Musical Genre, Similarity, and Mood (pp. 151 155)
More informationPattern Based Melody Matching Approach to Music Information Retrieval
Pattern Based Melody Matching Approach to Music Information Retrieval 1 D.Vikram and 2 M.Shashi 1,2 Department of CSSE, College of Engineering, Andhra University, India 1 daravikram@yahoo.co.in, 2 smogalla2000@yahoo.com
More informationMusic Segmentation Using Markov Chain Methods
Music Segmentation Using Markov Chain Methods Paul Finkelstein March 8, 2011 Abstract This paper will present just how far the use of Markov Chains has spread in the 21 st century. We will explain some
More informationA comparison and evaluation of approaches to the automatic formal analysis of musical audio
A comparison and evaluation of approaches to the automatic formal analysis of musical audio Jordan B. L. Smith Master of Arts Music Technology Area Department of Music Research Schulich School of Music
More informationAnalysing Musical Pieces Using harmony-analyser.org Tools
Analysing Musical Pieces Using harmony-analyser.org Tools Ladislav Maršík Dept. of Software Engineering, Faculty of Mathematics and Physics Charles University, Malostranské nám. 25, 118 00 Prague 1, Czech
More informationANALYZING MEASURE ANNOTATIONS FOR WESTERN CLASSICAL MUSIC RECORDINGS
ANALYZING MEASURE ANNOTATIONS FOR WESTERN CLASSICAL MUSIC RECORDINGS Christof Weiß 1 Vlora Arifi-Müller 1 Thomas Prätzlich 1 Rainer Kleinertz 2 Meinard Müller 1 1 International Audio Laboratories Erlangen,
More informationAUTOMASHUPPER: AN AUTOMATIC MULTI-SONG MASHUP SYSTEM
AUTOMASHUPPER: AN AUTOMATIC MULTI-SONG MASHUP SYSTEM Matthew E. P. Davies, Philippe Hamel, Kazuyoshi Yoshii and Masataka Goto National Institute of Advanced Industrial Science and Technology (AIST), Japan
More informationEffects of acoustic degradations on cover song recognition
Signal Processing in Acoustics: Paper 68 Effects of acoustic degradations on cover song recognition Julien Osmalskyj (a), Jean-Jacques Embrechts (b) (a) University of Liège, Belgium, josmalsky@ulg.ac.be
More informationRETRIEVING AUDIO RECORDINGS USING MUSICAL THEMES
RETRIEVING AUDIO RECORDINGS USING MUSICAL THEMES Stefan Balke, Vlora Arifi-Müller, Lukas Lamprecht, Meinard Müller International Audio Laboratories Erlangen, Friedrich-Alexander-Universität (FAU), Germany
More informationDESIGN AND CREATION OF A LARGE-SCALE DATABASE OF STRUCTURAL ANNOTATIONS
12th International Society for Music Information Retrieval Conference (ISMIR 2011) DESIGN AND CREATION OF A LARGE-SCALE DATABASE OF STRUCTURAL ANNOTATIONS Jordan B. L. Smith 1, J. Ashley Burgoyne 2, Ichiro
More informationTOWARDS AUTOMATED EXTRACTION OF TEMPO PARAMETERS FROM EXPRESSIVE MUSIC RECORDINGS
th International Society for Music Information Retrieval Conference (ISMIR 9) TOWARDS AUTOMATED EXTRACTION OF TEMPO PARAMETERS FROM EXPRESSIVE MUSIC RECORDINGS Meinard Müller, Verena Konz, Andi Scharfstein
More informationAudio Cover Song Identification using Convolutional Neural Network
Audio Cover Song Identification using Convolutional Neural Network Sungkyun Chang 1,4, Juheon Lee 2,4, Sang Keun Choe 3,4 and Kyogu Lee 1,4 Music and Audio Research Group 1, College of Liberal Studies
More informationarxiv: v1 [cs.ir] 2 Aug 2017
PIECE IDENTIFICATION IN CLASSICAL PIANO MUSIC WITHOUT REFERENCE SCORES Andreas Arzt, Gerhard Widmer Department of Computational Perception, Johannes Kepler University, Linz, Austria Austrian Research Institute
More information/$ IEEE
IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 17, NO. 6, AUGUST 2009 1159 Music Structure Analysis Using a Probabilistic Fitness Measure and a Greedy Search Algorithm Jouni Paulus,
More informationMODELS of music begin with a representation of the
602 IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 18, NO. 3, MARCH 2010 Modeling Music as a Dynamic Texture Luke Barrington, Student Member, IEEE, Antoni B. Chan, Member, IEEE, and
More informationSTRUCTURAL ANALYSIS AND SEGMENTATION OF MUSIC SIGNALS
STRUCTURAL ANALYSIS AND SEGMENTATION OF MUSIC SIGNALS A DISSERTATION SUBMITTED TO THE DEPARTMENT OF TECHNOLOGY OF THE UNIVERSITAT POMPEU FABRA FOR THE PROGRAM IN COMPUTER SCIENCE AND DIGITAL COMMUNICATION
More informationCitation for published version (APA): Jensen, K. K. (2005). A Causal Rhythm Grouping. Lecture Notes in Computer Science, 3310,
Aalborg Universitet A Causal Rhythm Grouping Jensen, Karl Kristoffer Published in: Lecture Notes in Computer Science Publication date: 2005 Document Version Early version, also known as pre-print Link
More informationAudio-based Music Segmentation Using Multiple Features
Audio-based Music Segmentation Using Multiple Features Pedro Girão Antunes Dissertation submitted for obtaining the degree of Master in Electrical and Computer Engineering Jury President: Doutor Carlos
More informationSINGING EXPRESSION TRANSFER FROM ONE VOICE TO ANOTHER FOR A GIVEN SONG. Sangeon Yong, Juhan Nam
SINGING EXPRESSION TRANSFER FROM ONE VOICE TO ANOTHER FOR A GIVEN SONG Sangeon Yong, Juhan Nam Graduate School of Culture Technology, KAIST {koragon2, juhannam}@kaist.ac.kr ABSTRACT We present a vocal
More informationThe Effect of DJs Social Network on Music Popularity
The Effect of DJs Social Network on Music Popularity Hyeongseok Wi Kyung hoon Hyun Jongpil Lee Wonjae Lee Korea Advanced Institute Korea Advanced Institute Korea Advanced Institute Korea Advanced Institute
More informationUSING MUSICAL STRUCTURE TO ENHANCE AUTOMATIC CHORD TRANSCRIPTION
10th International Society for Music Information Retrieval Conference (ISMIR 2009) USING MUSICL STRUCTURE TO ENHNCE UTOMTIC CHORD TRNSCRIPTION Matthias Mauch, Katy Noland, Simon Dixon Queen Mary University
More informationChord Recognition. Aspects of Music. Musical Chords. Harmony: The Basis of Music. Musical Chords. Musical Chords. Music Processing.
dvanced ourse omputer Science Music Processing Summer Term 2 Meinard Müller, Verena Konz Saarland University and MPI Informatik meinard@mpi-inf.mpg.de hord Recognition spects of Music Melody Piece of music
More informationDISCOVERY OF REPEATED VOCAL PATTERNS IN POLYPHONIC AUDIO: A CASE STUDY ON FLAMENCO MUSIC. Univ. of Piraeus, Greece
DISCOVERY OF REPEATED VOCAL PATTERNS IN POLYPHONIC AUDIO: A CASE STUDY ON FLAMENCO MUSIC Nadine Kroher 1, Aggelos Pikrakis 2, Jesús Moreno 3, José-Miguel Díaz-Báñez 3 1 Music Technology Group Univ. Pompeu
More informationMAKE YOUR OWN ACCOMPANIMENT: ADAPTING FULL-MIX RECORDINGS TO MATCH SOLO-ONLY USER RECORDINGS
MAKE YOUR OWN ACCOMPANIMENT: ADAPTING FULL-MIX RECORDINGS TO MATCH SOLO-ONLY USER RECORDINGS TJ Tsai Harvey Mudd College Steve Tjoa Violin.io Meinard Müller International Audio Laboratories Erlangen ABSTRACT
More informationAutomatic Identification of Samples in Hip Hop Music
Automatic Identification of Samples in Hip Hop Music Jan Van Balen 1, Martín Haro 2, and Joan Serrà 3 1 Dept of Information and Computing Sciences, Utrecht University, the Netherlands 2 Music Technology
More informationARECENT emerging area of activity within the music information
1726 IEEE/ACM TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 22, NO. 12, DECEMBER 2014 AutoMashUpper: Automatic Creation of Multi-Song Music Mashups Matthew E. P. Davies, Philippe Hamel,
More informationMAKE YOUR OWN ACCOMPANIMENT: ADAPTING FULL-MIX RECORDINGS TO MATCH SOLO-ONLY USER RECORDINGS
MAKE YOUR OWN ACCOMPANIMENT: ADAPTING FULL-MIX RECORDINGS TO MATCH SOLO-ONLY USER RECORDINGS TJ Tsai 1 Steven K. Tjoa 2 Meinard Müller 3 1 Harvey Mudd College, Claremont, CA 2 Galvanize, Inc., San Francisco,
More informationRepeating Pattern Discovery and Structure Analysis from Acoustic Music Data
Repeating Pattern Discovery and Structure Analysis from Acoustic Music Data Lie Lu, Muyuan Wang 2, Hong-Jiang Zhang Microsoft Research Asia Beijing, P.R. China, 8 {llu, hjzhang}@microsoft.com 2 Department
More informationMusic Information Retrieval. Juan Pablo Bello MPATE-GE 2623 Music Information Retrieval New York University
Music Information Retrieval Juan Pablo Bello MPATE-GE 2623 Music Information Retrieval New York University 1 Juan Pablo Bello Office: Room 626, 6th floor, 35 W 4th Street (ext. 85736) Office Hours: Wednesdays
More informationComputational Modelling of Harmony
Computational Modelling of Harmony Simon Dixon Centre for Digital Music, Queen Mary University of London, Mile End Rd, London E1 4NS, UK simon.dixon@elec.qmul.ac.uk http://www.elec.qmul.ac.uk/people/simond
More informationData-Driven Solo Voice Enhancement for Jazz Music Retrieval
Data-Driven Solo Voice Enhancement for Jazz Music Retrieval Stefan Balke1, Christian Dittmar1, Jakob Abeßer2, Meinard Müller1 1International Audio Laboratories Erlangen 2Fraunhofer Institute for Digital
More informationSIMULTANEOUS SEPARATION AND SEGMENTATION IN LAYERED MUSIC
SIMULTANEOUS SEPARATION AND SEGMENTATION IN LAYERED MUSIC Prem Seetharaman Northwestern University prem@u.northwestern.edu Bryan Pardo Northwestern University pardo@northwestern.edu ABSTRACT In many pieces
More informationAn Examination of Foote s Self-Similarity Method
WINTER 2001 MUS 220D Units: 4 An Examination of Foote s Self-Similarity Method Unjung Nam The study is based on my dissertation proposal. Its purpose is to improve my understanding of the feature extractors
More informationHomework 2 Key-finding algorithm
Homework 2 Key-finding algorithm Li Su Research Center for IT Innovation, Academia, Taiwan lisu@citi.sinica.edu.tw (You don t need any solid understanding about the musical key before doing this homework,
More informationMusic Synchronization. Music Synchronization. Music Data. Music Data. General Goals. Music Information Retrieval (MIR)
Advanced Course Computer Science Music Processing Summer Term 2010 Music ata Meinard Müller Saarland University and MPI Informatik meinard@mpi-inf.mpg.de Music Synchronization Music ata Various interpretations
More informationResearch Article Multiple Scale Music Segmentation Using Rhythm, Timbre, and Harmony
Hindawi Publishing Corporation EURASIP Journal on Advances in Signal Processing Volume 007, Article ID 7305, pages doi:0.55/007/7305 Research Article Multiple Scale Music Segmentation Using Rhythm, Timbre,
More informationAutomatic characterization of ornamentation from bassoon recordings for expressive synthesis
Automatic characterization of ornamentation from bassoon recordings for expressive synthesis Montserrat Puiggròs, Emilia Gómez, Rafael Ramírez, Xavier Serra Music technology Group Universitat Pompeu Fabra
More informationAudio alignment for improved melody transcription of Irish traditional music
Audio alignment for improved melody transcription of Irish traditional music Hannah Robertson MUMT 621 Winter 2012 In order to study Irish traditional music comprehensively, it is critical to work from
More informationAutomatic Extraction of Popular Music Ringtones Based on Music Structure Analysis
Automatic Extraction of Popular Music Ringtones Based on Music Structure Analysis Fengyan Wu fengyanyy@163.com Shutao Sun stsun@cuc.edu.cn Weiyao Xue Wyxue_std@163.com Abstract Automatic extraction of
More information10 Visualization of Tonal Content in the Symbolic and Audio Domains
10 Visualization of Tonal Content in the Symbolic and Audio Domains Petri Toiviainen Department of Music PO Box 35 (M) 40014 University of Jyväskylä Finland ptoiviai@campus.jyu.fi Abstract Various computational
More informationMusical Examination to Bridge Audio Data and Sheet Music
Musical Examination to Bridge Audio Data and Sheet Music Xunyu Pan, Timothy J. Cross, Liangliang Xiao, and Xiali Hei Department of Computer Science and Information Technologies Frostburg State University
More informationTranscription of the Singing Melody in Polyphonic Music
Transcription of the Singing Melody in Polyphonic Music Matti Ryynänen and Anssi Klapuri Institute of Signal Processing, Tampere University Of Technology P.O.Box 553, FI-33101 Tampere, Finland {matti.ryynanen,
More informationMusic Emotion Recognition. Jaesung Lee. Chung-Ang University
Music Emotion Recognition Jaesung Lee Chung-Ang University Introduction Searching Music in Music Information Retrieval Some information about target music is available Query by Text: Title, Artist, or
More informationTopic 11. Score-Informed Source Separation. (chroma slides adapted from Meinard Mueller)
Topic 11 Score-Informed Source Separation (chroma slides adapted from Meinard Mueller) Why Score-informed Source Separation? Audio source separation is useful Music transcription, remixing, search Non-satisfying
More informationSALAMI: Structural Analysis of Large Amounts of Music Information. Annotator s Guide
SALAMI: Structural Analysis of Large Amounts of Music Information Annotator s Guide SALAMI in a nutshell: Our goal is to provide an unprecedented number of structural analyses of pieces of music for future
More informationA SIMPLE-CYCLES WEIGHTED KERNEL BASED ON HARMONY STRUCTURE FOR SIMILARITY RETRIEVAL
A SIMPLE-CYCLES WEIGHTED KERNEL BASED ON HARMONY STRUCTURE FOR SIMILARITY RETRIEVAL Silvia García-Díez and Marco Saerens Université catholique de Louvain {silvia.garciadiez,marco.saerens}@uclouvain.be
More informationAspects of Music Information Retrieval. Will Meurer. School of Information at. The University of Texas at Austin
Aspects of Music Information Retrieval Will Meurer School of Information at The University of Texas at Austin Music Information Retrieval 1 Abstract This paper outlines the complexities of music as information
More informationGROUPING RECORDED MUSIC BY STRUCTURAL SIMILARITY
10th International Society for Music Information Retrieval Conference (ISMIR 2009) GROUPING RECORDED MUSIC BY STRUCTURAL SIMILARITY Juan Pablo Bello Music and Audio Research Lab (MARL), New York University
More informationInteracting with a Virtual Conductor
Interacting with a Virtual Conductor Pieter Bos, Dennis Reidsma, Zsófia Ruttkay, Anton Nijholt HMI, Dept. of CS, University of Twente, PO Box 217, 7500AE Enschede, The Netherlands anijholt@ewi.utwente.nl
More informationTheory D-examination 1
Theory D-examination 1 1. Metre 1.1. Simple and compound metre, composite metre 1.2. Afterbeat 2. Pitch: chords 2.1. Triads and seventh chords 3. Theory of form 3.1. Binary and ternary form 3.2. Pop song
More information