Curriculum Vitae. Electrical Engineering, BSc September 1997 June 2000 Specialization: Control and Automation

Size: px
Start display at page:

Download "Curriculum Vitae. Electrical Engineering, BSc September 1997 June 2000 Specialization: Control and Automation"

Transcription

1 Curriculum Vitae Personal Information Contact Information Research Interests Education Name Esteban Maestre Birth Barcelona, Spain, 28 October 1979 Home address 5187 Jeanne-Mance, apt. 201, Montréal, QC, Canada Telephone number Computational Acoustic Modeling Lab, Music Technology Center for Interdisciplinary Research in Music, Media, and Technology Department of Music Research, Schulich School of Music McGill University, Montréal, Canada Digital audio signal processing // Musical acoustics // Physical modeling // Artificial reverberation Gesture control of sound synthesis // Motion capture data analysis Music performance modeling // Music rendering by automatic control of physical models Digital archiving and web retrieval of music performance multimodal data Universitat Pompeu Fabra, Barcelona, Spain Computer Science and Digital Communication, PhD October 2006 November 2009 Dissertation: Modeling instrumental gestures: an analysis/synthesis framework for violin bowing Advisors: Prof. Xavier Serra (Univesitat Pompeu Fabra) and Prof. Julius Smith (Stanford University) Computer Science and Digital Communication, DEA Master September 2004 October 2006 Thesis: Coding instrumental gestures: towards a quantitative description of instrumental gestures in excitation-continuous musical instruments Advisor: Prof. Xavier Serra (Univesitat Pompeu Fabra) Universitat Politècnica de Catalunya, Barcelona, Spain Electrical Engineering, MSc September 2001 June 2003 Thesis: Resonant LLC converter for large flat displays Advisors: Prof. Francesc Guinjoan (Universitat Politècnica de Catalunya) and Dr. Bernd Ackermann (Philips Research Laboratories - Aachen, Germany) Electrical Engineering, BSc September 1997 June 2000 Specialization: Control and Automation Languages Honors and Awards Native Spanish, Catalan. Fluent English, French, Italian. Conversational Portuguese, German, Greek. Tenure-track, Assistant Professor of Media Technology and Interaction Design, School of Computer Science and Communication, KTH Royal Institute of Technology, Stockholm. Ranked #1 (2016) [declined]. Marie Curie Fellowship, awarded by the European Research Council for a combined research residency at the Computational Acoustic Modeling Laboratory, Music Tech, Schulich Music School, McGill University, and the Music Technology Group, Universitat Pompeu Fabra (USD 300K, ). SAEMP Fellowship, awarded by the Spanish Research Council for a post-doctoral research residency at the Center for Computer Research in Music and Acoustics (CCRMA), Stanford University (USD 125K, ) [declined]. Beatriu de Pinós Fellowship, awarded by Agència de Gestió d Ajuts Universitaris i de Recerca (AGAUR) for a post-doctoral research residency at the Center for Computer Research in Music and Acoustics (CCRMA), Stanford University (USD 110K, ). Scholarship for Outstanding Academic Achievement, Universitat Pompeu Fabra (USD 3K, 2010). BE Postgraduate Research Scholarship, awarded by Agència de Gestió d Ajuts Universitaris i de Recerca (AGAUR) for a pre-doctoral research residency at the Center for Computer Research in Music and Acoustics (CCRMA), Stanford University (USD 15K, 2008). STSM Scholarship, awarded by the EU FP7 ICT SID Project (USD 2K, 2008).

2 R+D+I Research Scholarship, awarded by Universitat Pompeu Fabra (USD 140K, ). Junior Research Scientist, Philips Resarch Laboratories Aachen (USD 10K, ). Professional Experience McGill University, Montréal, Canada Research Associate April 2017 present Research on computational acoustics and virtual auditory reality. Physical modeling sound synthesis. Artificial reverberation. Lecturer August 2017 present Undergraduate and graduate courses on digital musical instrument control, and digital signal processing for sound synthesis and effects. Marie Curie Fellow Researcher April 2014 April 2017 Research on autonomous sound synthesis via gesture modeling and physically inspired virtual musical instruments. Stanford University, Stanford, USA Lecturer February 2011 August 2016 Digital signal processing for digital audio effects: CCRMA Summer Workshops - Digital Stompbox Design Postdoctoral Researcher July 2013 February 2014 Research on musical instrument sound synthesis via physical modeling. Postdoctoral Researcher October 2010 October 2012 Research on instrumental gesture modeling in (ensemble) music performance, multi-modal data acquisition, and musical instrument sound analysis/synthesis. Visiting Researcher March 2008 December 2008 Research on instrumental gesture modeling in violin music performance, and violin sound analysis/synthesis. Technological Education Institute of Crete, Rethymno, Greece Postdoctoral Researcher September 2015 October 2015 Design of ad-hoc laser interferometry measurement instrumentation for vibration analysis of musical instruments. Universidad Federico Santa María, Valparaíso, Chile Postdoctoral Researcher December 2012 February 2013 Research on numerical methods for computational acoustic modeling. Postdoctoral Researcher December 2014 February 2015 Research on numerical methods for computational acoustic modeling. Universitat Pompeu Fabra, Barcelona, Spain Research Associate, Marie Curie Fellow Researcher November 2009 April 2017 EU, national, and industrial funded projects, including (ensemble) music performance modeling, physical and spectral modeling synthesis, context-aware mobile music interaction, motion analysis in violin bowing, recorder performance and sound modeling, speech processing, and multi-modal data processing and applications. Other duties include the supervision and evaluation of graduate students in research-oriented M.Sc. thesis projects and Ph.D. theses. Teaching Assistant, Lecturer September 2004 October 2010 Taught diverse theory and practical classes, including Digital Music Lab, Voice over IP, Relational Databases, and diverse seminars at the Sound and Music Computing MSc program. Research Assistant March 2004 October 2009 EU, national, and industrial funded projects, including context-aware mobile music interaction, multimodal analysis of violin playing, singing voice modeling, and expressive music performance modeling (saxophone and violin). Other duties included the supervision and evaluation of graduate students in

3 research-oriented BSc final projects. Barcelona Music and Audio Technologies, Barcelona, Spain Business Development Officer, North America March 2008 November 2009 Business opportunity search at international level. Technology and product partnerships. Universitat Politècnica de Catalunya, Barcelona, Spain Lecturer September 2002 June 2004 Taught diverse theory and practical classes, including Digital Signal Processing, Circuit Design, Power Electronics, DSP Processor Programming, and Multimedia Laboratory. Lecturer September 2001 June 2002 Taught diverse theory and practical classes, including Digital Signal Processing, Circuit Design, and Analog Electronics. Philips Research, Aachen, Germany Junior Researcher September 2002 June 2003 Research activities in the field of resonant power conversion. Successfully developed a novel LLC resonant converter prototype. Finalized a research-oriented MSc thesis in industrial context. Teaching and Advising McGill University, Montréal, Canada April 2014 Present Lecturer in undergraduate and graduate courses covering communication and control in music and audio software (Arduino, Max/MSP, C++), digital signal processing for audio effects and sound synthesis. Participation in research seminars as part of graduate level courses in computational acoustics, and digital interfaces for musical instrument design. Engaged in research overview and collaboration with Master and PhD students involved in projects dealing with musical instrument acoustic characterization and sound synthesis. Stanford University, Stanford, USA February 2011 August 2016 Since 2011, Lecturer in Digital Audio Effects for the CCRMA Summer Workshops. Theory of effects and programming. Deployment on low-cost hardware: sensor data acquisition and embedded Linux audio/sensor data processing using Raspberry PI and Arduino. Along my different stages at the Center for Computer Research in Music and Acoustics I gave seminars, and advised and collaborated with students at the MSc and PhD levels. Universitat Pompeu Fabra, Barcelona, Spain September 2004 February 2016 From 2004 until 2010, both Teaching Assistant (laboratory classes) and Lecturer (theory classes) in Digital Music Lab, Voice over IP, and Relational Databases courses, part of the BSc degree in Electrical Engineering / Audio-visual Systems. Moreover, gave research-oriented seminars as part of the Sound and Music Computing MSc program. Throughout my years at Universitat Pompeu Fabra and still today, I have been principal advisor in research-oriented BSc and MSc Theses of successful students who later went on to work at companies like Yamaha, Native Instruments, or Spotify. Also, through funding coming from large-scale research projects I have proposed and led, I have mentored and supported PhD students working on performance modeling via multi-modal data analysis. These students, for which I was principal PhD advisor, successfully defended their dissertaiton in 2014 and Universitat Politécnica de Catalunya, Barcelona, Spain September 2001 June 2004 Soon after completing my BSc degree in Electrical Engineering, I became Part-time Lecturer in the same degree and same school. One year after, while I was still pursuing my MSc degree in Electrical Engineering, I was hired as Full-time Lecturer for the BSc degree studies. During my years as Lecturer at Universitat Politécnica de Catalunya (largest and most renowned technical university in Catalunya), I acquired significant experience in teaching. I thaught theory and laboratory classes (including the creation of new courses from scratch) on Digital Signal Processing, Circuit Design, Analog Electronics, Power Electronics, DSP Processor Programming, and Audio/Video Lab. Along with my lecturing, I was advisor of students in their BSc degree final projects. Conference Organization International Symposium on Musical Acoustics (ISMA), Paper Chair, 2017 International Conference on New Interfaces for Musical Expression (NIME), Demo Chair, 2015

4 Review Activities ACM Workshop on Music and Machine Learning (MML) Computer Music Journal European Signal Processing Conference (EUSIPCO) IEEE Journal on Selected Topics in Signal Processing IEEE Transactions on Affective Computing IEEE Transactions on Audio, Speech and Language Processing IEEE Transactions on Multimedia IEEE Transactions on Systems, Man and Cybernetics International Computer Music Conference (ICMC) International Conference on Digital Audio Effects (DAFx) International Conference on Sound and Music Computing (SMC) International Society for Music Information Retrieval Conference (ISMIR) International Symposium on Musical Acoustics (ISMA) International Symposium on New Interfaces for Musical Expression (NIME) Journal on Multimodal User Interfaces Journal of New Music Research Research Projects (selected) For each research project, it is indicated the source of funding, the total amount granted to the institution where I was working, and the institutions defining the locale of the work I carried out. For the large-scale, multi-partner projects, consortium members are omitted. PIANO-AAS AAS Systems Inc. + Canadian Federal Program (CAD 50K) McGill University (Canada) Lead researcher April 2017 present Developed the proposal. Acting as principal researcher. Design and execution of novel vibroacoustic measurements on grand pianos. Algorithms for acoustic characterization and efficient modeling by wave-based methods coupled to modal synthesis. Semi-privately funded project aimed at experimental analysis of the vibroacoustic properties of grand pianos, including bridge-string or string-string coupling, and soundboard radiation. Efficient synthesis by coupling digital waveguides and modal synthesis. Data-driven calibration of physical model parameters. MUSMAP EU public funding, Marie Curie Programme (USD 300K) McGill University (Canada) Manager, Lead researcher April 2014 March 2017 Developed the proposal. Currently overseeing the budget and leading the project. Research on computational modeling of music performance. Multi-modal (audio, motion capture, video) analysis and modeling of playing technique in bowed string performance. Autonomous sound synthesis via performer and instrument modeling. Motor control in music performance. Bowed strings and woodwind instrument physical modeling. PHENICX EU public funding, FP7 Programme (USD 450K) McGill University (Canada) Consultant February 2013 February 2016 Directed the team in charge of developing cutting-edge web technology for remote access and visualization of large datasets containing multi-modal recordings of music ensembles. Multi-partner, large-scale project aimed at using state-of-the-art digital multimedia and internet technologies to transform traditional concert experiences into multi-modal, multi-perspective and multi-layer social digital artefacts that can be easily explored, customized, personalized, (re)enjoyed and shared. The project focused on classical music in large ensemble settings. C4IDS Catalunya public funding, AGAUR (USD 70K) Stanford University (USA) McGill University (Canada) Manager, Lead researcher August 2011 June 2012 Developed the proposal. Oversaw the budget and led the project. Directed a team of up to six researchers/developers, including the supervision of funded PhD students.

5 Multi-modal (audio, motion capture, video) analysis and modeling of playing technique in bowed string performance. Analysis of musician-musician interdependence in ensemble performance (string quartets). Development of cutting-edge web technology for remote access and visualization of large datasets containing multi-modal recordings of music ensembles. SIEMPRE EU public funding, FP7 Programme (USD 400K) Stanford University (USA) Manager, Lead researcher June 2010 June 2013 Developed the proposal. Oversaw the budget and led the project at Universitat Pompeu Fabra. Directed a team of up to six researchers/developers, including the supervision of funded PhD theses. Multi-partner, large-scale project developing novel research theoretical and methodological frameworks, computational models, and algorithms for the analysis of social/creative communication within groups of people. Research focused on ensemble musical performance and audience experience. Special emphasis was given to string quartet performance analysis. SAME EU public funding, FP7 Programme (USD 350K) Manager, Lead researcher March 2008 Nopvember 2010 Oversaw the budget and led the project at Universitat Pompeu Fabra. Directed a team of up to three researchers/developers, including the supervision of funded MSc and BSc theses. Multi-partner, large-scale project exploring social, context-aware mobile music making and interaction. The project aimed at creating a new end-to-end networked platform for active, experience-centric, and context-aware active music listening. Developed sound analysis/synthesis algorithms for mobile phones, and investigated new social interaction paradigms for mobile music making VIOLIN-P Yamaha R+D private funding (via Yamaha-UPF strategic partnership) Research Engineer September 2006 September 2008 Conducted research on multi-modal (audio, motion capture) analysis and modeling of violin performance, including bowing motion description and audio analysis-synthesis via spectral models. Closely supervised by Yamaha, this industrial research project explored new, hybrid paradigms for sample-based sound synthesis via gesture-driven spectral-domain sound processing. VOCALOIDv2 Yamaha R+D private funding (via Yamaha-UPF strategic partnership) Research Assistant Engineer September 2005 June 2006 Conducted research on phoneme-aware characterization of instensity and fundamental frequency modulations in singing voice articulation. Closely supervised by Yamaha, this long-term industrial research project developed pioneering singing voice synthesis technologies based on spectral-domain processing of voice samples. PROSEMUS Spain public funding (USD 110K, cont. from PROMUSIC project) Research Assistant Engineer July 2005 June 2008 Conducted research on saxophone and violin performance description via audio analysis leading to automatic segmentation and characterization of dynamics and pitch profiles. Multi-partner, national project devoted to the application of audio analysis and machine learning techniques to expressive music performance modeling. PROMUSIC Spain public funding (USD 110K) Research Assistant Engineer March 2004 June 2005 Conducted research on saxophone performance description via audio analysis leading to automatic segmentation and characterization of dynamics and pitch profiles. Multi-partner, national project devoted to the application of audio analysis and machine learning techniques to expressive music performance modeling.

6 Publications Journal Maestre, E., Papiotis, P., Marchini, M., Llimona, Q., Mayor, O., Pérez, A., Wanderley, M. Enriched multimodal representations of music performances: online access and visualization IEEE Multimedia, Vol. 25, No. 1, pp 24-34, Maestre, E., Scavone, G.P., Smith, J.O. Joint modeling of bridge admittance and body radiativity for efficient synthesis of string instrument sound by digital waveguides IEEE Transacions on Audio, Speech, and Language Processing, Vol. 25, No. 5, pp , Maestre, E., Scavone, G.P., Smith, J.O. Design of recursive digital filters in parallel form by linearly constrained pole optimization IEEE Signal Processing Letters, Vol. 23, No. 11, pp , Maestre, E., Smith, J.O., Scavone, G.P., Efficient rendering of wind instrument sound by combining digital waveguides and modal synthesis, Acta Acustica united with Acustica (in preparation). Maestre, E., Spa, C., Llimona, Q., Scavone, G.P., Smith, J.O. Efficient simulation of bowed string sound: multi-hair, two-dimensional bow-string interaction including thermal friction and hair dynamics, Journal of the Acoustical Society of America (in preparation). Papiotis, P., Marchini, M., Pérez, A., Maestre, E. Measuring ensemble interdependence in a string quartet through analysis of multidimensional performance data, Frontiers in Psychology, Vol. 5, Marchini, M., Ramírez, R., Papiotis, P., Maestre, E. The sense of ensemble: a machine learning approach to expressive performance modeling in string quartets, Journal of New Music Research, Vol. 43, No. 3, pp , Ramírez, R., Maestre, E., Serra, X. A Rule-Based Evolutionary Approach to Music Performance Modeling, IEEE Transactions on Evolutionary Computation Vol. 16, no.1, pp , Pérez, A., Bonada, J., Maestre, E., Blaauw, M., Guaus, E. Performance Control driven Violin Timbre Model based on Neural Networks, IEEE Transactions on Audio, Speech, and Language Processing, Vol. 20, No. 3, pp , Ramírez, R., Maestre, E., Pérez, A., Serra, X. Automatic Performer Identification in celtic violin audio recordings, Journal of New Music Research, Vol. 40, no. 2, pp , Maestre, E., Ramírez, R. An approach to predicting bowing control parameter contours in violin performance, Intelligent Data Analysis, Vol. 15, No. 4, pp , Ramírez, R., Maestre, E., Serra, X. Automatic performer identication in commercial monophonic Jazz performances, Pattern Recognition Letters, Vol. 31, pp , Maestre, E., Blaauw, M., Bonada, J., Guaus, E., Pérez, A. Statistical modeling of bowing control applied to violin sound synthesis, IEEE Transactions on Audio, Speech, and Language Processing, Vol. 18, No. 4, pp , Maestre, E., Ramírez, R., Kersten, S., Serra, X. Expressive concatenative synthesis by reusing samples from real performance recordings, Computer Music Journal, Vol. 33, No. 4, pp , Ramírez, R., Hazan, A., Maestre, E., Serra, X. A genetic rule-based expressive performance model for Jazz saxophone, Computer Music Journal, Vol. 32, No. 1, pp , Ramírez, R., Maestre, E., Pertusa, A., Gómez, E., Serra, X. Performance-based interpreter identification in saxophone audio recordings, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 17, No. 3, pp , 2007 Ramírez, R., Hazan, A., Gómez, E., Maestre, E., Serra, X. Discovering expressive transformation rules from saxophone Jazz performances, Journal of New Music Research, Vol. 34, No. 4, pp , 2005 Chapter/Collection Papiotis, P., Marchini, M., Maestre, E., Pérez, A. Measuring Ensemble Synchrony through Violin Performance Parameters, Intelligent Technologies for Interactive Entertainment, Vol. 78. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering. A. Camurri and C. Costa (Eds.), Sringer, Ramírez, R., Maestre, E., Pérez, A. Modeling, Analyzing, Identifying, and Synthesizing Expressive Popular Music Performances, Guide to Computing for Expressive Music Performance. A. Kirke and E.R. Miranda (Eds.), Sringer-Verlag, London, Janer, J., Maestre, E. Mapping phonetic features for voice-driven sound synthesis, E-business and

7 Telecommunication. J. Filipe and M.S. Obaidat (Eds.), Sringer, Ramírez, R., Hazan, A., Maestre, E., Serra, X. A machine learning approach to expressive performance in jazz standards, Multimedia Data Mining and Knowledge Discovery. V. A. Petrushin and L. Khan (Eds.), Springer, Ramírez, R., Gómez, E., Vicente, V., Puiggròs, M., Hazan, A., Maestre, E. Modeling expressive music performance in bassoon audio recordings, Intelligent Computing in Signal Processing and Pattern Recognition. D. Huang, K. Li, and G. W. Irwin (Eds.), Springer, Conference Maestre, E., Abel, J.S., Smith, J.O., Scavone, G. P. Constrained pole optimization for modal reverberation International Conference on Digital Audio Effects, Maestre, E., Smith, J.O., Scavone, G. P. Analysis-synthesis of saxophone input impedances via recursive parallel filters International Symposium on Musical Acoustics, Rau, M. Maestre, E., Smith, J.O., Scavone, G. P. An exploration of guitar neck admittance measurements taken at different string stopping locations International Symposium on Musical Acoustics, Chafe, C., Maestre, E., Sarti, A., Canclini, A., Scavone, G. P., Smith, J.O., Antonacci, F. The return of the Messiah: modal analysis and bridge admittance modeling International Symposium on Musical Acoustics, Llimona, Q., Saitis, C., Maestre, E., Scavone, G. P. Exploring simulation-based playability metrics of 9 perceptually evaluated violins International Symposium on Musical Acoustics, Maestre, E., Scavone, G. P. Experimental modal analysis/synthesis of saxophone input impedances 5th Joint Meeting of the Acoustical Society of America and the Acoustical Society of Japan, Maestre, E., Scavone, G. P., Smith, J.O. Digital modeling of string instrument bridge reflectance and body radiativity for sound synthesis by digital waveguides IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, Maestre, E., Spa, C., Llimona, Q., Scavone, G. P., Smith, J.O. Playability of a bowed string physical model including finite-width thermal friction and hair dynamics 170th Meeting of the Acoustical Society of America, Llimona, Q., Mayor, O., Papiotis, P., Maestre, E. Repovizz: multimodal online database and visualization tool 1st Web Audio Conference, 2015 Maestre, E., Spa, C., Smith, J.O. A bowed string phyiscal model including finite-width thermal friction and hair dynamics International Computer Music Conference, Maestre, E., Spa, C., Smith, J.O. Bowed string simulation combining digital waveguide and finitedifference time-domain frameworks 166th Meeting of the Acoustical Society of America, Mayor, O., Llimona, Q., Marchini, M., Papiotis, P., Maestre, E. repovizz: a framework for remote storage, browsing, annotation, and exchange of multi-modal data ACM Multimedia, Maestre, E., Scavone, G.P., Smith, J.O. Digital modeling of bridge driving-point admittances from measurements on violin-family instruments Sotckholm Music Acoustics Conference, Maestre, E. Analysis/synthesis of bowing control applied to violin sound rendering via physical models International Congress on Acoustics / Proceedings of Meetings of Acoustics, Papiotis, P., Marchini, M., Maestre, E. Multidimensional analysis of interdependence in a string quartet I.S. Performance Science, 2013 Marchini, M., Papiotis, P., Maestre, E. Investigating the relationship between expressivity and synchronization in ensemble performance: an exploratory study I.S. Performance Science, 2013 Papiotis, P., Marchini, M., Herrera, P. Maestre, E. Aural-based detection and assessment of real versus artificially synchronized string quartet performance, International Conference on Music and Emotion, Marchini, M., Ramírez, R., Papiotis, P., Maestre, E. Inducing Rules of Ensemble Music Performance: a Machine Learning Approach International Conference on Music and Emotion, Papiotis, P., Marchini, M., Maestre, E. Computational Analysis of Solo versus Ensemble Performance in String Quartets: Intonation and Dynamics, International Conference on Music Perception and Cognition, 2012.

8 Marchini, M., Papiotis, P., Maestre, E. Timing Synchronization in String Quartet Performance: a Preliminary study, International Symposium on Computer Music Modeling and Retrieval, Maestre, E., Scavone, G. P., Smith III, J. O. Modeling of a violin input admittance by direct positioning of second-order resonators, 162nd Meeting of the Acoustical Society of America, Maestre, E. Synthesis of bowing controls applied to violin sound generation, 162nd Meeting of the Acoustical Society of America, Mayor, O., Llop, J., Maestre, E. RepoVizz: A multi-modal on-line database and browsing tool for music performance research, International Symposium on Music Information Retrieval, Vinceslas, L., García, F., Pérez, A., Maestre, E. Mapping blowing pressure and sound features in recorder playing, International Conference on Digital Audio Effects, Papiotis, P., Marchini M., Pérez, A., Maestre, E., Andrzejak, R. Synchronization of intonation adjustments in violin duets: towards an objective evaluation of musical interaction, International Conference on Digital Audio Effects, Marchini, M., Papiotis P., Pérez, A., Maestre, E. A Hair Ribbon Deflection Model for Low- Intrusiveness Measurement of Bow Force in Violin Performance, International Symposium on New Interfaces for Musical Expression, García, F., Vinceslas L., Maestre, E., Tubau, J. Acquisition and study of blowing pressure profiles in recorder playing, International Symposium on New Interfaces for Musical Expression, Papiotis, P., Marchini, M., Maestre, E., Pérez, A. Measuring ensemble synchrony through violin performance parameters: a preliminary progress report, Workshop on Social Behavior in Music, Coleman, G., Bonada J., Maestre, E. Adding Dynamic Smoothing to Mixture Mosaicing Synthesis, Spars11: Workshop on Signal Processing with Adaptive Sparse Structure Representations, Villavicencio, F., Maestre E. GMM-PCA based speaker-timbre conversion on full-quality speech, Interspeech Speech Synthesis Workshop, Coleman, G., Maestre, E., Bonada, J. Augmenting sound mosacing with descriptor-driven transformation, International Conference on Digital Audio Effects, Ramírez, R., Neocleous, A., Pérez, A., Maestre, E. Modeling emotions in violin audio recordings, ACM Workshop on Music and Machine Learning, Maestre, E., Pérez, A., Ramírez, R. Gesture sampling for instrumental sound synthesis: violin bowing as a case study, International Computer Music Conference, Ramírez, R., Maestre, E. A framework for performer identification in audio recordings, International Workshop on Machine Learning and Music, Guaus, E., Bonada, J., Maestre, E., Pérez, A., Blaauw, M. Calibration method to accurately measure bow force in real violin performances, International Computer Music Conference, Camurri, A., Bevilacqua, F., Bresin, R., Maestre, E., Penttinen, H., Seppänen, J., Välimäki, V., Volpe, G., Warusfel, O. Embodied music listening and making in context-aware mobile applications: the EU-ICT SAME Project, Gesture Workshop, Maestre, E. Statistical modeling of violin bowing parameter contours, International Computer Music Conference, Camurri, A., Volpe, G., Vinet, H., Bresin, R., Maestre, E., Llop, J., Kleimola, J., Oksanen, S., Välimäki, V., Seppänen, J. User-centric context-aware mobile applications for embodied music listening, International ICST Conference on User Centric Media, Kersten, S., Maestre, E., Ramírez, R. Concatenative synthesis of expressive saxophone performance, Sound and Music Computing Conference, Pérez, A., Maestre, E., Ramírez, R., Kersten, S. Expressive irish fiddle performance model informed with bowing, International Computer Music Conference, Pérez, A., Bonada, J., Maestre, E., Guaus, E., Blaauw, M. Measuring violin sound radiation for sound equalization, Acoustics 08 Paris, Ramírez, R., Pérez, A., Maestre, E., Kersten, E., Rizo, D., Román, P., Iñesta, J.M. Modeling celtic violin expressive performance, International Conference on Machine Learning, Ramírez, R., Pérez, A., Kersten, S., Maestre, E. Performer identification in celtic violin recordings, International Society for Music Information Retrieval Conference, 2008.

9 Pérez, A., Bonada, J., Maestre, E., Guaus, E., Blaauw, M. Score Level Timbre Transformations of Violin Sounds, International Conference on Digital Audio Effects, Maestre, E., Bonada, J., Blaauw, M., Pérez, A., Guaus, E. Acquisition of violin instrumental gestures using a commercial EMF device, International Computer Music Conference, Jensenius, A., Castagné, N., Camurri, A., Maestre, E., Malloch, J., McGilvray, D. A summary of formats for streaming and storing music-related movement and gesture data, International Conference on Enactive Interfaces, Pérez, A., Bonada, J., Maestre, E., Guaus, E., Blaauw, M. Combining performance actions with spectral models for violin sound transformation, International Congress on Acoustics, Ramírez, R., Maestre, E., Pertusa, A. Identifying saxophonists from their playing styles, AES 30th Conference, Guaus, E., Bonada, J., Pérez, A., Maestre, E., Blaauw, M. Measuring the bow pressing force in a real violin performance, International Symposium on Musical Acoustics, Pérez, A., Maestre, E., Ramírez, R. Modeling Expressive Performance in Classical Violin, Digital Music Research Network Workshop, Kersten, S., Maestre, E., Ramírez, R. Modeling and Synthesis of Expressive Performance, Digital Music Research Network Workshop, Janer, J., Maestre, E. Phonetic-based mappings in voice-driven sound synthesis, International Conference on Signal Processing and Multimedia Applications, Jensenius, A., Camurri, A., Castagné, N., Maestre, E., Malloch, J., McGilvray, D., Schwarz, D., Wright, M. The need of formats for streaming and storing music-related movement and gesture data, International Computer Music Conference, Ramírez, R., Hazan, A., Maestre, E. A sequential covering evolutionary algorithm for expressive music performance, Conference on Innovative Applications of Artificial Intelligence, Hazan, A., Ramírez, R., Maestre, E., Pérez, A., Pertusa, A. Modeling expressive performance: a regression tree approach based on strongly typed genetic programming, European Workshop on Evolutionary Music and Art, Maestre, E., Bonada, J., Mayor, O. Modeling musical articulation gestures in singing voice performances, AES 121th Convention, Maestre, E., Hazan, A., Ramírez, R., Pérez, A. Using concatenative synthesis for expressive performance in jazz saxophone, International Computer Music Conference, Maestre, E., Gómez, E. Automatic characterization of dynamics and articulation of expressive monophonic recordings, AES 118th Convention, Ramírez, R., Hazan, A., Maestre, E. Intra-note features prediction model for jazz saxophone performance, International Computer Music Conference, Ramírez, R., Hazan, A., Gómez, E., Maestre, E. A machine learning approach to expressive performance in jazz standards, ACM International Conference on Knowledge Discovery and Data Mining, Ramírez, R., Hazan, A., Gómez, E., Maestre, E. Understanding expressive transformations in saxophone jazz performances using inductive machine learning, International Conference in Sound and Music Computing, References (academic) Prof. Julius Smith Prof. Xavier Serra Prof. Gary Scavone Stanford University Universitat Pompeu Fabra McGill University Stanford, USA Barcelona, Spain Montréal, Canada Prof. Chris Chafe Prof. Marcelo Wanderley Prof. Anders Askenfelt Stanford University McGill University KTH Stanford, USA Montréal, Canada Stockholm, Sweden References (industry) Dr. Jonathan Abel Dr. Vincent Freour Dr. Òscar Celma Co-founder and Chief Scientist Senior Research Engineer Head of Research Universal Audio Yamaha Corporate R+D Pandora Santa Cruz, USA Hammamatsu, Japan Oakland, USA

Multidimensional analysis of interdependence in a string quartet

Multidimensional analysis of interdependence in a string quartet International Symposium on Performance Science The Author 2013 ISBN tbc All rights reserved Multidimensional analysis of interdependence in a string quartet Panos Papiotis 1, Marco Marchini 1, and Esteban

More information

A System for Acoustic Chord Transcription and Key Extraction from Audio Using Hidden Markov models Trained on Synthesized Audio

A System for Acoustic Chord Transcription and Key Extraction from Audio Using Hidden Markov models Trained on Synthesized Audio Curriculum Vitae Kyogu Lee Advanced Technology Center, Gracenote Inc. 2000 Powell Street, Suite 1380 Emeryville, CA 94608 USA Tel) 1-510-428-7296 Fax) 1-510-547-9681 klee@gracenote.com kglee@ccrma.stanford.edu

More information

Paulo V. K. Borges. Flat 1, 50A, Cephas Av. London, UK, E1 4AR (+44) PRESENTATION

Paulo V. K. Borges. Flat 1, 50A, Cephas Av. London, UK, E1 4AR (+44) PRESENTATION Paulo V. K. Borges Flat 1, 50A, Cephas Av. London, UK, E1 4AR (+44) 07942084331 vini@ieee.org PRESENTATION Electronic engineer working as researcher at University of London. Doctorate in digital image/video

More information

OBSERVED DIFFERENCES IN RHYTHM BETWEEN PERFORMANCES OF CLASSICAL AND JAZZ VIOLIN STUDENTS

OBSERVED DIFFERENCES IN RHYTHM BETWEEN PERFORMANCES OF CLASSICAL AND JAZZ VIOLIN STUDENTS OBSERVED DIFFERENCES IN RHYTHM BETWEEN PERFORMANCES OF CLASSICAL AND JAZZ VIOLIN STUDENTS Enric Guaus, Oriol Saña Escola Superior de Música de Catalunya {enric.guaus,oriol.sana}@esmuc.cat Quim Llimona

More information

Automatic characterization of ornamentation from bassoon recordings for expressive synthesis

Automatic characterization of ornamentation from bassoon recordings for expressive synthesis Automatic characterization of ornamentation from bassoon recordings for expressive synthesis Montserrat Puiggròs, Emilia Gómez, Rafael Ramírez, Xavier Serra Music technology Group Universitat Pompeu Fabra

More information

Guide to Computing for Expressive Music Performance

Guide to Computing for Expressive Music Performance Guide to Computing for Expressive Music Performance Alexis Kirke Eduardo R. Miranda Editors Guide to Computing for Expressive Music Performance Editors Alexis Kirke Interdisciplinary Centre for Computer

More information

A prototype system for rule-based expressive modifications of audio recordings

A prototype system for rule-based expressive modifications of audio recordings International Symposium on Performance Science ISBN 0-00-000000-0 / 000-0-00-000000-0 The Author 2007, Published by the AEC All rights reserved A prototype system for rule-based expressive modifications

More information

PROBABILISTIC MODELING OF BOWING GESTURES FOR GESTURE-BASED VIOLIN SOUND SYNTHESIS

PROBABILISTIC MODELING OF BOWING GESTURES FOR GESTURE-BASED VIOLIN SOUND SYNTHESIS PROBABILISTIC MODELING OF BOWING GESTURES FOR GESTURE-BASED VIOLIN SOUND SYNTHESIS Akshaya Thippur 1 Anders Askenfelt 2 Hedvig Kjellström 1 1 Computer Vision and Active Perception Lab, KTH, Stockholm,

More information

GARY PAUL SCAVONE EDUCATION:

GARY PAUL SCAVONE EDUCATION: Music Technology Area Schulich School of Music of McGill University Montreal, Quebec H3A 1E3 Canada 514-398-4535, x-089834 http://www.music.mcgill.ca/~gary/ GARY PAUL SCAVONE EDUCATION: 1992 1997 Stanford

More information

19 th INTERNATIONAL CONGRESS ON ACOUSTICS MADRID, 2-7 SEPTEMBER 2007

19 th INTERNATIONAL CONGRESS ON ACOUSTICS MADRID, 2-7 SEPTEMBER 2007 19 th INTERNATIONAL CONGRESS ON ACOUSTICS MADRID, 2-7 SEPTEMBER 2007 AN HMM BASED INVESTIGATION OF DIFFERENCES BETWEEN MUSICAL INSTRUMENTS OF THE SAME TYPE PACS: 43.75.-z Eichner, Matthias; Wolff, Matthias;

More information

ESP: Expression Synthesis Project

ESP: Expression Synthesis Project ESP: Expression Synthesis Project 1. Research Team Project Leader: Other Faculty: Graduate Students: Undergraduate Students: Prof. Elaine Chew, Industrial and Systems Engineering Prof. Alexandre R.J. François,

More information

BRAIN-ACTIVITY-DRIVEN REAL-TIME MUSIC EMOTIVE CONTROL

BRAIN-ACTIVITY-DRIVEN REAL-TIME MUSIC EMOTIVE CONTROL BRAIN-ACTIVITY-DRIVEN REAL-TIME MUSIC EMOTIVE CONTROL Sergio Giraldo, Rafael Ramirez Music Technology Group Universitat Pompeu Fabra, Barcelona, Spain sergio.giraldo@upf.edu Abstract Active music listening

More information

MODELING OF GESTURE-SOUND RELATIONSHIP IN RECORDER

MODELING OF GESTURE-SOUND RELATIONSHIP IN RECORDER MODELING OF GESTURE-SOUND RELATIONSHIP IN RECORDER PLAYING: A STUDY OF BLOWING PRESSURE LENY VINCESLAS MASTER THESIS UPF / 2010 Master in Sound and Music Computing Master thesis supervisor: Esteban Maestre

More information

Luwei Yang. Mobile: (+86) luweiyang.com

Luwei Yang. Mobile: (+86) luweiyang.com Luwei Yang Mobile: (+86) 17502530917 luwei.yang.qm@gmail.com luweiyang.com Personal Statement A machine learning researcher obtained PhD degree from Queen Mary University of London. Looking to secure the

More information

TOWARD AN INTELLIGENT EDITOR FOR JAZZ MUSIC

TOWARD AN INTELLIGENT EDITOR FOR JAZZ MUSIC TOWARD AN INTELLIGENT EDITOR FOR JAZZ MUSIC G.TZANETAKIS, N.HU, AND R.B. DANNENBERG Computer Science Department, Carnegie Mellon University 5000 Forbes Avenue, Pittsburgh, PA 15213, USA E-mail: gtzan@cs.cmu.edu

More information

SYNTHESIS FROM MUSICAL INSTRUMENT CHARACTER MAPS

SYNTHESIS FROM MUSICAL INSTRUMENT CHARACTER MAPS Published by Institute of Electrical Engineers (IEE). 1998 IEE, Paul Masri, Nishan Canagarajah Colloquium on "Audio and Music Technology"; November 1998, London. Digest No. 98/470 SYNTHESIS FROM MUSICAL

More information

CURRICULUM VITAE John Usher

CURRICULUM VITAE John Usher CURRICULUM VITAE John Usher John_Usher-AT-me.com Education: Ph.D. Audio upmixing signal processing and sound quality evaluation. 2006. McGill University, Montreal, Canada. Dean s Honours List Recommendation.

More information

3/2/11. CompMusic: Computational models for the discovery of the world s music. Music information modeling. Music Computing challenges

3/2/11. CompMusic: Computational models for the discovery of the world s music. Music information modeling. Music Computing challenges CompMusic: Computational for the discovery of the world s music Xavier Serra Music Technology Group Universitat Pompeu Fabra, Barcelona (Spain) ERC mission: support investigator-driven frontier research.

More information

11/1/11. CompMusic: Computational models for the discovery of the world s music. Current IT problems. Taxonomy of musical information

11/1/11. CompMusic: Computational models for the discovery of the world s music. Current IT problems. Taxonomy of musical information CompMusic: Computational models for the discovery of the world s music Xavier Serra Music Technology Group Universitat Pompeu Fabra, Barcelona (Spain) ERC mission: support investigator-driven frontier

More information

Introductions to Music Information Retrieval

Introductions to Music Information Retrieval Introductions to Music Information Retrieval ECE 272/472 Audio Signal Processing Bochen Li University of Rochester Wish List For music learners/performers While I play the piano, turn the page for me Tell

More information

About Giovanni De Poli. What is Model. Introduction. di Poli: Methodologies for Expressive Modeling of/for Music Performance

About Giovanni De Poli. What is Model. Introduction. di Poli: Methodologies for Expressive Modeling of/for Music Performance Methodologies for Expressiveness Modeling of and for Music Performance by Giovanni De Poli Center of Computational Sonology, Department of Information Engineering, University of Padova, Padova, Italy About

More information

Subjective Similarity of Music: Data Collection for Individuality Analysis

Subjective Similarity of Music: Data Collection for Individuality Analysis Subjective Similarity of Music: Data Collection for Individuality Analysis Shota Kawabuchi and Chiyomi Miyajima and Norihide Kitaoka and Kazuya Takeda Nagoya University, Nagoya, Japan E-mail: shota.kawabuchi@g.sp.m.is.nagoya-u.ac.jp

More information

ANDY M. SARROFF CURRICULUM VITAE

ANDY M. SARROFF CURRICULUM VITAE ANDY M. SARROFF CURRICULUM VITAE CONTACT ADDRESS 6242 Hallgarten Hall Dartmouth College Hanover, NH 03755 TELEPHONE EMAIL sarroff@cs.dartmouth.edu URL +1 (718) 930-8705 http://www.cs.dartmouth.edu/~sarroff

More information

Expressive Singing Synthesis based on Unit Selection for the Singing Synthesis Challenge 2016

Expressive Singing Synthesis based on Unit Selection for the Singing Synthesis Challenge 2016 Expressive Singing Synthesis based on Unit Selection for the Singing Synthesis Challenge 2016 Jordi Bonada, Martí Umbert, Merlijn Blaauw Music Technology Group, Universitat Pompeu Fabra, Spain jordi.bonada@upf.edu,

More information

Toward a Computationally-Enhanced Acoustic Grand Piano

Toward a Computationally-Enhanced Acoustic Grand Piano Toward a Computationally-Enhanced Acoustic Grand Piano Andrew McPherson Electrical & Computer Engineering Drexel University 3141 Chestnut St. Philadelphia, PA 19104 USA apm@drexel.edu Youngmoo Kim Electrical

More information

TOWARDS IMPROVING ONSET DETECTION ACCURACY IN NON- PERCUSSIVE SOUNDS USING MULTIMODAL FUSION

TOWARDS IMPROVING ONSET DETECTION ACCURACY IN NON- PERCUSSIVE SOUNDS USING MULTIMODAL FUSION TOWARDS IMPROVING ONSET DETECTION ACCURACY IN NON- PERCUSSIVE SOUNDS USING MULTIMODAL FUSION Jordan Hochenbaum 1,2 New Zealand School of Music 1 PO Box 2332 Wellington 6140, New Zealand hochenjord@myvuw.ac.nz

More information

The Trumpet Shall Sound: De-anonymizing jazz recordings

The Trumpet Shall Sound: De-anonymizing jazz recordings http://dx.doi.org/10.14236/ewic/eva2016.55 The Trumpet Shall Sound: De-anonymizing jazz recordings Janet Lazar Rutgers University New Brunswick, NJ, USA janetlazar@icloud.com Michael Lesk Rutgers University

More information

Proceedings of Meetings on Acoustics

Proceedings of Meetings on Acoustics Proceedings of Meetings on Acoustics Volume 19, 2013 http://acousticalsociety.org/ ICA 2013 Montreal Montreal, Canada 2-7 June 2013 Musical Acoustics Session 3pMU: Perception and Orchestration Practice

More information

An ecological approach to multimodal subjective music similarity perception

An ecological approach to multimodal subjective music similarity perception An ecological approach to multimodal subjective music similarity perception Stephan Baumann German Research Center for AI, Germany www.dfki.uni-kl.de/~baumann John Halloran Interact Lab, Department of

More information

Physical Modelling of Musical Instruments Using Digital Waveguides: History, Theory, Practice

Physical Modelling of Musical Instruments Using Digital Waveguides: History, Theory, Practice Physical Modelling of Musical Instruments Using Digital Waveguides: History, Theory, Practice Introduction Why Physical Modelling? History of Waveguide Physical Models Mathematics of Waveguide Physical

More information

The song remains the same: identifying versions of the same piece using tonal descriptors

The song remains the same: identifying versions of the same piece using tonal descriptors The song remains the same: identifying versions of the same piece using tonal descriptors Emilia Gómez Music Technology Group, Universitat Pompeu Fabra Ocata, 83, Barcelona emilia.gomez@iua.upf.edu Abstract

More information

ESTIMATING THE ERROR DISTRIBUTION OF A TAP SEQUENCE WITHOUT GROUND TRUTH 1

ESTIMATING THE ERROR DISTRIBUTION OF A TAP SEQUENCE WITHOUT GROUND TRUTH 1 ESTIMATING THE ERROR DISTRIBUTION OF A TAP SEQUENCE WITHOUT GROUND TRUTH 1 Roger B. Dannenberg Carnegie Mellon University School of Computer Science Larry Wasserman Carnegie Mellon University Department

More information

SONG HUI CHON. EDUCATION McGill University Montreal, QC, Canada Doctor of Philosophy in Music Technology (Advisor: Dr.

SONG HUI CHON. EDUCATION McGill University Montreal, QC, Canada Doctor of Philosophy in Music Technology (Advisor: Dr. SONG HUI CHON Electrical, Computer, and Telecommunications Engineering Technology, College of Applied Science and Technology, Rochester Institute of Technology, Rochester, NY 14623, United States EDUCATION

More information

Computational Modelling of Harmony

Computational Modelling of Harmony Computational Modelling of Harmony Simon Dixon Centre for Digital Music, Queen Mary University of London, Mile End Rd, London E1 4NS, UK simon.dixon@elec.qmul.ac.uk http://www.elec.qmul.ac.uk/people/simond

More information

Topics in Computer Music Instrument Identification. Ioanna Karydi

Topics in Computer Music Instrument Identification. Ioanna Karydi Topics in Computer Music Instrument Identification Ioanna Karydi Presentation overview What is instrument identification? Sound attributes & Timbre Human performance The ideal algorithm Selected approaches

More information

Vocal-tract Influence in Trombone Performance

Vocal-tract Influence in Trombone Performance Proceedings of the International Symposium on Music Acoustics (Associated Meeting of the International Congress on Acoustics) 25-31 August 2, Sydney and Katoomba, Australia Vocal-tract Influence in Trombone

More information

Music Composition with Interactive Evolutionary Computation

Music Composition with Interactive Evolutionary Computation Music Composition with Interactive Evolutionary Computation Nao Tokui. Department of Information and Communication Engineering, Graduate School of Engineering, The University of Tokyo, Tokyo, Japan. e-mail:

More information

A FUNCTIONAL CLASSIFICATION OF ONE INSTRUMENT S TIMBRES

A FUNCTIONAL CLASSIFICATION OF ONE INSTRUMENT S TIMBRES A FUNCTIONAL CLASSIFICATION OF ONE INSTRUMENT S TIMBRES Panayiotis Kokoras School of Music Studies Aristotle University of Thessaloniki email@panayiotiskokoras.com Abstract. This article proposes a theoretical

More information

Joint bottom-up/top-down machine learning structures to simulate human audition and musical creativity

Joint bottom-up/top-down machine learning structures to simulate human audition and musical creativity Joint bottom-up/top-down machine learning structures to simulate human audition and musical creativity Jonas Braasch Director of Operations, Professor, School of Architecture Rensselaer Polytechnic Institute,

More information

Vocal Pedagogy and Performance

Vocal Pedagogy and Performance Vocal Pedagogy and Performance 1 Vocal Pedagogy and Performance Degree Offered: Doctor of Musical Arts in Vocal Pedagogy and Performance At this time, the School of Music is not offering the Doctor of

More information

Deep learning for music data processing

Deep learning for music data processing Deep learning for music data processing A personal (re)view of the state-of-the-art Jordi Pons www.jordipons.me Music Technology Group, DTIC, Universitat Pompeu Fabra, Barcelona. 31st January 2017 Jordi

More information

Measurement of Motion and Emotion during Musical Performance

Measurement of Motion and Emotion during Musical Performance Measurement of Motion and Emotion during Musical Performance R. Benjamin Knapp, PhD b.knapp@qub.ac.uk Javier Jaimovich jjaimovich01@qub.ac.uk Niall Coghlan ncoghlan02@qub.ac.uk Abstract This paper describes

More information

EE391 Special Report (Spring 2005) Automatic Chord Recognition Using A Summary Autocorrelation Function

EE391 Special Report (Spring 2005) Automatic Chord Recognition Using A Summary Autocorrelation Function EE391 Special Report (Spring 25) Automatic Chord Recognition Using A Summary Autocorrelation Function Advisor: Professor Julius Smith Kyogu Lee Center for Computer Research in Music and Acoustics (CCRMA)

More information

Learning Singer-Specific Performance Rules

Learning Singer-Specific Performance Rules Learning Singer-Specific Performance Rules Maria Cristina Marinescu and Rafael Ramirez Abstract This work investigates how opera singers manipulate timing in order to produce expressive performances that

More information

A PERPLEXITY BASED COVER SONG MATCHING SYSTEM FOR SHORT LENGTH QUERIES

A PERPLEXITY BASED COVER SONG MATCHING SYSTEM FOR SHORT LENGTH QUERIES 12th International Society for Music Information Retrieval Conference (ISMIR 2011) A PERPLEXITY BASED COVER SONG MATCHING SYSTEM FOR SHORT LENGTH QUERIES Erdem Unal 1 Elaine Chew 2 Panayiotis Georgiou

More information

Instrument Recognition in Polyphonic Mixtures Using Spectral Envelopes

Instrument Recognition in Polyphonic Mixtures Using Spectral Envelopes Instrument Recognition in Polyphonic Mixtures Using Spectral Envelopes hello Jay Biernat Third author University of Rochester University of Rochester Affiliation3 words jbiernat@ur.rochester.edu author3@ismir.edu

More information

Automatic Laughter Detection

Automatic Laughter Detection Automatic Laughter Detection Mary Knox Final Project (EECS 94) knoxm@eecs.berkeley.edu December 1, 006 1 Introduction Laughter is a powerful cue in communication. It communicates to listeners the emotional

More information

Speech and Speaker Recognition for the Command of an Industrial Robot

Speech and Speaker Recognition for the Command of an Industrial Robot Speech and Speaker Recognition for the Command of an Industrial Robot CLAUDIA MOISA*, HELGA SILAGHI*, ANDREI SILAGHI** *Dept. of Electric Drives and Automation University of Oradea University Street, nr.

More information

TOWARDS EXPRESSIVE INSTRUMENT SYNTHESIS THROUGH SMOOTH FRAME-BY-FRAME RECONSTRUCTION: FROM STRING TO WOODWIND

TOWARDS EXPRESSIVE INSTRUMENT SYNTHESIS THROUGH SMOOTH FRAME-BY-FRAME RECONSTRUCTION: FROM STRING TO WOODWIND TOWARDS EXPRESSIVE INSTRUMENT SYNTHESIS THROUGH SMOOTH FRAME-BY-FRAME RECONSTRUCTION: FROM STRING TO WOODWIND Sanna Wager, Liang Chen, Minje Kim, and Christopher Raphael Indiana University School of Informatics

More information

Piya Pal. California Institute of Technology, Pasadena, CA GPA: 4.2/4.0 Advisor: Prof. P. P. Vaidyanathan

Piya Pal. California Institute of Technology, Pasadena, CA GPA: 4.2/4.0 Advisor: Prof. P. P. Vaidyanathan Piya Pal 1200 E. California Blvd MC 136-93 Pasadena, CA 91125 Tel: 626-379-0118 E-mail: piyapal@caltech.edu http://www.systems.caltech.edu/~piyapal/ Education Ph.D. in Electrical Engineering Sep. 2007

More information

2 2. Melody description The MPEG-7 standard distinguishes three types of attributes related to melody: the fundamental frequency LLD associated to a t

2 2. Melody description The MPEG-7 standard distinguishes three types of attributes related to melody: the fundamental frequency LLD associated to a t MPEG-7 FOR CONTENT-BASED MUSIC PROCESSING Λ Emilia GÓMEZ, Fabien GOUYON, Perfecto HERRERA and Xavier AMATRIAIN Music Technology Group, Universitat Pompeu Fabra, Barcelona, SPAIN http://www.iua.upf.es/mtg

More information

DESIGN OF ANALOG FUZZY LOGIC CONTROLLERS IN CMOS TECHNOLOGIES

DESIGN OF ANALOG FUZZY LOGIC CONTROLLERS IN CMOS TECHNOLOGIES DESIGN OF ANALOG FUZZY LOGIC CONTROLLERS IN CMOS TECHNOLOGIES Design of Analog Fuzzy Logic Controllers in CMOS Technologies Implementation, Test and Application by Carlos Dualibe Universidad Católica de

More information

Chapter 60 Development of the Remote Instrumentation Systems Based on Embedded Web to Support Remote Laboratory

Chapter 60 Development of the Remote Instrumentation Systems Based on Embedded Web to Support Remote Laboratory Chapter 60 Development of the Remote Instrumentation Systems Based on Embedded Web to Support Remote Laboratory F. Yudi Limpraptono and Irmalia Suryani Faradisa Abstract Web-based remote instrumentation

More information

MUSIC (MUSI) 100 Level Courses. Music (MUSI) 1

MUSIC (MUSI) 100 Level Courses. Music (MUSI) 1 Music (MUSI) 1 MUSIC (MUSI) 100 Level Courses MUSI 100: Fundamentals of Music. 3 credits. Study of musical notation, interval and triad construction, reading of treble and bass clefs, scale construction,

More information

SIEMPRE. D3.3 SIEMPRE and SIEMPRE-INCO extension Final version of techniques for data acquisition and multimodal analysis of emap signals

SIEMPRE. D3.3 SIEMPRE and SIEMPRE-INCO extension Final version of techniques for data acquisition and multimodal analysis of emap signals D3.3 SIEMPRE AND SIEMPRE-INCO EXTENSION FINAL VERSION OF TECHNIQUES FOR DATA ACQUISITION AND MULTIMODAL ANALYSIS OF EMAP SIGNALS DISSEMINATION LEVEL: PUBLIC Social Interaction and Entrainment using Music

More information

Scalability of MB-level Parallelism for H.264 Decoding

Scalability of MB-level Parallelism for H.264 Decoding Scalability of Macroblock-level Parallelism for H.264 Decoding Mauricio Alvarez Mesa 1, Alex Ramírez 1,2, Mateo Valero 1,2, Arnaldo Azevedo 3, Cor Meenderinck 3, Ben Juurlink 3 1 Universitat Politècnica

More information

TongArk: a Human-Machine Ensemble

TongArk: a Human-Machine Ensemble TongArk: a Human-Machine Ensemble Prof. Alexey Krasnoskulov, PhD. Department of Sound Engineering and Information Technologies, Piano Department Rostov State Rakhmaninov Conservatoire, Russia e-mail: avk@soundworlds.net

More information

QUALITY OF COMPUTER MUSIC USING MIDI LANGUAGE FOR DIGITAL MUSIC ARRANGEMENT

QUALITY OF COMPUTER MUSIC USING MIDI LANGUAGE FOR DIGITAL MUSIC ARRANGEMENT QUALITY OF COMPUTER MUSIC USING MIDI LANGUAGE FOR DIGITAL MUSIC ARRANGEMENT Pandan Pareanom Purwacandra 1, Ferry Wahyu Wibowo 2 Informatics Engineering, STMIK AMIKOM Yogyakarta 1 pandanharmony@gmail.com,

More information

Melody Retrieval On The Web

Melody Retrieval On The Web Melody Retrieval On The Web Thesis proposal for the degree of Master of Science at the Massachusetts Institute of Technology M.I.T Media Laboratory Fall 2000 Thesis supervisor: Barry Vercoe Professor,

More information

Music Understanding and the Future of Music

Music Understanding and the Future of Music Music Understanding and the Future of Music Roger B. Dannenberg Professor of Computer Science, Art, and Music Carnegie Mellon University Why Computers and Music? Music in every human society! Computers

More information

MUSIC (MU) Music (MU) 1

MUSIC (MU) Music (MU) 1 Music (MU) 1 MUSIC (MU) MU 1130 Beginning Piano I (1 Credit) For students with little or no previous study. Basic knowledge and skills necessary for keyboard performance. Development of physical and mental

More information

Digital audio and computer music. COS 116, Spring 2012 Guest lecture: Rebecca Fiebrink

Digital audio and computer music. COS 116, Spring 2012 Guest lecture: Rebecca Fiebrink Digital audio and computer music COS 116, Spring 2012 Guest lecture: Rebecca Fiebrink Overview 1. Physics & perception of sound & music 2. Representations of music 3. Analyzing music with computers 4.

More information

A CHROMA-BASED SALIENCE FUNCTION FOR MELODY AND BASS LINE ESTIMATION FROM MUSIC AUDIO SIGNALS

A CHROMA-BASED SALIENCE FUNCTION FOR MELODY AND BASS LINE ESTIMATION FROM MUSIC AUDIO SIGNALS A CHROMA-BASED SALIENCE FUNCTION FOR MELODY AND BASS LINE ESTIMATION FROM MUSIC AUDIO SIGNALS Justin Salamon Music Technology Group Universitat Pompeu Fabra, Barcelona, Spain justin.salamon@upf.edu Emilia

More information

PLOrk Beat Science 2.0 NIME 2009 club submission by Ge Wang and Rebecca Fiebrink

PLOrk Beat Science 2.0 NIME 2009 club submission by Ge Wang and Rebecca Fiebrink PLOrk Beat Science 2.0 NIME 2009 club submission by Ge Wang and Rebecca Fiebrink Introduction This document details our proposed NIME 2009 club performance of PLOrk Beat Science 2.0, our multi-laptop,

More information

Florida Atlantic University Dorothy F. Schmidt College of Arts and Letters Department of Music Promotion and Tenure Guidelines (2017)

Florida Atlantic University Dorothy F. Schmidt College of Arts and Letters Department of Music Promotion and Tenure Guidelines (2017) Florida Atlantic University Dorothy F. Schmidt College of Arts and Letters Department of Music Promotion and Tenure Guidelines (2017) Mission Statement The mission of the Florida Atlantic University Department

More information

IJMIE Volume 2, Issue 3 ISSN:

IJMIE Volume 2, Issue 3 ISSN: Development of Virtual Experiment on Flip Flops Using virtual intelligent SoftLab Bhaskar Y. Kathane* Pradeep B. Dahikar** Abstract: The scope of this paper includes study and implementation of Flip-flops.

More information

Digital Signal Processing

Digital Signal Processing COMP ENG 4TL4: Digital Signal Processing Notes for Lecture #1 Friday, September 5, 2003 Dr. Ian C. Bruce Room CRL-229, Ext. 26984 ibruce@mail.ece.mcmaster.ca Office Hours: TBA Instructor: Teaching Assistants:

More information

Proposal for Application of Speech Techniques to Music Analysis

Proposal for Application of Speech Techniques to Music Analysis Proposal for Application of Speech Techniques to Music Analysis 1. Research on Speech and Music Lin Zhong Dept. of Electronic Engineering Tsinghua University 1. Goal Speech research from the very beginning

More information

15th International Conference on New Interfaces for Musical Expression (NIME)

15th International Conference on New Interfaces for Musical Expression (NIME) 15th International Conference on New Interfaces for Musical Expression (NIME) May 31 June 3, 2015 Louisiana State University Baton Rouge, Louisiana, USA http://nime2015.lsu.edu Introduction NIME (New Interfaces

More information

inter.noise 2000 The 29th International Congress and Exhibition on Noise Control Engineering August 2000, Nice, FRANCE

inter.noise 2000 The 29th International Congress and Exhibition on Noise Control Engineering August 2000, Nice, FRANCE Copyright SFA - InterNoise 2000 1 inter.noise 2000 The 29th International Congress and Exhibition on Noise Control Engineering 27-30 August 2000, Nice, FRANCE I-INCE Classification: 6.1 INFLUENCE OF THE

More information

POST-PROCESSING FIDDLE : A REAL-TIME MULTI-PITCH TRACKING TECHNIQUE USING HARMONIC PARTIAL SUBTRACTION FOR USE WITHIN LIVE PERFORMANCE SYSTEMS

POST-PROCESSING FIDDLE : A REAL-TIME MULTI-PITCH TRACKING TECHNIQUE USING HARMONIC PARTIAL SUBTRACTION FOR USE WITHIN LIVE PERFORMANCE SYSTEMS POST-PROCESSING FIDDLE : A REAL-TIME MULTI-PITCH TRACKING TECHNIQUE USING HARMONIC PARTIAL SUBTRACTION FOR USE WITHIN LIVE PERFORMANCE SYSTEMS Andrew N. Robertson, Mark D. Plumbley Centre for Digital Music

More information

Audio-Based Video Editing with Two-Channel Microphone

Audio-Based Video Editing with Two-Channel Microphone Audio-Based Video Editing with Two-Channel Microphone Tetsuya Takiguchi Organization of Advanced Science and Technology Kobe University, Japan takigu@kobe-u.ac.jp Yasuo Ariki Organization of Advanced Science

More information

Chapter 1. Introduction to Digital Signal Processing

Chapter 1. Introduction to Digital Signal Processing Chapter 1 Introduction to Digital Signal Processing 1. Introduction Signal processing is a discipline concerned with the acquisition, representation, manipulation, and transformation of signals required

More information

EMPLOYMENT SERVICE. Professional Service Editorial Board Journal of Audiology & Otology. Journal of Music and Human Behavior

EMPLOYMENT SERVICE. Professional Service Editorial Board Journal of Audiology & Otology. Journal of Music and Human Behavior Kyung Myun Lee, Ph.D. Curriculum Vitae Assistant Professor School of Humanities and Social Sciences KAIST South Korea Korea Advanced Institute of Science and Technology Daehak-ro 291 Yuseong, Daejeon,

More information

Distributed Digital Music Archives and Libraries (DDMAL)

Distributed Digital Music Archives and Libraries (DDMAL) Distributed Digital Music Archives and Libraries (DDMAL) Ichiro Fujinaga Schulich School of Music McGill University Research Infrastructure CIRMMT McGill University Schulich School of Music Music Technology

More information

A MULTI-PARAMETRIC AND REDUNDANCY-FILTERING APPROACH TO PATTERN IDENTIFICATION

A MULTI-PARAMETRIC AND REDUNDANCY-FILTERING APPROACH TO PATTERN IDENTIFICATION A MULTI-PARAMETRIC AND REDUNDANCY-FILTERING APPROACH TO PATTERN IDENTIFICATION Olivier Lartillot University of Jyväskylä Department of Music PL 35(A) 40014 University of Jyväskylä, Finland ABSTRACT This

More information

The doctor of musical arts curriculum in conducting prepares students for careers in higher education and in the professional world.

The doctor of musical arts curriculum in conducting prepares students for careers in higher education and in the professional world. Conducting 1 Conducting Degrees Offered Master of Music in Conducting Doctor of Musical Arts in Conducting During the program of study, students at both the masters and doctoral levels will study repertoire

More information

International Journal of Advance Engineering and Research Development MUSICAL INSTRUMENT IDENTIFICATION AND STATUS FINDING WITH MFCC

International Journal of Advance Engineering and Research Development MUSICAL INSTRUMENT IDENTIFICATION AND STATUS FINDING WITH MFCC Scientific Journal of Impact Factor (SJIF): 5.71 International Journal of Advance Engineering and Research Development Volume 5, Issue 04, April -2018 e-issn (O): 2348-4470 p-issn (P): 2348-6406 MUSICAL

More information

DIGITAL TV RESEARCH LINE

DIGITAL TV RESEARCH LINE UNIVERSIDAD POLITÉCNICA DE MADRID GRUPO DE DISEÑO ELECTRÓNICO Y MICROELECTRÓNICO DIGITAL TV RESEARCH LINE Document: Digital_TV_Research.doc Author: GDEM Data: 24 / 01 / 2011 E.U.I.T. Telecomunicación.

More information

EDUCATION PROFESSIONAL EXPERIENCE

EDUCATION PROFESSIONAL EXPERIENCE GARY P. SCAVONE Associate Professor, Music Technology Schulich School of Music, McGill University Montreal, Quebec H3A 1E3 Canada 514-398-4400, x-089834 http://www.music.mcgill.ca/~gary/ EDUCATION 1992

More information

Real-time Chatter Compensation based on Embedded Sensing Device in Machine tools

Real-time Chatter Compensation based on Embedded Sensing Device in Machine tools International Journal of Engineering and Technical Research (IJETR) ISSN: 2321-0869 (O) 2454-4698 (P), Volume-3, Issue-9, September 2015 Real-time Chatter Compensation based on Embedded Sensing Device

More information

Capturing Sound by Light: Towards Massive Channel Audio Sensing via LEDs and Video Cameras

Capturing Sound by Light: Towards Massive Channel Audio Sensing via LEDs and Video Cameras : New Developments in Communication Science Capturing Sound by Light: Towards Massive Channel Audio Sensing via LEDs and Video Cameras Gabriel Pablo Nava, Yoshifumi Shiraki, Hoang Duy Nguyen, Yutaka Kamamoto,

More information

Music Information Retrieval with Temporal Features and Timbre

Music Information Retrieval with Temporal Features and Timbre Music Information Retrieval with Temporal Features and Timbre Angelina A. Tzacheva and Keith J. Bell University of South Carolina Upstate, Department of Informatics 800 University Way, Spartanburg, SC

More information

CONTENT-BASED MELODIC TRANSFORMATIONS OF AUDIO MATERIAL FOR A MUSIC PROCESSING APPLICATION

CONTENT-BASED MELODIC TRANSFORMATIONS OF AUDIO MATERIAL FOR A MUSIC PROCESSING APPLICATION CONTENT-BASED MELODIC TRANSFORMATIONS OF AUDIO MATERIAL FOR A MUSIC PROCESSING APPLICATION Emilia Gómez, Gilles Peterschmitt, Xavier Amatriain, Perfecto Herrera Music Technology Group Universitat Pompeu

More information

An interdisciplinary approach to audio effect classification

An interdisciplinary approach to audio effect classification An interdisciplinary approach to audio effect classification Vincent Verfaille, Catherine Guastavino Caroline Traube, SPCL / CIRMMT, McGill University GSLIS / CIRMMT, McGill University LIAM / OICM, Université

More information

LEARNING AUDIO SHEET MUSIC CORRESPONDENCES. Matthias Dorfer Department of Computational Perception

LEARNING AUDIO SHEET MUSIC CORRESPONDENCES. Matthias Dorfer Department of Computational Perception LEARNING AUDIO SHEET MUSIC CORRESPONDENCES Matthias Dorfer Department of Computational Perception Short Introduction... I am a PhD Candidate in the Department of Computational Perception at Johannes Kepler

More information

Usability of Computer Music Interfaces for Simulation of Alternate Musical Systems

Usability of Computer Music Interfaces for Simulation of Alternate Musical Systems Usability of Computer Music Interfaces for Simulation of Alternate Musical Systems Dionysios Politis, Ioannis Stamelos {Multimedia Lab, Programming Languages and Software Engineering Lab}, Department of

More information

Physical Modelling of Musical Instruments Using Digital Waveguides: History, Theory, Practice

Physical Modelling of Musical Instruments Using Digital Waveguides: History, Theory, Practice Physical Modelling of Musical Instruments Using Digital Waveguides: History, Theory, Practice Introduction Why Physical Modelling? History of Waveguide Physical Models Mathematics of Waveguide Physical

More information

Robert Alexandru Dobre, Cristian Negrescu

Robert Alexandru Dobre, Cristian Negrescu ECAI 2016 - International Conference 8th Edition Electronics, Computers and Artificial Intelligence 30 June -02 July, 2016, Ploiesti, ROMÂNIA Automatic Music Transcription Software Based on Constant Q

More information

INTER GENRE SIMILARITY MODELLING FOR AUTOMATIC MUSIC GENRE CLASSIFICATION

INTER GENRE SIMILARITY MODELLING FOR AUTOMATIC MUSIC GENRE CLASSIFICATION INTER GENRE SIMILARITY MODELLING FOR AUTOMATIC MUSIC GENRE CLASSIFICATION ULAŞ BAĞCI AND ENGIN ERZIN arxiv:0907.3220v1 [cs.sd] 18 Jul 2009 ABSTRACT. Music genre classification is an essential tool for

More information

MUSIC TECHNOLOGY MASTER OF MUSIC PROGRAM (33 CREDITS)

MUSIC TECHNOLOGY MASTER OF MUSIC PROGRAM (33 CREDITS) MUSIC TECHNOLOGY MASTER OF MUSIC PROGRAM (33 CREDITS) The Master of Music in Music Technology builds upon the strong foundation of an undergraduate degree in music. Students can expect a rigorous graduate-level

More information

Video-based Vibrato Detection and Analysis for Polyphonic String Music

Video-based Vibrato Detection and Analysis for Polyphonic String Music Video-based Vibrato Detection and Analysis for Polyphonic String Music Bochen Li, Karthik Dinesh, Gaurav Sharma, Zhiyao Duan Audio Information Research Lab University of Rochester The 18 th International

More information

Musical Instrument Identification Using Principal Component Analysis and Multi-Layered Perceptrons

Musical Instrument Identification Using Principal Component Analysis and Multi-Layered Perceptrons Musical Instrument Identification Using Principal Component Analysis and Multi-Layered Perceptrons Róisín Loughran roisin.loughran@ul.ie Jacqueline Walker jacqueline.walker@ul.ie Michael O Neill University

More information

A STATISTICAL VIEW ON THE EXPRESSIVE TIMING OF PIANO ROLLED CHORDS

A STATISTICAL VIEW ON THE EXPRESSIVE TIMING OF PIANO ROLLED CHORDS A STATISTICAL VIEW ON THE EXPRESSIVE TIMING OF PIANO ROLLED CHORDS Mutian Fu 1 Guangyu Xia 2 Roger Dannenberg 2 Larry Wasserman 2 1 School of Music, Carnegie Mellon University, USA 2 School of Computer

More information

Interacting with a Virtual Conductor

Interacting with a Virtual Conductor Interacting with a Virtual Conductor Pieter Bos, Dennis Reidsma, Zsófia Ruttkay, Anton Nijholt HMI, Dept. of CS, University of Twente, PO Box 217, 7500AE Enschede, The Netherlands anijholt@ewi.utwente.nl

More information

GOOD-SOUNDS.ORG: A FRAMEWORK TO EXPLORE GOODNESS IN INSTRUMENTAL SOUNDS

GOOD-SOUNDS.ORG: A FRAMEWORK TO EXPLORE GOODNESS IN INSTRUMENTAL SOUNDS GOOD-SOUNDS.ORG: A FRAMEWORK TO EXPLORE GOODNESS IN INSTRUMENTAL SOUNDS Giuseppe Bandiera 1 Oriol Romani Picas 1 Hiroshi Tokuda 2 Wataru Hariya 2 Koji Oishi 2 Xavier Serra 1 1 Music Technology Group, Universitat

More information

Chord Classification of an Audio Signal using Artificial Neural Network

Chord Classification of an Audio Signal using Artificial Neural Network Chord Classification of an Audio Signal using Artificial Neural Network Ronesh Shrestha Student, Department of Electrical and Electronic Engineering, Kathmandu University, Dhulikhel, Nepal ---------------------------------------------------------------------***---------------------------------------------------------------------

More information

Constellation: A Tool for Creative Dialog Between Audience and Composer

Constellation: A Tool for Creative Dialog Between Audience and Composer Constellation: A Tool for Creative Dialog Between Audience and Composer Akito van Troyer MIT Media Lab akito@media.mit.edu Abstract. Constellation is an online environment for music score making designed

More information

Melody classification using patterns

Melody classification using patterns Melody classification using patterns Darrell Conklin Department of Computing City University London United Kingdom conklin@city.ac.uk Abstract. A new method for symbolic music classification is proposed,

More information

CURRICULUM VITAE. David W. R. Sears

CURRICULUM VITAE. David W. R. Sears CURRICULUM VITAE David W. R. Sears 555 Sherbrooke Street West, Montreal, Québec, Canada H3A 1E3 Office Phone: (514) 398-4535, ext. 094837 Cellular Phone: (514) 554-2703 Email: david.sears@mail.mcgill.ca

More information