Modified Spectral Modeling Synthesis Algorithm for Digital Piri

Similar documents
SYNTHESIS FROM MUSICAL INSTRUMENT CHARACTER MAPS

A METHOD OF MORPHING SPECTRAL ENVELOPES OF THE SINGING VOICE FOR USE WITH BACKING VOCALS

Automatic Construction of Synthetic Musical Instruments and Performers

CONTENT-BASED MELODIC TRANSFORMATIONS OF AUDIO MATERIAL FOR A MUSIC PROCESSING APPLICATION

Toward a Single Reed Mouthpiece for the Oboe ( )

USING MICROPHONE ARRAYS TO RECONSTRUCT MOVING SOUND SOURCES FOR AURALIZATION

A prototype system for rule-based expressive modifications of audio recordings

POLYPHONIC INSTRUMENT RECOGNITION USING SPECTRAL CLUSTERING

Analysis, Synthesis, and Perception of Musical Sounds

WHEN a fault occurs on power systems, not only are the

ANALYSIS-ASSISTED SOUND PROCESSING WITH AUDIOSCULPT

Department of Electrical & Electronic Engineering Imperial College of Science, Technology and Medicine. Project: Real-Time Speech Enhancement

Multichannel Satellite Image Resolution Enhancement Using Dual-Tree Complex Wavelet Transform and NLM Filtering

Musical Tapestry: Re-composing Natural Sounds {

Evaluation of the Technical Level of Saxophone Performers by Considering the Evolution of Spectral Parameters of the Sound

Query By Humming: Finding Songs in a Polyphonic Database

OBJECTIVE EVALUATION OF A MELODY EXTRACTOR FOR NORTH INDIAN CLASSICAL VOCAL PERFORMANCES

Normalized Cumulative Spectral Distribution in Music

Combining Instrument and Performance Models for High-Quality Music Synthesis

Sound and Music Computing Research: Historical References

Analysis, Synthesis, and Perception of Musical Sounds

Experiments on musical instrument separation using multiplecause

Instrument Recognition in Polyphonic Mixtures Using Spectral Envelopes

AUTOMATIC TIMBRAL MORPHING OF MUSICAL INSTRUMENT SOUNDS BY HIGH-LEVEL DESCRIPTORS

Computer-based sound spectrograph system

Timbre Variations as an Attribute of Naturalness in Clarinet Play

Toward a Computationally-Enhanced Acoustic Grand Piano

2. AN INTROSPECTION OF THE MORPHING PROCESS

Expressive Singing Synthesis based on Unit Selection for the Singing Synthesis Challenge 2016

Modeling and Control of Expressiveness in Music Performance

Removal of Decaying DC Component in Current Signal Using a ovel Estimation Algorithm

Robert Alexandru Dobre, Cristian Negrescu

Harmonic Analysis of the Soprano Clarinet

A Local Dimming Algorithm for Low Power LCD TVs Using Edge-type LED Backlight

Music composition through Spectral Modeling Synthesis and Pure Data

SMS Composer and SMS Conductor: Applications for Spectral Modeling Synthesis Composition and Performance

ON FINDING MELODIC LINES IN AUDIO RECORDINGS. Matija Marolt

Chapter 1. Introduction to Digital Signal Processing

An Effective Filtering Algorithm to Mitigate Transient Decaying DC Offset

Influence of strain-gauge sensors on the vibrational behaviour of single reeds

1. Introduction NCMMSC2009

Improved Packet Loss Recovery using Interleaving for CELP-type Speech Coders in Packet Networks

Supervised Learning in Genre Classification

Keywords Separation of sound, percussive instruments, non-percussive instruments, flexible audio source separation toolbox

Topic 4. Single Pitch Detection

A FUNCTIONAL CLASSIFICATION OF ONE INSTRUMENT S TIMBRES

MUSICAL INSTRUMENT RECOGNITION WITH WAVELET ENVELOPES

DECAYING DC COMPONENT EFFECT ELIMINATION ON PHASOR ESTIMATION USING AN ADAPTIVE FILTERING ALGORITHM

Eric Dubois. Visual Communications from Broadcast TV to Telepresence

SPECTRAL PARAMETER ENCODING: TOWARDS A FRAMEWORK FOR FUNCTIONAL-AESTHETIC SONIFICATION. Takahiko Tsuchiya and Jason Freeman

System Identification

Real-Time Spectrogram (RTS tm )

A Luminance Adjusting Algorithm for High Resolution and High Image Quality AMOLED Displays of Mobile Phone Applications

Memory efficient Distributed architecture LUT Design using Unified Architecture

RUMBATOR: A FLAMENCO RUMBA COVER VERSION GENERATOR BASED ON AUDIO PROCESSING AT NOTE-LEVEL

Automatic characterization of ornamentation from bassoon recordings for expressive synthesis

A NEW LOOK AT FREQUENCY RESOLUTION IN POWER SPECTRAL DENSITY ESTIMATION. Sudeshna Pal, Soosan Beheshti

Study of White Gaussian Noise with Varying Signal to Noise Ratio in Speech Signal using Wavelet

Laboratory Assignment 3. Digital Music Synthesis: Beethoven s Fifth Symphony Using MATLAB

SV1C Personalized SerDes Tester

MODELING PRINCIPLES FOR TIME-DOMAIN SIMULATIONS OF WIND INSTRUMENTS IN PLAYING SITUATIONS

ONLINE ACTIVITIES FOR MUSIC INFORMATION AND ACOUSTICS EDUCATION AND PSYCHOACOUSTIC DATA COLLECTION

A Bootstrap Method for Training an Accurate Audio Segmenter

Sharif University of Technology. SoC: Introduction

Synthesizing a choir in real-time using Pitch Synchronous Overlap Add (PSOLA)

Stochastic synthesis: An overview

A SVD BASED SCHEME FOR POST PROCESSING OF DCT CODED IMAGES

Real-time Granular Sampling Using the IRCAM Signal Processing Workstation. Cort Lippe IRCAM, 31 rue St-Merri, Paris, 75004, France

MIE 402: WORKSHOP ON DATA ACQUISITION AND SIGNAL PROCESSING Spring 2003

ELEC 484 Project Pitch Synchronous Overlap-Add

An Accurate Timbre Model for Musical Instruments and its Application to Classification

SV1C Personalized SerDes Tester. Data Sheet

IN HIGH-SPEED digital systems, the high-speed digital

Investigation of Digital Signal Processing of High-speed DACs Signals for Settling Time Testing

ALONG with the progressive device scaling, semiconductor

Melody Retrieval On The Web

TIMBRE REPLACEMENT OF HARMONIC AND DRUM COMPONENTS FOR MUSIC AUDIO SIGNALS

Automatic Music Transcription: The Use of a. Fourier Transform to Analyze Waveform Data. Jake Shankman. Computer Systems Research TJHSST. Dr.

Examination of a simple pulse blanking technique for RFI mitigation

Color Image Compression Using Colorization Based On Coding Technique

LUT Optimization for Memory Based Computation using Modified OMS Technique

Audio spectrogram representations for processing with Convolutional Neural Networks

Perceptual Synthesis Engine: An Audio-Driven Timbre Generator

1. INTRODUCTION. Index Terms Video Transcoding, Video Streaming, Frame skipping, Interpolation frame, Decoder, Encoder.

POST-PROCESSING FIDDLE : A REAL-TIME MULTI-PITCH TRACKING TECHNIQUE USING HARMONIC PARTIAL SUBTRACTION FOR USE WITHIN LIVE PERFORMANCE SYSTEMS

An integrated granular approach to algorithmic composition for instruments and electronics

Design of an Area-Efficient Interpolated FIR Filter Based on LUT Partitioning

AN ARTISTIC TECHNIQUE FOR AUDIO-TO-VIDEO TRANSLATION ON A MUSIC PERCEPTION STUDY

LOUDNESS EFFECT OF THE DIFFERENT TONES ON THE TIMBRE SUBJECTIVE PERCEPTION EXPERIMENT OF ERHU

Further Topics in MIR

MELODY EXTRACTION BASED ON HARMONIC CODED STRUCTURE

Singing voice synthesis based on deep neural networks

APPLICATION OF A PHYSIOLOGICAL EAR MODEL TO IRRELEVANCE REDUCTION IN AUDIO CODING

Measurement of overtone frequencies of a toy piano and perception of its pitch

Recognising Cello Performers using Timbre Models

Digital music synthesis using DSP

Music Segmentation Using Markov Chain Methods

Polyphonic music transcription through dynamic networks and spectral pattern identification

Figure 2: Original and PAM modulated image. Figure 4: Original image.

A System for Acoustic Chord Transcription and Key Extraction from Audio Using Hidden Markov models Trained on Synthesized Audio

Transcription:

Modified Spectral Modeling Synthesis Algorithm for Digital Piri Myeongsu Kang, Yeonwoo Hong, Sangjin Cho, Uipil Chong

6 > Abstract This paper describes a modified spectral modeling synthesis algorithm for digital Piri, which is a Korean woodwind instrument. The standard spectral modeling synthesis (SMS) considers the sound as a combination of deterministic and stochastic components and it usually takes long time to synthesize sounds and needs numerous parameters. In order to improve this drawback, it is necessary to modify the SMS. Thus, a novel approach for analysis, transformation and synthesis of the sound has been proposed. Moreover, it is possible to generate various sound duration flexibly using this modified SMS. Piri was a target to simulate the modified SMS. To synthesize sounds with the proposed method, it is firstly necessary to obtain a trimmed sound in the sustain region from the original Piri sound. Then, two parameter sets are required: a parameter set describing the characteristic of the Piri, such as deterministic frequencies, magnitudes and stochastic, and a parameter set including the window size, hop size and number of peaks. Finally, a flexible time scaling algorithm based on frame reallocation and interpolation technique is applied. Namely, the extracted parameters in the sustain region can be reallocated and interpolated to change the length of the synthesized sound with a real stretching factor. When synthesized sounds are compared with original sounds through their waveforms and spectra, the proposed method well synthesizes sounds which are similar to originals. The method is also applied successfully for other Korean instruments, Taepyeongso. Key words : Sound synthesis ( ), Spectral modeling ( ), Korean traditional woodwind instruments ( ), Time stretching algorithm ( ), Digital Piri ( )

< 7

8 >

< 9

10 >

< 11 [1] X. Serra and J. Smith, Spectral modeling synthesis: A sound analysis/synthesis system based on a deterministic plus stochastic decomposition. Computer Music Journal 14(4), pp. 12-24, 1990. [2] Allen, Jont B., Short term spectral analysis, synthesis, and modification by discrete Fourier transform, IEEE Trans. on Acoust., Speech, and Signal Proc., vol. ASSP-25, pp. 235-238, 1977. [3] X. Serra, A System for Sound Analysis/Transformation/Synthesis based on a Deterministic plus Stochastic Decomposition, Ph.D. Thesis. Stanford University, 1989. [4] X. Serra Musical Sound Modeling with Sinusoids plus Noise, published in C. Roads, S. Pope, A. Picialli, G. De Poli, editors. 1997. [ Musical Signal Processing. Swets & Zeitlinger Publishers] [5] McAulay, R.J. and T.F. Quatieri. Speech Analysis/Synthesis based on a Sinusoidal Representation. IEEE Trans. on Acoust., Speech, and Signal Proc. vol. 34, no. 4, pp.744-754, 1986. [6] Maher, R. C. and J. W. Beauchamp, Fundamental Frequency Estimation of Musical Signals using a twoway Mismatch Procedure. J. Acoust. Soc. Am. vol. 95, no. 4, pp. 2254-2263, 1984. [7] Allen, Jont B. and Lawrence R. Rabiner. A Unified approach analysis and synthesis, IEEE Trans. on Acoust., Speech, and Signal Proc, vol. 65, pp. 1558-1564, 1977. [8] Serra, X, Residual Minimization in a Musical Signal Model based on a Deterministic plus Stochastic Decomposition. J. Acoust. Soc. Am. vol. 95 no. 5-2, pp. 2958-2959, 1994. [9] Jean-Pierre Dalmont, Joel Gilbert, and Sebastien Ollivier, Nonlinear characteristics of single-reed instruments: Quasistatic volume flow and reed opening measurements, J. Acoust. Soc. Am. vol. 114, no. 4, pp. 2253-2262, 2003. [10] Fabrice Pinard, Benoit Laine, and Holger Vach, Musical quality assessment of clarinet reeds using optical holography, J. Acoust. Soc. Am. vol. 113, no. 3, pp. 1736-1742, 2003. [11] Andre Almeida, Christophe Vergez, and Rene Causse, Quasistatic nonlinear characteristics of double-

12 > reed instruments, J. Acoust. Soc. Am. vol. 121, no. 1, pp. 536-546, 2007. [12],,, FM,, vol. 7, no. 1, pp. 37-40, 2006. [13],,, FM,, vol. 4, no. 1, pp. 85-88, 2006. [14] Hye Jee Kim, Hye Jung Yoon, Hyung Je Cho, Jun Kim, A study on the spectrum analysis for the sound synthesis of Piri, KMMS, vol. 9, no. 7, pp. 801-807, July, 2006. [15] Kieu Huu Thu, Joongbae Pyoun, Sangjin Cho, Uipil Chong, Parameter extraction for sound synthesis of the Dan Tranh, Proc. IFOST2008, pp. 310-313, June 23-29 2008. [16] Sangjin Cho, Uipil Chong, Physical modeling of Gayageum with application to sound engine in musical synthesizer, Proc. ICHIT, vol. 1, Cheju island, Korea, Nov 9-11, 2006. [17],,,, 2007.