Expressive information

Size: px
Start display at page:

Download "Expressive information"

Transcription

1 Expressive information 1. Emotions 2. Laban Effort space (gestures) 3. Kinestetic space (music performance) 4. Performance worm 5. Action based metaphor 1

2 Motivations " In human communication, two channels can be distinguished: " one transmits explicit messages, " the other transmits implicit messages about the humans themselves. " Explicit channel: " well studied " Implicit channel " not as well understood. " Understanding the other party emotions is one of the key tasks. " When a person engages with music, many mental process and contents are involved " representational and evaluative processes 2

3 How affect is differentiated from other psychological phenomena " Representational process: " e.g. determination or awareness of musical properties " as meter, rhythm, tonality, harmony, form, style " Central to recognition, identification, performance " Study of music perception and cognition " Evaluative process " e.g. determination or awareness of music as eliciting liking or disliking; preference; emotion and mood; aesthetic and spiritual experiences " are valenced: tendency to attach different degrees of positivity or negativity " are subjective: affected by labile personal factors as attitudes, associations, goals. " Key issue: understand the relationship between representational and evaluative process 3

4 1. Approaches to conceptualizing emotion " Aims of psychological approach: understanding " the mechanisms that intervene between " music reaching a person s ears and " an emotion being perceived, or experienced, " the roles of emotion in composing and performing music " Aim of the scientific and technological approach: to develop " models able to describe such phenomena " systems for expression and emotion rendering and recognizing in multimodal communication. " Approaches to conceptualizing emotion in psychology: " categorical " dimensional 4

5 1 a. Categorical approach " Assumption: people experience emotions as categories that are distinct from each other. " Basic emotions: " there is a limited number of innate and universal emotional categories, from which all other emotional states can be derived " happiness, sadness, anger, fear, " disgust, surprise " Focus: characteristics that distinguish emotion from one another " Critic: different set of basic emotions 5

6 1 b. Dimensional approach " Focus: identifying emotions based on their placement on a small number of dimensions, e.g. valence, activity, potency " Derived from similarity judgments analyzed using factor analysis or multidimensional scaling " Allow illustrating similarities between different feelings in terms of neighborhood in space 6

7 Circumplex model of Russel " Circular structure: valence and activation " Varying degree of similarity " Bipolar emotions " Organize in term of : " Valence: affect appraisal (pleasant unpleasant) " positive or negative evaluations of people or things or events " Activation: physiological reaction (high low arousal) " the strength of the person s disposition to take some action rather than none " Useful for capturing the continuous change in emotional expression " Critic: Blur important distinctions 7

8 Circumplex model of Russel " Valence " Activation (or Arousal) 8

9 Plutchik emotion wheel " Full-blown emotions tend to form a roughly circular pattern in activation-evaluation space. " è a circular structure inherent in emotionality. " Emotional orientation " angular measure " Emotional strength " distance from the origin " Strong emotions are more sharply distinct from each other than weaker emotions with the same emotional orientation. " Axes: " from acceptance to disgust " from apathetic to curious Anticipation Joy Anger Disgust Acceptance Fear Sadness Surprise The emotion wheel (Plutchik, 1980) 9

10 Typical characteristics of emotions " are functional despite their apparent non instrumentality " have behavioral, physiological and experiential components " have proximal elicitors " are intrinsically social " invoke action tendencies " change during the course of human development " involve cognitive appraisal of organism-environment relationships 10

11 2. Laban space: Expressive gestures Camurri - Volpe 11

12 Laban s Theory of Effort " In his Theory of Effort, choreographer Rudolf Laban points out " the dynamic nature of movement " the relationship among movement, space and time " Laban s approach is an attempt to " describe, in a formalized way, the major features of human movement " without focusing on a particular kind of movement or dance expression. " Gesture qualities described by the Effort space: " components: Space, Time, Weight, Flow => Extraction and analysis of Laban s gesture qualities is a step toward analysis and understanding of expressive gesture. 12

13 Laban s Space and Time components " Space component " refers to the " direction of a motion stroke and to the " path followed by a sequence of strokes (i.e., a sequence of directions). " flexible " if the movement follows these directions smoothly " direct " if it follows them along a straight trajectory. " Time component " is related to impulsiveness and capacity of controlling a movement. " With respect to Time an action can be sustained or quick. 13

14 Laban s Weight and Flow components " Weight component " is a measure of how much strength and weight is exerted in a movement. " It can be light or strong. " For example, in pushing away a heavy object it is necessary to use a strong weight, whereas in handling a delicate and light object, the weight component has to be light. " Flow component " is a measure of how bound or free a movement, or a sequence of movements, appears. 14

15 Laban s Theory of Effort 15

16 Laban s Theory of Effort 16

17 Example: Emotion and Motion " Movement affects emotional state and can produce stronger social connections. " How does/should this affect movement-based interaction? " Examining gestures and body movement in Wii games. " Linking the movements with emotional states and cues. " Used Laban Movement Analysis effort dimensions to better understand what makes certain movements feel certain ways. " happy games use light and sustained movements. " More directed, sudden movements up the competitive feel 17

18 3. Kinetics- Energy space: Expressive music performance Expressive music performance 18

19 3. Understanding expressiveness " Dimensional approach " Method " represent expressiveness on a low dimensional space " cluster analysis " dimensions interpretation " Dimensional representation: " asking subjects to evaluate according some scales " semantic effects " asking subjects to associate to specific attractors " focus on specific aspects " asking subjects to group by similarity " less semantic constraint 19

20 Perceptual analysis of expressive intentions " What? " Expressive music performances " Why? " Between performer s intention and listener experience " How? " Different scores " Different expressive (sensorial) intentions " Evaluation adjectives " Extract judgment categories (Cluster analysis, Factor analysis, MDS) " Result: " Expressive semantic space 20

21 3A. Kinetics Energy space " Aim of the perceptual analysis " determine the judgment categories used by the listeners. " Material " excerpts from Western Classical and ethnic music " different instruments " played according sensorial expressive intentions " hard, soft, light, heavy, bright, dark " neutral vs. natural " Subjects were asked to evaluate according 17 adjectives of sensorial nature " Sonological analysis of excerpts " Cluster analysis and factor analysis Canazza et al. JNMR

22 Methodology " A group of sensorial adjectives was chosen (hard, soft, light, heavy, bright, dark) which should inspire an expressive intention to a musician " Musicians (violin, clarinet, piano, sax) produced different performances of the same piece correlated to expressive intentions " Perceptual analyses confirmed that listener's experience and performer's intention were basically agreed " The sonological analyses shown the acoustic parameters which separate the different performances of the same score natural hard soft heavy light bright dark 22

23 Cluster Analysis " Cluster analysis shows clear distinction " group of trained musicians " group of non musicians (greater variance) Musicians Non musicians distance index between the subjects 23

24 Perceptual analysis " Factor analysis on evaluation adjectives: " black, oppressive, serious, dismal, massive, rigid, mellow, tender, sweet, limpid, airy, gentle, effervescent, vaporous, fresh, abrupt, sharp " The performances are placed on it, according to factor scores, in order to observe in which semantic sector they map " Performances placed near similar adjectives " Neutral in the middle 24

25 Kinetics- Energy space " Factor analysis on performances: 2 factors " Interpretation " dim. 1 (Heavy-Light) è Kinetics " dim. 2 (Hard-Soft) è Energy 1,0 tempo legato intensity Hard factor factor ,5 Heavy Dark " Abstract control space Energy 0,0-0,5 Light Bright Soft -1,0-1,0-0,5 0,0 0,5 1,0 Kinetics 25

26 Factor analysis on performances " Subjects placed the performances along only two axes " Factor 1 distinguishes Heavy from Light " Factor 2 distinguishes Soft from Hard " Indication of how listeners organized the performances in their own minds. 1,0 Hard 0,5 Heavy Dark Energy 0,0-0,5 Light Bright -1,0 Soft -1,0-0,5 0,0 0,5 1,0 Kinetics 26

27 Interpretation: Kinetics-Energy space " X-axis (Heavy-Light) " correlated with Tempo " è Kinetics " Y-axis (Hard-Soft) " correlated with Attack Time, Legato/Staccato, Intensity " è Energy " Kinetics - Energy define an abstract representation space " è Kinestetic space Energy 1,0 0,5 0,0-0,5-1,0 Heavy Dark Hard Soft Light Bright -1,0-0,5 0,0 0,5 1,0 Kinetics 27

28 4. Performance worm: Expressive music performance Expressive music performance 28

29 Performance Worm (Dixon 2002) " Skilled musicians communicate high level information such as musical structure and emotion when they shape the music by the continuous modulation of aspects such as tempo and loudness. " The Performance Worm is a real time system for tracking and visualizing the tempo and dynamics of a performance " provides insight into the expressive patterns applied by skilled artists. " This representation also forms the basis for automatic recognition of performers style 29

30 Performance worm " horizontal axis è tempo in beats per minute, " vertical axis è loudness in sones. Rachmaninov s Prelude op.23 no.6 played by Vladimir Ashkenazy, bar

31 To learn more " Cowie R., Douglas-Cowie E., Tsapatsoulis N., Votsis G., Kollias S., Fellenz W., Taylor J., Emotion Recognition in Human-Computer Interaction, IEEE Signal Processing Magazine, vol. 18, no. 1, pp , " Sloboda J.A. and Juslin P. (eds), Music and Emotions, Oxford University Press, 2001 " Laban R. and Lawrence F.C., Effort. London: Macdonald & Evans Ltd., " Canazza S., De Poli G., Rodà A. and Vidolin A., An Abstract Control Space for Communication of Sensory Expressive Intentions in Music Performance Journal of New Music Research, vol. 32, n. 3, pp , 2003 " Dixon, S., Goebl, W., and Widmer, G. (2002). Real time tracking and visualisation of musical expression. in Music and Artificial Intelligence: Second International Conference, ICMAI2002, pages 58 68, Edinburgh, Scotland. Springer. 31

Action and expression in music performance

Action and expression in music performance Action and expression in music performance Giovanni De Poli e Luca Mion Department of Information Engineering Centro di Sonologia Computazionale Università di Padova 1 1. Why study expressiveness Understanding

More information

The relationship between properties of music and elicited emotions

The relationship between properties of music and elicited emotions The relationship between properties of music and elicited emotions Agnieszka Mensfelt Institute of Computing Science Poznan University of Technology, Poland December 5, 2017 1 / 19 Outline 1 Music and

More information

Electronic Musicological Review

Electronic Musicological Review Electronic Musicological Review Volume IX - October 2005 home. about. editors. issues. submissions. pdf version The facial and vocal expression in singers: a cognitive feedback study for improving emotional

More information

About Giovanni De Poli. What is Model. Introduction. di Poli: Methodologies for Expressive Modeling of/for Music Performance

About Giovanni De Poli. What is Model. Introduction. di Poli: Methodologies for Expressive Modeling of/for Music Performance Methodologies for Expressiveness Modeling of and for Music Performance by Giovanni De Poli Center of Computational Sonology, Department of Information Engineering, University of Padova, Padova, Italy About

More information

Compose yourself: The Emotional Influence of Music

Compose yourself: The Emotional Influence of Music 1 Dr Hauke Egermann Director of York Music Psychology Group (YMPG) Music Science and Technology Research Cluster University of York hauke.egermann@york.ac.uk www.mstrcyork.org/ympg Compose yourself: The

More information

Affective response to a set of new musical stimuli W. Trey Hill & Jack A. Palmer Psychological Reports, 106,

Affective response to a set of new musical stimuli W. Trey Hill & Jack A. Palmer Psychological Reports, 106, Hill & Palmer (2010) 1 Affective response to a set of new musical stimuli W. Trey Hill & Jack A. Palmer Psychological Reports, 106, 581-588 2010 This is an author s copy of the manuscript published in

More information

Opening musical creativity to non-musicians

Opening musical creativity to non-musicians Opening musical creativity to non-musicians Fabio Morreale Experiential Music Lab Department of Information Engineering and Computer Science University of Trento, Italy Abstract. This paper gives an overview

More information

An action based metaphor for description of expression in music performance

An action based metaphor for description of expression in music performance An action based metaphor for description of expression in music performance Luca Mion CSC-SMC, Centro di Sonologia Computazionale Department of Information Engineering University of Padova Workshop Toni

More information

1. BACKGROUND AND AIMS

1. BACKGROUND AND AIMS THE EFFECT OF TEMPO ON PERCEIVED EMOTION Stefanie Acevedo, Christopher Lettie, Greta Parnes, Andrew Schartmann Yale University, Cognition of Musical Rhythm, Virtual Lab 1. BACKGROUND AND AIMS 1.1 Introduction

More information

Searching for the Universal Subconscious Study on music and emotion

Searching for the Universal Subconscious Study on music and emotion Searching for the Universal Subconscious Study on music and emotion Antti Seppä Master s Thesis Music, Mind and Technology Department of Music April 4, 2010 University of Jyväskylä UNIVERSITY OF JYVÄSKYLÄ

More information

Expressive performance in music: Mapping acoustic cues onto facial expressions

Expressive performance in music: Mapping acoustic cues onto facial expressions International Symposium on Performance Science ISBN 978-94-90306-02-1 The Author 2011, Published by the AEC All rights reserved Expressive performance in music: Mapping acoustic cues onto facial expressions

More information

Perceptual dimensions of short audio clips and corresponding timbre features

Perceptual dimensions of short audio clips and corresponding timbre features Perceptual dimensions of short audio clips and corresponding timbre features Jason Musil, Budr El-Nusairi, Daniel Müllensiefen Department of Psychology, Goldsmiths, University of London Question How do

More information

THE EFFECT OF EXPERTISE IN EVALUATING EMOTIONS IN MUSIC

THE EFFECT OF EXPERTISE IN EVALUATING EMOTIONS IN MUSIC THE EFFECT OF EXPERTISE IN EVALUATING EMOTIONS IN MUSIC Fabio Morreale, Raul Masu, Antonella De Angeli, Patrizio Fava Department of Information Engineering and Computer Science, University Of Trento, Italy

More information

HOW COOL IS BEBOP JAZZ? SPONTANEOUS

HOW COOL IS BEBOP JAZZ? SPONTANEOUS HOW COOL IS BEBOP JAZZ? SPONTANEOUS CLUSTERING AND DECODING OF JAZZ MUSIC Antonio RODÀ *1, Edoardo DA LIO a, Maddalena MURARI b, Sergio CANAZZA a a Dept. of Information Engineering, University of Padova,

More information

Influence of timbre, presence/absence of tonal hierarchy and musical training on the perception of musical tension and relaxation schemas

Influence of timbre, presence/absence of tonal hierarchy and musical training on the perception of musical tension and relaxation schemas Influence of timbre, presence/absence of tonal hierarchy and musical training on the perception of musical and schemas Stella Paraskeva (,) Stephen McAdams (,) () Institut de Recherche et de Coordination

More information

Goebl, Pampalk, Widmer: Exploring Expressive Performance Trajectories. Werner Goebl, Elias Pampalk and Gerhard Widmer (2004) Introduction

Goebl, Pampalk, Widmer: Exploring Expressive Performance Trajectories. Werner Goebl, Elias Pampalk and Gerhard Widmer (2004) Introduction Werner Goebl, Elias Pampalk and Gerhard Widmer (2004) Presented by Brian Highfill USC ISE 575 / EE 675 February 16, 2010 Introduction Exploratory approach for analyzing large amount of expressive performance

More information

Sofia Dahl Cognitive and Systematic Musicology Lab, School of Music. Looking at movement gesture Examples from drumming and percussion Sofia Dahl

Sofia Dahl Cognitive and Systematic Musicology Lab, School of Music. Looking at movement gesture Examples from drumming and percussion Sofia Dahl Looking at movement gesture Examples from drumming and percussion Sofia Dahl Players movement gestures communicative sound facilitating visual gesture sound producing sound accompanying gesture sound gesture

More information

Subjective Emotional Responses to Musical Structure, Expression and Timbre Features: A Synthetic Approach

Subjective Emotional Responses to Musical Structure, Expression and Timbre Features: A Synthetic Approach Subjective Emotional Responses to Musical Structure, Expression and Timbre Features: A Synthetic Approach Sylvain Le Groux 1, Paul F.M.J. Verschure 1,2 1 SPECS, Universitat Pompeu Fabra 2 ICREA, Barcelona

More information

DIGITAL AUDIO EMOTIONS - AN OVERVIEW OF COMPUTER ANALYSIS AND SYNTHESIS OF EMOTIONAL EXPRESSION IN MUSIC

DIGITAL AUDIO EMOTIONS - AN OVERVIEW OF COMPUTER ANALYSIS AND SYNTHESIS OF EMOTIONAL EXPRESSION IN MUSIC DIGITAL AUDIO EMOTIONS - AN OVERVIEW OF COMPUTER ANALYSIS AND SYNTHESIS OF EMOTIONAL EXPRESSION IN MUSIC Anders Friberg Speech, Music and Hearing, CSC, KTH Stockholm, Sweden afriberg@kth.se ABSTRACT The

More information

ESP: Expression Synthesis Project

ESP: Expression Synthesis Project ESP: Expression Synthesis Project 1. Research Team Project Leader: Other Faculty: Graduate Students: Undergraduate Students: Prof. Elaine Chew, Industrial and Systems Engineering Prof. Alexandre R.J. François,

More information

The Role of Time in Music Emotion Recognition

The Role of Time in Music Emotion Recognition The Role of Time in Music Emotion Recognition Marcelo Caetano 1 and Frans Wiering 2 1 Institute of Computer Science, Foundation for Research and Technology - Hellas FORTH-ICS, Heraklion, Crete, Greece

More information

A User-Oriented Approach to Music Information Retrieval.

A User-Oriented Approach to Music Information Retrieval. A User-Oriented Approach to Music Information Retrieval. Micheline Lesaffre 1, Marc Leman 1, Jean-Pierre Martens 2, 1 IPEM, Institute for Psychoacoustics and Electronic Music, Department of Musicology,

More information

Embodied music cognition and mediation technology

Embodied music cognition and mediation technology Embodied music cognition and mediation technology Briefly, what it is all about: Embodied music cognition = Experiencing music in relation to our bodies, specifically in relation to body movements, both

More information

MUSICAL MOODS: A MASS PARTICIPATION EXPERIMENT FOR AFFECTIVE CLASSIFICATION OF MUSIC

MUSICAL MOODS: A MASS PARTICIPATION EXPERIMENT FOR AFFECTIVE CLASSIFICATION OF MUSIC 12th International Society for Music Information Retrieval Conference (ISMIR 2011) MUSICAL MOODS: A MASS PARTICIPATION EXPERIMENT FOR AFFECTIVE CLASSIFICATION OF MUSIC Sam Davies, Penelope Allen, Mark

More information

"The mind is a fire to be kindled, not a vessel to be filled." Plutarch

The mind is a fire to be kindled, not a vessel to be filled. Plutarch "The mind is a fire to be kindled, not a vessel to be filled." Plutarch -21 Special Topics: Music Perception Winter, 2004 TTh 11:30 to 12:50 a.m., MAB 125 Dr. Scott D. Lipscomb, Associate Professor Office

More information

MELODIC AND RHYTHMIC CONTRASTS IN EMOTIONAL SPEECH AND MUSIC

MELODIC AND RHYTHMIC CONTRASTS IN EMOTIONAL SPEECH AND MUSIC MELODIC AND RHYTHMIC CONTRASTS IN EMOTIONAL SPEECH AND MUSIC Lena Quinto, William Forde Thompson, Felicity Louise Keating Psychology, Macquarie University, Australia lena.quinto@mq.edu.au Abstract Many

More information

Breathe Life Into Your Conducting Dr. Erica Neidlinger DePaul University. Breathing as a Player vs. Breathing as a Conductor

Breathe Life Into Your Conducting Dr. Erica Neidlinger DePaul University. Breathing as a Player vs. Breathing as a Conductor Breathe Life Into Your Conducting Dr. Erica Neidlinger DePaul University Breathing as a Player vs. Breathing as a Conductor 1. Breathing as a player is different than breathing as a conductor. Wind players

More information

Modeling and Control of Expressiveness in Music Performance

Modeling and Control of Expressiveness in Music Performance Modeling and Control of Expressiveness in Music Performance SERGIO CANAZZA, GIOVANNI DE POLI, MEMBER, IEEE, CARLO DRIOLI, MEMBER, IEEE, ANTONIO RODÀ, AND ALVISE VIDOLIN Invited Paper Expression is an important

More information

A Recipe for Emotion in Music (Music & Meaning Part II)

A Recipe for Emotion in Music (Music & Meaning Part II) A Recipe for Emotion in Music (Music & Meaning Part II) Curriculum Guide This curriculum guide is designed to help you use the MPR Class Notes video A Recipe for Emotion in Music as a teaching tool in

More information

Research & Development. White Paper WHP 228. Musical Moods: A Mass Participation Experiment for the Affective Classification of Music

Research & Development. White Paper WHP 228. Musical Moods: A Mass Participation Experiment for the Affective Classification of Music Research & Development White Paper WHP 228 May 2012 Musical Moods: A Mass Participation Experiment for the Affective Classification of Music Sam Davies (BBC) Penelope Allen (BBC) Mark Mann (BBC) Trevor

More information

Mappe per Affetti Erranti: a Multimodal System for Social Active Listening and Expressive Performance

Mappe per Affetti Erranti: a Multimodal System for Social Active Listening and Expressive Performance Mappe per Affetti Erranti: a Multimodal System for Social Active Listening and Expressive Performance Antonio Camurri, Corrado Canepa, Paolo Coletta, Barbara Mazzarino, Gualtiero Volpe InfoMus Lab Casa

More information

Surprise & emotion. Theoretical paper Key conference theme: Interest, surprise and delight

Surprise & emotion. Theoretical paper Key conference theme: Interest, surprise and delight Surprise & emotion Geke D.S. Ludden, Paul Hekkert & Hendrik N.J. Schifferstein, Department of Industrial Design, Delft University of Technology, Landbergstraat 15, 2628 CE Delft, The Netherlands, phone:

More information

Grade 10 Fine Arts Guidelines: Dance

Grade 10 Fine Arts Guidelines: Dance Grade 10 Fine Arts Guidelines: Dance Historical, Cultural and Social Contexts Students understand dance forms and styles from a diverse range of cultural environments of past and present society. They

More information

Peak experience in music: A case study between listeners and performers

Peak experience in music: A case study between listeners and performers Alma Mater Studiorum University of Bologna, August 22-26 2006 Peak experience in music: A case study between listeners and performers Sujin Hong College, Seoul National University. Seoul, South Korea hongsujin@hotmail.com

More information

INFLUENCE OF MUSICAL CONTEXT ON THE PERCEPTION OF EMOTIONAL EXPRESSION OF MUSIC

INFLUENCE OF MUSICAL CONTEXT ON THE PERCEPTION OF EMOTIONAL EXPRESSION OF MUSIC INFLUENCE OF MUSICAL CONTEXT ON THE PERCEPTION OF EMOTIONAL EXPRESSION OF MUSIC Michal Zagrodzki Interdepartmental Chair of Music Psychology, Fryderyk Chopin University of Music, Warsaw, Poland mzagrodzki@chopin.edu.pl

More information

Analyzing and Responding Students express orally and in writing their interpretations and evaluations of dances they observe and perform.

Analyzing and Responding Students express orally and in writing their interpretations and evaluations of dances they observe and perform. OHIO DEPARTMENT OF EDUCATION ACADEMIC CONTENT STANDARDS FINE ARTS CHECKLIST: DANCE ~GRADE 10~ Historical, Cultural and Social Contexts Students understand dance forms and styles from a diverse range of

More information

The Effects of Web Site Aesthetics and Shopping Task on Consumer Online Purchasing Behavior

The Effects of Web Site Aesthetics and Shopping Task on Consumer Online Purchasing Behavior The Effects of Web Site Aesthetics and Shopping Task on Consumer Online Purchasing Behavior Cai, Shun The Logistics Institute - Asia Pacific E3A, Level 3, 7 Engineering Drive 1, Singapore 117574 tlics@nus.edu.sg

More information

& Ψ. study guide. Music Psychology ... A guide for preparing to take the qualifying examination in music psychology.

& Ψ. study guide. Music Psychology ... A guide for preparing to take the qualifying examination in music psychology. & Ψ study guide Music Psychology.......... A guide for preparing to take the qualifying examination in music psychology. Music Psychology Study Guide In preparation for the qualifying examination in music

More information

Dynamic Levels in Classical and Romantic Keyboard Music: Effect of Musical Mode

Dynamic Levels in Classical and Romantic Keyboard Music: Effect of Musical Mode Dynamic Levels in Classical and Romantic Keyboard Music: Effect of Musical Mode OLIVIA LADINIG [1] School of Music, Ohio State University DAVID HURON School of Music, Ohio State University ABSTRACT: An

More information

Mammals and music among others

Mammals and music among others Mammals and music among others crossmodal perception & musical expressiveness W.P. Seeley Philosophy Department University of New Hampshire Stravinsky. Rites of Spring. This is when I was heavy into sampling.

More information

mood into an adequate input for our procedural music generation system, a scientific classification system is needed. One of the most prominent classi

mood into an adequate input for our procedural music generation system, a scientific classification system is needed. One of the most prominent classi Received, 201 ; Accepted, 201 Markov Chain Based Procedural Music Generator with User Chosen Mood Compatibility Adhika Sigit Ramanto Institut Teknologi Bandung Jl. Ganesha No. 10, Bandung 13512060@std.stei.itb.ac.id

More information

ONLINE. Key words: Greek musical modes; Musical tempo; Emotional responses to music; Musical expertise

ONLINE. Key words: Greek musical modes; Musical tempo; Emotional responses to music; Musical expertise Brazilian Journal of Medical and Biological Research Online Provisional Version ISSN 0100-879X This Provisional PDF corresponds to the article as it appeared upon acceptance. Fully formatted PDF and full

More information

Music Mood. Sheng Xu, Albert Peyton, Ryan Bhular

Music Mood. Sheng Xu, Albert Peyton, Ryan Bhular Music Mood Sheng Xu, Albert Peyton, Ryan Bhular What is Music Mood A psychological & musical topic Human emotions conveyed in music can be comprehended from two aspects: Lyrics Music Factors that affect

More information

Emotions perceived and emotions experienced in response to computer-generated music

Emotions perceived and emotions experienced in response to computer-generated music Emotions perceived and emotions experienced in response to computer-generated music Maciej Komosinski Agnieszka Mensfelt Institute of Computing Science Poznan University of Technology Piotrowo 2, 60-965

More information

However, in studies of expressive timing, the aim is to investigate production rather than perception of timing, that is, independently of the listene

However, in studies of expressive timing, the aim is to investigate production rather than perception of timing, that is, independently of the listene Beat Extraction from Expressive Musical Performances Simon Dixon, Werner Goebl and Emilios Cambouropoulos Austrian Research Institute for Artificial Intelligence, Schottengasse 3, A-1010 Vienna, Austria.

More information

MEMORY & TIMBRE MEMT 463

MEMORY & TIMBRE MEMT 463 MEMORY & TIMBRE MEMT 463 TIMBRE, LOUDNESS, AND MELODY SEGREGATION Purpose: Effect of three parameters on segregating 4-note melody among distraction notes. Target melody and distractor melody utilized.

More information

A FUNCTIONAL CLASSIFICATION OF ONE INSTRUMENT S TIMBRES

A FUNCTIONAL CLASSIFICATION OF ONE INSTRUMENT S TIMBRES A FUNCTIONAL CLASSIFICATION OF ONE INSTRUMENT S TIMBRES Panayiotis Kokoras School of Music Studies Aristotle University of Thessaloniki email@panayiotiskokoras.com Abstract. This article proposes a theoretical

More information

A Case Based Approach to the Generation of Musical Expression

A Case Based Approach to the Generation of Musical Expression A Case Based Approach to the Generation of Musical Expression Taizan Suzuki Takenobu Tokunaga Hozumi Tanaka Department of Computer Science Tokyo Institute of Technology 2-12-1, Oookayama, Meguro, Tokyo

More information

The Sound of Emotion: The Effect of Performers Emotions on Auditory Performance Characteristics

The Sound of Emotion: The Effect of Performers Emotions on Auditory Performance Characteristics The Sound of Emotion: The Effect of Performers Emotions on Auditory Performance Characteristics Anemone G. W. van Zijl *1, Petri Toiviainen *2, Geoff Luck *3 * Department of Music, University of Jyväskylä,

More information

Environment Expression: Expressing Emotions through Cameras, Lights and Music

Environment Expression: Expressing Emotions through Cameras, Lights and Music Environment Expression: Expressing Emotions through Cameras, Lights and Music Celso de Melo, Ana Paiva IST-Technical University of Lisbon and INESC-ID Avenida Prof. Cavaco Silva Taguspark 2780-990 Porto

More information

Expressive arts Experiences and outcomes

Expressive arts Experiences and outcomes Expressive arts Experiences and outcomes Experiences in the expressive arts involve creating and presenting and are practical and experiential. Evaluating and appreciating are used to enhance enjoyment

More information

A Categorical Approach for Recognizing Emotional Effects of Music

A Categorical Approach for Recognizing Emotional Effects of Music A Categorical Approach for Recognizing Emotional Effects of Music Mohsen Sahraei Ardakani 1 and Ehsan Arbabi School of Electrical and Computer Engineering, College of Engineering, University of Tehran,

More information

Can parents influence children s music preferences and positively shape their development? Dr Hauke Egermann

Can parents influence children s music preferences and positively shape their development? Dr Hauke Egermann Introduction Can parents influence children s music preferences and positively shape their development? Dr Hauke Egermann Listening to music is a ubiquitous experience. Most of us listen to music every

More information

WESTFIELD PUBLIC SCHOOLS Westfield, New Jersey

WESTFIELD PUBLIC SCHOOLS Westfield, New Jersey WESTFIELD PUBLIC SCHOOLS Westfield, New Jersey Office of Instruction Course of Study MUSIC K 5 Schools... Elementary Department... Visual & Performing Arts Length of Course.Full Year (1 st -5 th = 45 Minutes

More information

THE SOUND OF SADNESS: THE EFFECT OF PERFORMERS EMOTIONS ON AUDIENCE RATINGS

THE SOUND OF SADNESS: THE EFFECT OF PERFORMERS EMOTIONS ON AUDIENCE RATINGS THE SOUND OF SADNESS: THE EFFECT OF PERFORMERS EMOTIONS ON AUDIENCE RATINGS Anemone G. W. Van Zijl, Geoff Luck Department of Music, University of Jyväskylä, Finland Anemone.vanzijl@jyu.fi Abstract Very

More information

A Conductor s Expressive Palette: Bringing Every Note to Life through Gesture Dr. Trent A. Hollinger

A Conductor s Expressive Palette: Bringing Every Note to Life through Gesture Dr. Trent A. Hollinger A Conductor s Expressive Palette: Bringing Every Note to Life through Gesture Dr. Trent A. Hollinger As artists and ensemble leaders, we bring the emotional and expressive power of music to life through

More information

HST 725 Music Perception & Cognition Assignment #1 =================================================================

HST 725 Music Perception & Cognition Assignment #1 ================================================================= HST.725 Music Perception and Cognition, Spring 2009 Harvard-MIT Division of Health Sciences and Technology Course Director: Dr. Peter Cariani HST 725 Music Perception & Cognition Assignment #1 =================================================================

More information

ELEMENTS AND PRINCIPLES OF DESIGN

ELEMENTS AND PRINCIPLES OF DESIGN ELEMENTS AND PRINCIPLES OF DESIGN The Elements of Design The Elements of Design (what we see): Line Shape & Form Colour Texture Space Proportion Line Lines have direction: A linear mark on a page vertical,

More information

Felt Evaluations: A Theory of Pleasure and Pain. Bennett Helm (2002) Slides by Jeremiah Tillman

Felt Evaluations: A Theory of Pleasure and Pain. Bennett Helm (2002) Slides by Jeremiah Tillman Felt Evaluations: A Theory of Pleasure and Pain Bennett Helm (2002) Slides by Jeremiah Tillman Introduction Helm s big picture: Pleasure and pain aren t isolated phenomenal bodily states, but are conceptually

More information

Summary of programme. Affect and Personality in Interaction with Ubiquitous Systems. Today s topics. Displaying emotion. Professor Ruth Aylett

Summary of programme. Affect and Personality in Interaction with Ubiquitous Systems. Today s topics. Displaying emotion. Professor Ruth Aylett Affect and Personality in Interaction with Ubiquitous Systems Professor Ruth Aylett Vision Interactive Systems & Graphical Environments MACS, Heriot-Watt University www.macs.hw.ac.uk/~ruth Summary of programme

More information

Towards a multi-layer architecture for multi-modal rendering of expressive actions

Towards a multi-layer architecture for multi-modal rendering of expressive actions Towards a multi-layer architecture for multi-modal rendering of expressive actions Giovanni (de) Poli, Federico Avanzini, Antonio Rodà, Luca Mion, Gianluca D Inca, Cosmo Trestino, Carlo (de) Pirro, Annie

More information

1. Use interesting materials and/or techniques. Title: Medium: Comments:

1. Use interesting materials and/or techniques. Title: Medium: Comments: ART CAN! Find pieces that match these aspects of Contemporary Art. 1. Use interesting materials and/or techniques. Title: Medium: Comments: 2. Express emotions without relying on recognizable images. Title:

More information

A Comparison between Continuous Categorical Emotion Responses and Stimulus Loudness Parameters

A Comparison between Continuous Categorical Emotion Responses and Stimulus Loudness Parameters A Comparison between Continuous Categorical Emotion Responses and Stimulus Loudness Parameters Sam Ferguson, Emery Schubert, Doheon Lee, Densil Cabrera and Gary E. McPherson Creativity and Cognition Studios,

More information

F r o m M o d e t o E m o t i o n i n Musical Communication. S t e v e n B r o w n M c M a s t e r U n i v e r s i t y

F r o m M o d e t o E m o t i o n i n Musical Communication. S t e v e n B r o w n M c M a s t e r U n i v e r s i t y F r o m M o d e t o E m o t i o n i n Musical Communication S t e v e n B r o w n M c M a s t e r U n i v e r s i t y Appraisal theories of emotion Appraisal theories of emotion Emotions are ABOUT something.

More information

Gestalt, Perception and Literature

Gestalt, Perception and Literature ANA MARGARIDA ABRANTES Gestalt, Perception and Literature Gestalt theory has been around for almost one century now and its applications in art and art reception have focused mainly on the perception of

More information

Theatre of the Mind (Iteration 2) Joyce Ma. April 2006

Theatre of the Mind (Iteration 2) Joyce Ma. April 2006 Theatre of the Mind (Iteration 2) Joyce Ma April 2006 Keywords: 1 Mind Formative Evaluation Theatre of the Mind (Iteration 2) Joyce

More information

Music Mood Classification - an SVM based approach. Sebastian Napiorkowski

Music Mood Classification - an SVM based approach. Sebastian Napiorkowski Music Mood Classification - an SVM based approach Sebastian Napiorkowski Topics on Computer Music (Seminar Report) HPAC - RWTH - SS2015 Contents 1. Motivation 2. Quantification and Definition of Mood 3.

More information

EXPLORING EXPRESSIVE PERFORMANCE TRAJECTORIES: SIX FAMOUS PIANISTS PLAY SIX CHOPIN PIECES

EXPLORING EXPRESSIVE PERFORMANCE TRAJECTORIES: SIX FAMOUS PIANISTS PLAY SIX CHOPIN PIECES EXPLORING EXPRESSIVE PERFORMANCE TRAJECTORIES: SIX FAMOUS PIANISTS PLAY SIX CHOPIN PIECES Werner Goebl 1, Elias Pampalk 1, and Gerhard Widmer 1;2 1 Austrian Research Institute for Artificial Intelligence

More information

Exploring Relationships between Audio Features and Emotion in Music

Exploring Relationships between Audio Features and Emotion in Music Exploring Relationships between Audio Features and Emotion in Music Cyril Laurier, *1 Olivier Lartillot, #2 Tuomas Eerola #3, Petri Toiviainen #4 * Music Technology Group, Universitat Pompeu Fabra, Barcelona,

More information

Are there opposite pupil responses to different aspects of processing fluency?

Are there opposite pupil responses to different aspects of processing fluency? Are there opposite pupil responses to different aspects of processing fluency? Sophie G. Elschner & Ronald Hübner 60 th TeaP, Marburg, March 12 th 2018 Types of Processing Fluency Processing Fluency The

More information

Sentiment Extraction in Music

Sentiment Extraction in Music Sentiment Extraction in Music Haruhiro KATAVOSE, Hasakazu HAl and Sei ji NOKUCH Department of Control Engineering Faculty of Engineering Science Osaka University, Toyonaka, Osaka, 560, JAPAN Abstract This

More information

Music, Timbre and Time

Music, Timbre and Time Music, Timbre and Time Júlio dos Reis UNICAMP - julio.dreis@gmail.com José Fornari UNICAMP tutifornari@gmail.com Abstract: The influence of time in music is undeniable. As for our cognition, time influences

More information

Manipulating Greek musical modes and tempo affects perceived musical emotion in musicians and nonmusicians

Manipulating Greek musical modes and tempo affects perceived musical emotion in musicians and nonmusicians Volume 44 (2) 84-181 February 2011 doi: 10.1590/S0100-879X2010007500148 Braz J Med Biol Res, F ebruary 2011, Volume 44(2) 165-172 Manipulating Greek musical modes and tempo affects perceived musical emotion

More information

Educational Objectives

Educational Objectives Evocative Approaches to Change Workshop 28 Jeffrey K. Zeig, Ph.D. Educational Objectives Describe the function of metaphor in psychotherapy. Given a patient, design an experiential approach. Indicate when

More information

Real-Time Control of Music Performance

Real-Time Control of Music Performance Chapter 7 Real-Time Control of Music Performance Anders Friberg and Roberto Bresin Department of Speech, Music and Hearing, KTH, Stockholm About this chapter In this chapter we will look at the real-time

More information

Perception and Sound Design

Perception and Sound Design Centrale Nantes Perception and Sound Design ENGINEERING PROGRAMME PROFESSIONAL OPTION EXPERIMENTAL METHODOLOGY IN PSYCHOLOGY To present the experimental method for the study of human auditory perception

More information

Bi-Modal Music Emotion Recognition: Novel Lyrical Features and Dataset

Bi-Modal Music Emotion Recognition: Novel Lyrical Features and Dataset Bi-Modal Music Emotion Recognition: Novel Lyrical Features and Dataset Ricardo Malheiro, Renato Panda, Paulo Gomes, Rui Paiva CISUC Centre for Informatics and Systems of the University of Coimbra {rsmal,

More information

MODELING MUSICAL MOOD FROM AUDIO FEATURES AND LISTENING CONTEXT ON AN IN-SITU DATA SET

MODELING MUSICAL MOOD FROM AUDIO FEATURES AND LISTENING CONTEXT ON AN IN-SITU DATA SET MODELING MUSICAL MOOD FROM AUDIO FEATURES AND LISTENING CONTEXT ON AN IN-SITU DATA SET Diane Watson University of Saskatchewan diane.watson@usask.ca Regan L. Mandryk University of Saskatchewan regan.mandryk@usask.ca

More information

GCT535- Sound Technology for Multimedia Timbre Analysis. Graduate School of Culture Technology KAIST Juhan Nam

GCT535- Sound Technology for Multimedia Timbre Analysis. Graduate School of Culture Technology KAIST Juhan Nam GCT535- Sound Technology for Multimedia Timbre Analysis Graduate School of Culture Technology KAIST Juhan Nam 1 Outlines Timbre Analysis Definition of Timbre Timbre Features Zero-crossing rate Spectral

More information

Automatic Detection of Emotion in Music: Interaction with Emotionally Sensitive Machines

Automatic Detection of Emotion in Music: Interaction with Emotionally Sensitive Machines Automatic Detection of Emotion in Music: Interaction with Emotionally Sensitive Machines Cyril Laurier, Perfecto Herrera Music Technology Group Universitat Pompeu Fabra Barcelona, Spain {cyril.laurier,perfecto.herrera}@upf.edu

More information

MOTIVATION AGENDA MUSIC, EMOTION, AND TIMBRE CHARACTERIZING THE EMOTION OF INDIVIDUAL PIANO AND OTHER MUSICAL INSTRUMENT SOUNDS

MOTIVATION AGENDA MUSIC, EMOTION, AND TIMBRE CHARACTERIZING THE EMOTION OF INDIVIDUAL PIANO AND OTHER MUSICAL INSTRUMENT SOUNDS MOTIVATION Thank you YouTube! Why do composers spend tremendous effort for the right combination of musical instruments? CHARACTERIZING THE EMOTION OF INDIVIDUAL PIANO AND OTHER MUSICAL INSTRUMENT SOUNDS

More information

The Role of Time in Music Emotion Recognition: Modeling Musical Emotions from Time-Varying Music Features

The Role of Time in Music Emotion Recognition: Modeling Musical Emotions from Time-Varying Music Features The Role of Time in Music Emotion Recognition: Modeling Musical Emotions from Time-Varying Music Features Marcelo Caetano 1, Athanasios Mouchtaris 1,2, and Frans Wiering 3 1 Institute of Computer Science,

More information

Information Theory Applied to Perceptual Research Involving Art Stimuli

Information Theory Applied to Perceptual Research Involving Art Stimuli Marilyn Zurmuehlen Working Papers in Art Education ISSN: 2326-7070 (Print) ISSN: 2326-7062 (Online) Volume 2 Issue 1 (1983) pps. 98-102 Information Theory Applied to Perceptual Research Involving Art Stimuli

More information

WRITING PROMPTS AND ACTIVITIES FOR VISUAL ART ENGAGEMENT

WRITING PROMPTS AND ACTIVITIES FOR VISUAL ART ENGAGEMENT WRITING PROMPTS AND ACTIVITIES FOR VISUAL ART ENGAGEMENT To book a guided tour at the Halsey Institute: (843) 953-5957 HalseyTours@cofc.edu halsey.cofc.edu/learn DISCOVERING MEANING Using the questions

More information

Music Emotion Recognition. Jaesung Lee. Chung-Ang University

Music Emotion Recognition. Jaesung Lee. Chung-Ang University Music Emotion Recognition Jaesung Lee Chung-Ang University Introduction Searching Music in Music Information Retrieval Some information about target music is available Query by Text: Title, Artist, or

More information

EXPECTANCY AND ATTENTION IN MELODY PERCEPTION

EXPECTANCY AND ATTENTION IN MELODY PERCEPTION EXPECTANCY AND ATTENTION IN MELODY PERCEPTION W. Jay Dowling University of Texas at Dallas This article offers suggestions for operational definitions distinguishing between attentional vs. expectancy

More information

Quality of Music Classification Systems: How to build the Reference?

Quality of Music Classification Systems: How to build the Reference? Quality of Music Classification Systems: How to build the Reference? Janto Skowronek, Martin F. McKinney Digital Signal Processing Philips Research Laboratories Eindhoven {janto.skowronek,martin.mckinney}@philips.com

More information

A Need for Universal Audio Terminologies and Improved Knowledge Transfer to the Consumer

A Need for Universal Audio Terminologies and Improved Knowledge Transfer to the Consumer A Need for Universal Audio Terminologies and Improved Knowledge Transfer to the Consumer Rob Toulson Anglia Ruskin University, Cambridge Conference 8-10 September 2006 Edinburgh University Summary Three

More information

Discovering GEMS in Music: Armonique Digs for Music You Like

Discovering GEMS in Music: Armonique Digs for Music You Like Proceedings of The National Conference on Undergraduate Research (NCUR) 2011 Ithaca College, New York March 31 April 2, 2011 Discovering GEMS in Music: Armonique Digs for Music You Like Amber Anderson

More information

Piano Teacher Program

Piano Teacher Program Piano Teacher Program Associate Teacher Diploma - B.C.M.A. The Associate Teacher Diploma is open to candidates who have attained the age of 17 by the date of their final part of their B.C.M.A. examination.

More information

The role of texture and musicians interpretation in understanding atonal music: Two behavioral studies

The role of texture and musicians interpretation in understanding atonal music: Two behavioral studies International Symposium on Performance Science ISBN 978-2-9601378-0-4 The Author 2013, Published by the AEC All rights reserved The role of texture and musicians interpretation in understanding atonal

More information

TOWARD AN INTELLIGENT EDITOR FOR JAZZ MUSIC

TOWARD AN INTELLIGENT EDITOR FOR JAZZ MUSIC TOWARD AN INTELLIGENT EDITOR FOR JAZZ MUSIC G.TZANETAKIS, N.HU, AND R.B. DANNENBERG Computer Science Department, Carnegie Mellon University 5000 Forbes Avenue, Pittsburgh, PA 15213, USA E-mail: gtzan@cs.cmu.edu

More information

TOWARDS AFFECTIVE ALGORITHMIC COMPOSITION

TOWARDS AFFECTIVE ALGORITHMIC COMPOSITION TOWARDS AFFECTIVE ALGORITHMIC COMPOSITION Duncan Williams *, Alexis Kirke *, Eduardo Reck Miranda *, Etienne B. Roesch, Slawomir J. Nasuto * Interdisciplinary Centre for Computer Music Research, Plymouth

More information

Secrets To Better Composing & Improvising

Secrets To Better Composing & Improvising Secrets To Better Composing & Improvising By David Hicken Copyright 2017 by Enchanting Music All rights reserved. No part of this document may be reproduced or transmitted in any form, by any means (electronic,

More information

Tempo and Beat Analysis

Tempo and Beat Analysis Advanced Course Computer Science Music Processing Summer Term 2010 Meinard Müller, Peter Grosche Saarland University and MPI Informatik meinard@mpi-inf.mpg.de Tempo and Beat Analysis Musical Properties:

More information

Concert halls conveyors of musical expressions

Concert halls conveyors of musical expressions Communication Acoustics: Paper ICA216-465 Concert halls conveyors of musical expressions Tapio Lokki (a) (a) Aalto University, Dept. of Computer Science, Finland, tapio.lokki@aalto.fi Abstract: The first

More information

Modeling expressiveness in music performance

Modeling expressiveness in music performance Chapter 3 Modeling expressiveness in music performance version 2004 3.1 The quest for expressiveness During the last decade, lot of research effort has been spent to connect two worlds that seemed to be

More information

Emotional Remapping of Music to Facial Animation

Emotional Remapping of Music to Facial Animation Preprint for ACM Siggraph 06 Video Game Symposium Proceedings, Boston, 2006 Emotional Remapping of Music to Facial Animation Steve DiPaola Simon Fraser University steve@dipaola.org Ali Arya Carleton University

More information

iafor The International Academic Forum

iafor The International Academic Forum A Study on the Core Concepts of Environmental Aesthetics Curriculum Ya-Ting Lee, National Pingtung University, Taiwan The Asian Conference on Arts and Humanities 2017 Official Conference Proceedings Abstract

More information

BRAIN-ACTIVITY-DRIVEN REAL-TIME MUSIC EMOTIVE CONTROL

BRAIN-ACTIVITY-DRIVEN REAL-TIME MUSIC EMOTIVE CONTROL BRAIN-ACTIVITY-DRIVEN REAL-TIME MUSIC EMOTIVE CONTROL Sergio Giraldo, Rafael Ramirez Music Technology Group Universitat Pompeu Fabra, Barcelona, Spain sergio.giraldo@upf.edu Abstract Active music listening

More information