ANALYZING GESTURE AND SOUND SIMILARITIES WITH A HMM-BASED DIVERGENCE MEASURE

Publication Type:

Conference Paper

Source:

SMC Conference 2010 (2010)

URL:

files/proceedings/2010/9.pdf

Abstract:

In this paper we propose a divergence measure which is applied to the analysis of the relationships between gesture and sound. Technically, the divergence measure is defined based on a Hidden Markov Model (HMM) that is used to model the time profile of sound descriptors. Particularly, we used this divergence to analyze the results of experi- ments where participants were asked to perform physical gestures while listening to specific sounds. We found that the proposed divergence is able to measure global and local differences in either time alignment or amplitude between gesture and sound descriptors.