2006•Unpublished venueRequires access
Cross-modal coordination of expressive strength between voice and gesture for personified media
Tomoko Yonezawa, Noriko Suzuki, Shinji Abe, Kenji Mase, Kiyoshi Kogure
Open publisher page 6 citations
Abstract
The aim of this paper is to clarify the relationship between the expressive strengths of gestures and voice for embodied and personified interfaces. We conduct perceptual tests using a puppet interface, while controlling singing-voice expressions, to empirically determine the naturalness and strength of various combinations of gesture and voice. The results show that (1) the strength of cross-modal perception is affected more by gestural expression than by the expressions of a singing voice, and (2) the appropriateness of cross-modal perception is affected by expressive combinations between singing voice and gestures in personified expressions. As a promising solution, we propose balancing a singing voice and gestural expressions by expanding and correcting the width and shape of the curve of expressive strength in the singing voice.