ARTIFICIAL SINGING WITH A WEBCAM MOUTH-CONTROLLER

Publication Type:

Conference Paper

Source:

SMC Conference 2005 (2005)

URL:

files/proceedings/2005/HapipisMiranda.pdf

Abstract:

We present a device to control a singing synthesiser with mouth movements captured with a mini web camera. The device comprises a mini web camera connected to a computer, which extracts a number of mouth movement parameters. These parameters are sent out as MIDI messages to another computer running a formant synthesiser, which produces singing according to the movements of the mouth of the subject in realtime. The paper gives a technical explanation of the vision system, the synthesiser and the control parameters. Our main motivation with this research is to enable people with speech or voice disorders to engage in singing activity.