COMPUTER VISION METHOD FOR GUITARIST FINGERING RETRIEVAL

Publication Type:

Conference Paper

Source:

SMC Conference 2006 (2006)

URL:

files/proceedings/2006/1-Burns.pdf

Abstract:

This article presents a method to visually detect and recognize fingering gestures of the left hand of a guitarist. This method has been developed following preliminary manual and automated analysis of video recordings of a guitarist. These first analyses led to some important findings about the design methodology of such a system, namely the focus on the effective gesture, the consideration of the action of each individual finger, and a recognition system not relying on comparison against a knowledge base of previously learned fingering positions. Motivated by these results, studies on three important aspects of a complete fingering system were conducted. One study was on finger tracking, another on strings and frets detection, and the last on movement segmentation. Finally, these concepts were integrated into a prototype and a system for left hand fingering detection was developed.