A multimodal system for public speaking with real time feedback
Dermody, Fiona and Sutherland, Alistair
(2015)
A multimodal system for public speaking with real time feedback.
In: International Conference on Multimodal Interaction, 9-13 Nov 2015, Seattle, USA.
ISBN 978-1-4503-3912-4
We have developed a multimodal prototype for public speaking
with real time feedback using the Microsoft Kinect. Effective
speaking involves use of gesture, facial expression, posture, voice
as well as the spoken word. These modalities combine to give the
appearance of self-confidence in the speaker. This initial
prototype detects body pose, facial expressions and voice. Visual
and text feedback is displayed in real time to the user using a
video panel, icon panel and text feedback panel. The user can also
set and view elapsed time during their speaking performance. Real
time feedback is displayed on gaze direction, body pose and
gesture, vocal tonality, vocal dysfluencies and speaking rate.
Item Type:
Conference or Workshop Item (Other)
Event Type:
Conference
Refereed:
Yes
Uncontrolled Keywords:
Multimodal Interface; Affective Computing; Human Computer
Interaction; Social Signal Processing; Public Speaking.