Creating Prosodic Synchrony for a Robot Co-Player in a Speech-Controlled Game for Children
We report an approach to creating on-line acoustic synchrony by using a dynamic Bayesian network learned from prior recordings of child-child play to select from a predfinened space of robot speech in response to real-time measurement of the child's prosodic features.
Data-Driven Ghosting using Deep Imitation Learning
Motivated by the original “ghosting” work, we showcase an automatic “data-driven ghosting” method using advanced machine learning methodologies applied to a season’s worth of tracking data from a recent professional league in soccer.
Methods for Studying Group Interactions in HRI
We developed four different protocols to investigate human spatial behavior or trust in robots.
Cheng Zhang
Semi-Situated Learning of Verbal and Nonverbal Content for Repeated Human-Robot Interaction
We present PIP, an agent that crowdsources its own multimodal language behavior using a method we call semi-situated learning.
Deep Static and Dynamic Level Analysis: A Study on Infinite Mario
We introduce a static-dynamic scale to categorize level analysis strategies, which captures the extent that the analysis depends on player simulation.
PLOTSHOT: Generating Discourse-constrained Stories around Photos
In this paper, we propose a novel story generator, PLOTSHOT, capable of reasoning over discourse materials during fabula generation such that these materials meaningfully constrain the development of a causally and intentionally coherent story.
Multi-party Language Interaction in a Fast-paced Game Using Multi-keyword Spotting
This technology can enable others to create novel multi-party interactions for entertainment where a limited number of keywords has to be recognized.
The Role of Phonological Processes and Acoustic Confusability in Phone Errors in Children’s ASR
This paper examines the extent to which computer speech recognition errors for children’s speech can be attributed to common phonological effects associated with language acquisition.
An Acoustic Analysis of Child-Child and Child-Robot Interactions for Understanding Engagement during Speech-Controlled Computer Games
Our results indicate that the considered acoustic features are related to engagement levels for both the child-child and child-robot interaction.
Page 4 of 11