Human-Computer Interaction

We present freeform interactive loudspeakers for creating spatial sound experiences from a variety of surfaces.

We present Lumitrack, a novel motion tracking technology that uses projected structured patterns and linear optical sensors.

We describe the conceptual design, architecture, and implementation of a multimodal, robot-child dialogue system in a fast-paced, speech-controlled collaborative game.

We present initial findings from an experiment in which participants played Mafia, an established role-playing game, with our robot.

We present a retrospective view on our experience with small groups of more than 175 children (ages 4 to 10) playing versions of a language-based game hosted by an animated character.

We propose technology for designing and manufacturing interactive 3D printed speakers. With the proposed technology, sound reproduction can easily be integrated into various objects at the design stage and little assembly is required. The speaker can take the shape of anything from an abstract spiral to a rubber duck, opening new opportunities in product design.

An approach of rapid hologram generation for the realistic 3D image reconstruction based on the angular tiling concept is proposed, using a new graphic rendering approach integrated with a previously developed layer-based method for hologram calculation.

We demonstrate an interactive, human-powered energy harvesting system that converts a person's movements into electrical energy and then visible light. It explores the interaction of bodies, movement, materials, and electric power.

Our demonstration shows an interactive procedure for authoring haptic media content using the FE library, playing it back during interactions in the game, and broadcasting it to a group of guests.