Interactive Virtual Child (IVC)

We created an interactive art installation, called "FacePlay", with a the goal of demonstrating a new kind of user interface in a playful manner for children and adults alike. At the center of this application is a virtual baby face reacts to the visitors with its elaborate repertoire of facial expressions. the VHI system was configured to use two cameras placed at different heights. The first one is at the same level as that of a child's head sitting on top of the monitor showing the life size digital baby face. The second one is located higher to be able to collect images from the accompanying adults. The system runs face recognition algorithms on both of these image streams to determine not only if there are users to interact with, but also whether it is a child alone, with an accompanying adult or just a grown up standing in front of the installation. Based on this information the VHI uses different strategies (e.g. child like behavior or more adult actions) to address the people standing in front. The facial expressions of the digital character are linked to the faces as they move in within the field of view of the cameras. This from of non-verbal feedback based on visual perception is supplemented by the tactile subsystem in the form of a touch screen located in front of the virtual face. As the child reaches for the virtual baby's face, it notices when being touched, reacts accordingly and lets the user put finger paint on by changing the color and properties of the underlying skin.