Technical Reports
HPL-2010-96
Click here for full text:
Enabling Genuine Eye Contact and Accurate Gaze in Remote Collaboration
Tan, Kar-Han; Robinson, Ian N.; Culbertson, Bruce; Apostolopoulos, John
HP Laboratories
HPL-2010-96
Keyword(s): eye contact, gaze awareness, remote collaboration, natural interaction, immersive experiences
Abstract: Conventional telepresence systems allow remote users to see one another and interact with shared media and documents, but users cannot make eye contact, and gaze awareness with respect to shared media and documents is lost. In this paper we describe a remote collaboration system based on a see-through display to create an experience where local and remote users are seemingly separated only by a vertical sheet of glass. Users can see each other and media displayed on the shared surface. Face detectors on the local and remote video streams are used to introduce an offset in the video display so as to bring the local user's face, the local camera, and the remote user's face image into collinearity. This ensures that when the local user looks at the remote user's image, the camera behind the see-through display captures an image with the 'Mona Lisa effect', where the eyes of an image appears to follow the viewer. Experiments show that our system is capable of capturing and delivering realistic, genuine eye contact as well as accurate gaze awareness with respect to shared media.
6 Pages
Additional Publication Information: Presented at IEEE International Conference on Multimedia and Expo, July 19, 2010
External Posting Date: August 21, 2010 [Fulltext]. Approved for External Publication
Internal Posting Date: August 21, 2010 [Fulltext]