Andrew Fitzhugh, HP Labs

The Virgil Browser

Quick tour of the browser

Page last updated: Monday, May 08, 2006 22:41:37 -0700

Contents

Overview

Users browse their photos and related information while telling or composing stories of their personal life experiences, all the while maintaining an idea of time, place, and people.  Stories consist of more than answers to the simple questions When?  Where? and Who?, but that information provides a framework from which a rich narratives are created.  Virgil is a photo browser that allows a user to browse his personal photo collection and related information while maintaining and exploiting the current context (time, location, and personal identity).

The first time you run Virgil:

NOTE: Virgil will never modify your original photos.

Context

The overview mentions that Virgil maintains a current context of time, location, and people.  Any plugin can change the current context or respond to changes in it, and the changes can be to any part of the context (e.g., just time or just location).  The context indicator is a control (a plugin, too) visible at the top of the application that always displays a summary of the current context:

To the left are the starting and ending times of the current time range.  To the right are the total number of photos and the number of them that are selected.  In the middle is the location, including a text description from Microsoft's TerraService as well as the latitude and longitude.  (Any of this text can be selected, dragged & dropped to annotate a photo).

Thumbs viewer

The Thumbs tab shows time clusters on the left, and corresponding photo thumbnails on the right.  It will scroll quickly through thousands of thumbnails.

Each thumbnail may display one or more markings below it.  The letters T, D, and K indicate title, description and keyword(s) respectively, while a green dot indicates a location.

Image viewer

The image view above shows the current photo above a list of its properties.

WebMap plugin

This plugin uses the Google Maps web service to map geotagged photos and to provide a visual method to assign a location property to one or more photos.  The map view will update dynamically to reflect the current Virgil location context, which in turn may be set by selecting a geotagged photo, time cluster, or via another plugin.

Below is a sample of the hybrid mode:

WebMap bugs that I'm working to fix:

InfoBrowser plugin

The InfoBrowser plugin tries to automatically find information on the web that is related to the current photo.  It constructs queries automatically based on the current context.

Flickr plugin

This plugin demonstrates how an online photo service can be integrated with Virgil.  Flickr has an open web API and metadata support that helps Virgil to exploit the current context (time, location, person) to make discovery of related information simple.

As the Virgil context changes, matching results from Flickr will be updated dynamically (subject to the filter settings on the right).  This plugin makes it simple for multiple friends or family members to find and retrieve each others' photos that correspond to a shared experience.

The upload tab allows the user to collect local photos from the Thumbs control by dragging and dropping Virgil thumbnails.  Each photo's properties can be reviewed and modified, the online Flickr permissions can be specified, and then they can be uploaded to the current Flickr account. 

Notes:

Google Earth

As noted above under WebMap plugin, if you right click on a POI marker in the Google Maps view you can choose to view the photo locations in Google Earth.  This allows dynamic 3-D browsing of the world via high resolution aerial and/or satellite imagery. 

Virgil creates a temporary .KML (Keyhole Markup Language) file containing all the geotagged photos in the current context, and then Virgil has Windows open the file with the currently registered handler for .KML files.  The free, basic version of Google Earth works fine for this purpose.  Google Earth will pan to the average location upon loading the KML, and the photo locations will be marked with camera icons.  Some metadata is included in the POI markers, but no image thumbnails (yet).

There is a plugin for NASA's World Wind that embeds the application within Virgil, but it has certain limitations (it does not plot photos in the world, and it consumes a lot of CPU and memory).