Tuesday, May 11, 2010

IUI 2008 - Temporal semantic compression for video browsing

Temporal semantic compressoin for video browsing
By Brett Adams, Stewart Greenhill, & Svetha Venkatesh (Curtin University of Technology)

Summary:

The article discusses a new approach to display video streams with the Temporal Semantic Compression (TSC). A web browser with TSC grabs a video input and collects a "time based measure" on the video information. Next, it resamples the video dynamically to improve real time interaction.

Implementation

They have a designed a standard default video browsing widget with two features: compression control and context area. So, by manipulating the compression control, it will add or delete shots. An example of the compression, can be seen below on the movie, The Matrix.



Figure 4. Context overlay changes with compression,
centered on Escape Sequence: 94% Sequence bracketed
by two significant events; 80% Includes two sub-sequence
events, fire and escape on foot; 50% Detail includes dialog
giving rise to escape on foot; 0% Original video

From their trials, using the controls appears intuitive for the users. Also, it is planned to continue user testing on the browser.

Discussion:

I find this field to be interesting and informative. Anything that enhances the browser experience for the user, in my opinion, is a good thing. I will be interested in seeing if there are products similar using this approach today.

No comments:

Post a Comment