The Informedia group at Carnegie Mellon University has since 1994 been developing and evaluating surrogates,
summary interfaces, and visualizations for accessing digital video collections containing thousands of documents,
millions of shots, and terabytes of data. This paper reports on TRECVID 2005 and 2006 interactive search tasks
conducted with the Informedia system by users having no knowledge of Informedia or other video retrieval interfaces,
but being experts in analyst activities. Think-aloud protocols, questionnaires, and interviews were also conducted with
this user group to assess the contributions of various video summarization and browsing techniques with respect to
broadcast news test corpora. Lessons learned from these user interactions are reported, with recommendations on both
interface improvements for video retrieval systems and enhancing the ecological validity of video retrieval interface
evaluations.
The Informedia group at Carnegie Mellon University has since 1994 been developing and evaluating surrogates, summary interfaces, and visualizations for accessing digital video collections containing thousands of documents, millions of shots, and terabytes of data. This paper surveys the Informedia user studies that have taken place through the years, reporting on how these studies can provide a user pull complementing the technology push as automated video processing advances. The merits of discount usability techniques for iterative improvement and evaluation are presented, as well as the structure of formal empirical investigations with end users that have ecological validity while addressing the human computer interaction metrics of efficiency, effectiveness, and satisfaction. The difficulties in evaluating video summarization and browsing interfaces are discussed. Lessons learned from Informedia user studies are reported with respect to video summarization and browsing, ranging from the simplest portrayal of a single thumbnail to represent video stories, to collections of thumbnails in storyboards, to playable video skims, to video collages with multiple synchronized information perspectives.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.