20 July 2001 Multimedia browser (MMB)
Author Affiliations +
Proceedings Volume 4519, Internet Multimedia Management Systems II; (2001) https://doi.org/10.1117/12.434270
Event: ITCom 2001: International Symposium on the Convergence of IT and Communications, 2001, Denver, CO, United States
Current well-known web browsers are limited to graphical User Interfaces (GUIs) that are geared towards an iconic or hieroglyphic system of communication. Modern speech-enabled user interfaces are built over GUIs and apply a 'Say What You See' (SWYS) paradigm. GUIs and SWYS fail to satisfy the user's need for natural language multimedia interfaces. The first voice based OS interfaces such as the Vocal/Auditory Multimedia Browser (VAMB) combined a spoken quasi-natural language input with a graphical display, audio and verbal output and supported a rudimentary browsing capability. The MultiMedia Browser (MMB) improves VAMB's speech recognition capabilities and includes a complete web browser with advanced page navigation. MMB applies a What You Say Is What You Get (WYSIWYG) paradigm that utilizes both an Associative Calculus Environment (ACE) and Dynamic Hierarchal Limited Vocabulary (DHLV). The associative calculus is a set of rules that specifies how sentences using the ACE syntax are to be interpreted relative to graphical displays. DHLV dynamically minimizes the contents of the vocabulary pool depending on the current multimedia configuration.
© (2001) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Adel I Salem, Adel I Salem, Jerry L. Potter, Jerry L. Potter, "Multimedia browser (MMB)", Proc. SPIE 4519, Internet Multimedia Management Systems II, (20 July 2001); doi: 10.1117/12.434270; https://doi.org/10.1117/12.434270


Spoken language interface for a network management system
Proceedings of SPIE (November 21 1999)
Visual human tutoring of image interpretation systems
Proceedings of SPIE (July 31 1990)
Multimedia communications: architectural alternatives
Proceedings of SPIE (February 29 1992)
Packetized Video On Magnet
Proceedings of SPIE (November 19 1986)

Back to Top