Mapping texts through dimensionality reduction and visualization techniques for interactive exploration of document collections

Alneu de Andrade Lopes; Rosane Minghim; Vinícius Melo; Fernando Vieira Paulovich

doi:10.1117/12.650899

16 January 2006 Mapping texts through dimensionality reduction and visualization techniques for interactive exploration of document collections

Alneu de Andrade Lopes, Rosane Minghim, Vinícius Melo, Fernando Vieira Paulovich

Author Affiliations +

Proceedings Volume 6060, Visualization and Data Analysis 2006; 60600T (2006) https://doi.org/10.1117/12.650899
Event: Electronic Imaging 2006, 2006, San Jose, California, United States

Abstract

The current availability of information many times impair the tasks of searching, browsing and analyzing information pertinent to a topic of interest. This paper presents a methodology to create a meaningful graphical representation of documents corpora targeted at supporting exploration of correlated documents. The purpose of such an approach is to produce a map from a document body on a research topic or field based on the analysis of their contents, and similarities amongst articles. The document map is generated, after text pre-processing, by projecting the data in two dimensions using Latent Semantic Indexing. The projection is followed by hierarchical clustering to support sub-area identification. The map can be interactively explored, helping to narrow down the search for relevant articles. Tests were performed using a collection of documents pre-classified into three research subject classes: Case-Based Reasoning, Information Retrieval, and Inductive Logic Programming. The map produced was capable of separating the main areas and approaching documents by their similarity, revealing possible topics, and identifying boundaries between them. The tool can deal with the exploration of inter-topics and intra-topic relationship and is useful in many contexts that need deciding on relevant articles to read, such as scientific research, education, and training.

Citation Download Citation

Alneu de Andrade Lopes, Rosane Minghim, Vinícius Melo, and Fernando Vieira Paulovich "Mapping texts through dimensionality reduction and visualization techniques for interactive exploration of document collections", Proc. SPIE 6060, Visualization and Data Analysis 2006, 60600T (16 January 2006); https://doi.org/10.1117/12.650899

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available