Mining Topic Signals from Text
MetadataShow full item record
This work aims at studying the effect of word position in text on understanding and tracking the content of written text. In this thesis we present two uses of word position in text: topic word selectors and topic flow signals. The topic word selectors identify important words, called <i>topic words</i>, by their spread through a text. The underlying assumption here is that words that repeat across the text are likely to be more relevant to the main topic of the text than ones that are concentrated in small segments. Our experiments show that manually selected keywords correspond more closely to topic words extracted using these selectors than to words chosen using more traditional indexing techniques. This correspondence indicates that topic words identify the topical content of the documents more than words selected using the traditional indexing measures that do not utilize word position in text. The second approach to applying word position is through <i>topic flow signals</i>. In this representation, words are replaced by the topics to which they refer. The flow of any one topic can then be traced throughout the document and viewed as a signal that rises when a word relevant to the topic is used and falls when an irrelevant word occurs. To reflect the flow of the topic in larger segments of text we use a simple smoothing technique. The resulting smoothed signals are shown to be correlated to the ideal topic flow signals for the same document. Finally, we characterize documents using the importance of their topic words and the spread of these words in the document. When incorporated into a Support Vector Machine classifier, this representation is shown to drastically reduce the vocabulary size and improve the classifier's performance compared to the traditional word-based, vector space representation.
Cite this work
Reem Khalil Al-Halimi (2003). Mining Topic Signals from Text. UWSpace. http://hdl.handle.net/10012/1165
Showing items related by title, author, creator and subject.
Working Towards Collaborative Archaeology: Exploring Indigenous Perspectives on Archaeological Topics and Research Questions in Nain, Labrador Piskor, Ashley (University of Waterloo, 2015-01-12)Archaeology is one avenue that people use to understand the past. It is through these contemporary understandings of the past that cultural identities are created and maintained. Unfortunately, Indigenous perspectives have ...
Automatic Document Topic Identification Using Hierarchical Ontology Extracted from Human Background Knowledge Hassan, Mostafa (University of Waterloo, 2013-02-22)The rapid growth in the number of documents available to various end users from around the world has led to a greatly increased need for machine understanding of their topics, as well as for automatic grouping of related ...
Alqawlaq, Samih (University of Waterloo, 2013-01-29)Glaucoma is a group of optic nerve degenerative diseases, which leads to gradual and permanent vision loss. Recent developments in the field of gene therapy have proposed increasingly promising treatments for glaucoma, in ...