1. Главная
  2. Ресурсы
  3. Библиотечный поиск
Analysis of lexicalsignatures forimproving informationpersistence on theWorld Wide Web Seung-Taek ParkDavid M. PennockC. Lee Giles2004 год

Analysis of lexical signatures for improving information persistence on the World Wide Web
статья из журнала

Полный текстСтраница публикацииПубликация в OpenAlex
Аннотация: A <i>lexical signature</i> (LS) consisting of several key words from a Web document is often sufficient information for finding the document later, even if its URL has changed. We conduct a large-scale empirical study of nine methods for generating lexical signatures, including Phelps and Wilensky's original proposal (PW), seven of our own static variations, and one new dynamic method. We examine their performance on the Web over a 10-month period, and on a TREC data set, evaluating their ability to both (1) uniquely identify the original (possibly modified) document, and (2) locate other relevant documents if the original is lost. Lexical signatures chosen to minimize document frequency (DF) are good at unique identification but poor at finding relevant documents. PW works well on the relatively small TREC data set, but acts almost identically to DF on the Web, which contains billions of documents. Term-frequency-based lexical signatures (TF) are very easy to compute and often perform well, but are highly dependent on the ranking system of the search engine used. The term-frequency inverse-document-frequency- (TFIDF-) based method and hybrid methods (which combine DF with TF or TFIDF) seem to be the most promising candidates among static methods for generating effective lexical signatures. We propose a dynamic LS generator called <i>Test & Select</i> (TS) to mitigate LS conflict. TS outperforms all eight static methods in terms of both extracting the desired document and finding relevant information, over three different search engines. All LS methods show significant performance degradation as documents in the corpus are edited.
Год издания: 2004
Авторы: Seung-Taek Park, David M. Pennock, C. Lee Giles, Robert Krovetz
Издательство: Association for Computing Machinery
Источник: ACM transactions on office information systems
Ключевые слова: Web Data Mining and Analysis, Web visibility and informetrics, Information Retrieval and Search Behavior
Другие ссылки: ACM transactions on office information systems (HTML)
CiteSeer X (The Pennsylvania State University) (PDF)
CiteSeer X (The Pennsylvania State University) (HTML)