Full Text Available

Note: Clicking the button above will open the full text document at the original institutional repository in a new window.

A hybrid scavenger grid approach to intranet search

Includes bibliographical references (p. 93-98).

Saved in:
Bibliographic Details
Main Author: Nakashole, Ndapandula
Other Authors: Suleman, Hussein
Format: Thesis
Language:English
Published: Department of Computer Science 2014
Subjects:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1867613256523186177
access_status_str Open Access
author Nakashole, Ndapandula
author2 Suleman, Hussein
author_browse Nakashole, Ndapandula
Suleman, Hussein
author_facet Suleman, Hussein
Nakashole, Ndapandula
author_sort Nakashole, Ndapandula
collection Thesis
description Includes bibliographical references (p. 93-98).
format Thesis
id oai:open.uct.ac.za:11427/8977
institution University of Cape Town (South Africa)
language eng
last_indexed 2026-06-10T12:33:15.376Z
license_str Not specified — see source repository
provenance_str_mv Harvested via OAI-PMH from UCTD — University of Cape Town Open Access Repository
publishDate 2014
publishDateRange 2014
publishDateSort 2014
publisher Department of Computer Science
publisherStr Department of Computer Science
record_format dspace
source_str UCTD — University of Cape Town Open Access Repository
spelling oai:open.uct.ac.za:11427/8977 A hybrid scavenger grid approach to intranet search Nakashole, Ndapandula Suleman, Hussein Computer Science Includes bibliographical references (p. 93-98). According to a 2007 global survey of 178 organisational intranets, 3 out of 5 organisations are not satisfied with their intranet search services. However, as intranet data collections become large, effective full-text intranet search services are needed more than ever before. To provide an effective full-text search service based on current information retrieval algorithms, organisations have to deal with the need for greater computational power. Hardware architectures that can scale to large data collections and can be obtained and maintained at a reasonable cost are needed. Web search engines address scalability and cost-effectiveness by using large-scale centralised cluster architectures. The scalability of cluster architectures is evident in the ability of Web search engines to respond to millions of queries within a few seconds while searching very large data collections. Though more cost-effective than high-end supercomputers, cluster architectures still have relatively high acquisition and maintenance costs. Where information retrieval is not the core business of an organisation, a cluster-based approach may not be economically viable. A hybrid scavenger grid is proposed as an alternative architecture - it consists of a combination of dedicated and dynamic resources in the form of idle desktop workstations. From the dedicated resources, the architecture gets predictability and reliability whereas from the dynamic resources it gets scalability. An experimental search engine was deployed on a hybrid scavenger grid and evaluated. Test results showed that the resources of the grid can be organised to deliver the best performance by using the optimal number of machines and scheduling the optimal combination of tasks that the machines perform. A system-efficiency and cost-effectiveness comparison of a grid and a multi-core machine showed that for workloads of modest to large sizes, the grid architecture delivers better throughput per unit cost than the multi-core, at a system efficiency that is comparable to that of the multi-core. The study has shown that a hybrid scavenger grid is a feasible search engine architecture that is cost-effective and scales to medium- to large-scale data collections. 2014-10-30T13:54:10Z 2014-10-30T13:54:10Z 2009 Master Thesis Masters MSc http://hdl.handle.net/11427/8977 eng application/pdf Department of Computer Science Faculty of Science University of Cape Town
spellingShingle Computer Science
Nakashole, Ndapandula
A hybrid scavenger grid approach to intranet search
thesis_degree_str Master's
title A hybrid scavenger grid approach to intranet search
title_full A hybrid scavenger grid approach to intranet search
title_fullStr A hybrid scavenger grid approach to intranet search
title_full_unstemmed A hybrid scavenger grid approach to intranet search
title_short A hybrid scavenger grid approach to intranet search
title_sort hybrid scavenger grid approach to intranet search
topic Computer Science
url http://hdl.handle.net/11427/8977
work_keys_str_mv AT nakasholendapandula ahybridscavengergridapproachtointranetsearch
AT nakasholendapandula hybridscavengergridapproachtointranetsearch