Picture of scraped petri dish

Scrape below the surface of Strathprints...

Explore world class Open Access research by researchers at the University of Strathclyde, a leading technological university.

Explore

A scalable and fault-tolerant architecture for distributed web-resource discovery

Fongen, A. and Eliassen, F. and Ferguson, I. and Stobart, S. and Tait, J. (2002) A scalable and fault-tolerant architecture for distributed web-resource discovery. In: Proceedings of the 14th IASTED International Conference on Parallel and Distributed Computing and Systems (PDCS 2002). Acta Press, Cambridge, USA.

[img]
Preview
PDF (strathprints002598.pdf)
strathprints002598.pdf

Download (274kB) | Preview

Abstract

Most Internet search engines are built on a centralised design, and will therefore not cope with the expected future growth in information and query volume. A distributed approach to Internet resource discovery seems necessary. Many distributed designs have been proposed, but their scaleability is largely unknown. We propose a distributed design based on the use of classified metadata, which can be proven to be extremely scaleable, and has interesting fault-tolerant properties. We will show the principles of this design, called the Content- Sensitive Infrastructure (CSI), and demonstrate its properties through formal analysis and simulation.