A scalable and fault-tolerant architecture for distributed web-resource discovery

Fongen, A. and Eliassen, F. and Ferguson, I. and Stobart, S. and Tait, J. (2002) A scalable and fault-tolerant architecture for distributed web-resource discovery. In: Proceedings of the 14th IASTED International Conference on Parallel and Distributed Computing and Systems (PDCS 2002). ACTA Press, Cambridge, USA.

[img]
Preview
PDF (strathprints002598.pdf)
strathprints002598.pdf

Download (274kB)| Preview

    Abstract

    Most Internet search engines are built on a centralised design, and will therefore not cope with the expected future growth in information and query volume. A distributed approach to Internet resource discovery seems necessary. Many distributed designs have been proposed, but their scaleability is largely unknown. We propose a distributed design based on the use of classified metadata, which can be proven to be extremely scaleable, and has interesting fault-tolerant properties. We will show the principles of this design, called the Content- Sensitive Infrastructure (CSI), and demonstrate its properties through formal analysis and simulation.