A scalable and fault-tolerant architecture for distributed web-resource discovery

Tools

Fongen, A. and Eliassen, F. and Ferguson, I. and Stobart, S. and Tait, J.; (2002) A scalable and fault-tolerant architecture for distributed web-resource discovery. In: Proceedings of the 14th IASTED International Conference on Parallel and Distributed Computing and Systems (PDCS 2002). ACTA Press, Cambridge, USA.

[thumbnail of strathprints002598.pdf]
Preview
 PDF. Filename: strathprints002598.pdf
Download (274kB)| Preview

Abstract

Most Internet search engines are built on a centralised design, and will therefore not cope with the expected future growth in information and query volume. A distributed approach to Internet resource discovery seems necessary. Many distributed designs have been proposed, but their scaleability is largely unknown. We propose a distributed design based on the use of classified metadata, which can be proven to be extremely scaleable, and has interesting fault-tolerant properties. We will show the principles of this design, called the Content- Sensitive Infrastructure (CSI), and demonstrate its properties through formal analysis and simulation.

CORE (COnnecting REpositories)