High-level Thesaurus (HILT) Phase III [Final Report] : Evaluation Report

Nicholson, Dennis and McCulloch, Emma and Macgregor, George (2006) High-level Thesaurus (HILT) Phase III [Final Report] : Evaluation Report. [Report]

[img]
Preview
Text (Nicholson-etal-HILT-2006-High-level-thesaurus-HILT-phase-III-evaluation-report)
Nicholson_etal_HILT_2006_High_level_thesaurus_HILT_phase_III_evaluation_report.pdf
Final Published Version
License: Creative Commons Attribution 3.0 logo

Download (1MB)| Preview

    Abstract

    An evaluation stage of the HILT Phase III pilot M2M demonstrator was to be undertaken following completion of the main development work (November/December 2006). The aim was to determine whether the pilot demonstrator operates as specified in the requirements document and, hence, whether it correctly delivers the functionality needed to meet the five use cases (devised during the preceding feasibility study). Outcomes will be used to inform the system refinement process, due to occur in January 2007. Six SOAP functions were designed to meet the functionality required by each of the use cases, either singly or in combination, and the working pilot is best tested by examining whether each part of the system architecture (see Figure 1) operates as specified in the requirements document when any given one of the functions is called. This report documents the use cases being addressed, the nature of the functions designed to meet the use cases, how each part of the system is required to operate when a function is called, methodologies determined to assess the satisfactory performance of functions, and associated results. It is not the intention of this evaluation to study the quality of mappings or retrieval performance. Results presented will enable the identification of issues or errors within the system as it is currently implemented (or requirements as currently specified) and any additional requirements for development beyond Phase III will be noted.