Remote evaluation of remote console information retrieval system (NASA/RECON)

摘要

The technique is described for NASA user evaluation. It consists of sending out an evaluation form with each literature search. The results are presented which are derived from a compilation of user responses. In an eleven-month period in which evaluation forms went out with 3,001 searches, 33.6% of the forms were completed and returned. The returns showed that 88.5% of the respondents found the searches suitable to their needs, 81% learned of valuable new references from the searches, and 93.5% received the searches in time to meet their needs. The significance of relevance or precision ratio in relation to user satisfaction is discussed, and an extrapolation from user responses resulted in a relevance ratio of 49.3%. Some of the general comments found in the responses are analyzed as indicators of what the users expected from the information retrieval service.