Usability Evaluation of NLP-PIER: A Clinical Document Search Engine for Researchers

摘要

NLP-PIER (Natural Language Processing -Patient Information Extraction for Research) is a self-service platform with a search engine for clinical researchers to perform natural language processing (NLP) queries using clinical notes. We conducted user-centered testing of NLP-PIER's usability to inform future design decisions. Quantitative and qualitative data were analyzed. Our findings will be used to improve the usability of NLP-PIER. NLP-PIER was created to provide an accessible solution through a search interface to clinical researchers interested in or requiring access to clinical NLP capabilities of clinical documents [1]. The system has two interfaces: a full text search interface and a custom interface for searching Unified Medical Language System (UMLS) concepts [2]. We were interested in understanding potential design opportunities and user acceptance of NLP-PIER and to more broadly understand the needs of clinical researchers when using a self-service NLP tool.