Facilitating Subject Matter Expert (SME)-Built Knowledge Bases (KBS)

摘要

This report describes the efforts surrounding the Challenge Problem Development and Evaluation Management for DARPA's Rapid Knowledge Formation (RKF) program. The goal of RKF was the development of technology by which subject matter experts (SMEs) can develop knowledge bases (KBs) directly, without the intervention of professional knowledge engineers (KEs). IET's primary responsibility under RKF during the first two years was qualitative and quantitative evaluation of RKF-developed technology with respect to challenge problems (CPs) that they developed and administered. RKF's annual evaluation cycle began with new CP discussions in the Fall PI meeting, with subsequent CP specification, and a major evaluation during the summer. This document refers to RKF's first evaluation year (ending Fall 2001) as RKF Y1 and to its second evaluation year (ending Fall 2002) as RKF Y2.