Accelerating Conversational Agents Built With Off-the-Shelf Modularized Services

摘要

Today's common practice in developing conversational agents is pipelining off-the-shelf modularized services as ready-made building blocks. However, the discrete and sequential nature of the modules yields long response latency. We introduce Sci-Fii, a sp