In this paper we present the architecture and framework for a benchmark suite that has been developed as part of te DeSiDeRaTa project. The proposed benchmark suite is representative of the emerging generation of distributed, mission-critical, real-time control systems that operate in dynamic environments. SYstems that operate in such environments may have unknown worst-case scenarios, may have large variances in the sizes of the data and event sets that they process, and may be very difficult to characterize statically, even by time-invariant statistical distributions. The proposed is useful for evaluation of the Quality of serivec management and/or resource Management services in distributed real-time systems. As such, DynBench includes a set of performance metrics for the evaluation of the Qos and RM technologies in dynamic distributed real-time systems. The paper demonstrates the successful application of Dynbench in evaluation of the DeSiDeRaTa Qos management middle-ware.
展开▼