首页> 外文会议>International conference on quantitative evaluation of systems >Multi-objective Robust Strategy Synthesis for Interval Markov Decision Processes
【24h】

Multi-objective Robust Strategy Synthesis for Interval Markov Decision Processes

机译:区间马尔可夫决策过程的多目标鲁棒策略综合

获取原文

摘要

Interval Markov decision processes (IMDPs) generalise classical MDPs by having interval-valued transition probabilities. They provide a powerful modelling tool for probabilistic systems with an additional variation or uncertainty that prevents the knowledge of the exact transition probabilities. In this paper, we consider the problem of multi-objective robust strategy synthesis for interval MDPs, where the aim is to find a robust strategy that guarantees the satisfaction of multiple properties at the same time in face of the transition probability uncertainty. We first show that this problem is PSPACE-hard. Then, we provide a value iteration-based decision algorithm to approximate the Pareto set of achievable points. We finally demonstrate the practical effectiveness of our proposals by applying them on several real-world case studies.
机译:间隔马尔可夫决策过程(IMDP)通过具有间隔值转换概率来概括经典MDP。它们为概率系统提供了强大的建模工具,具有额外的变化或不确定性,从而无法了解确切的转移概率。在本文中,我们考虑了区间MDP的多目标鲁棒策略综合问题,其目的是找到一种能够在面对转移概率不确定性的同时保证满足多个属性的鲁棒策略。我们首先显示此问题是PSPACE难题。然后,我们提供基于值迭代的决策算法,以近似可实现点的帕累托集。最后,通过将其应用到几个实际案例研究中,我们证明了我们的建议的实际有效性。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号