A Mirror Descent Algorithm for Minimization of Mean Poisson Flow Driven Losses

摘要

A problem of minimization of integral losses on given horizon is considered for stochastic system in continuous time. The losses occur in jump times of a Poisson process, and represent continuous convex function of control parameter on convex compact finite-dimensional set. At the jump times an oracle provide stochastically perturbed sub-gradient of the loss function, bounded in mean squares; the noise is additive and centered. Control strategy generated by Mirror Descent algorithm is suggested. For the strategy an explicit upper bound for integral loss discrepancy over its minimum is proved. Example of such strategy application to queueing model is examined.