Institute of Information Theory and Automation

You are here

Bibliography

Conference Paper (international conference)

Cumulative Optimality in Risk-Sensitive and Risk-Neutral Markov Reward Chains

Sladký Karel

: Proceedings of the 31st International Conference Mathematical Methods in Economics 2013 , Eds: Vojáčková Hana

: MME 2013. International Conference on Mathematical Methods in Economics 2013 /31./, (Jihlava, CZ, 11.09.2013-13.09.2013)

: GA13-14445S, GA ČR, GAP402/11/0150, GA ČR

: dynamic programming, stochastic models, risk analysis and management

: http://library.utia.cas.cz/separaty/2013/E/sladky-cumulative optimality in risk-sensitive and risk-neutral markov reward chains.pdf

(eng): This contribution is devoted to risk-sensitive and risk-neutral optimality in Markov decision chains. Since the traditional optimality criteria (e.g. discounted or average rewards) cannot reflect the variability-risk features of the problem, and using the mean variance selection rules that stem from the classical work of Markowitz present some technical difficulties, we are interested in expectation of the stream of rewards generated by the Markov chain that is evaluated by an exponential utility function with a given risk sensitivity coefficient. Recall that for the risk sensitivity coefficient equal zero we arrive at¨traditional optimality criteria. In this note we present necessary and sufficient risk-sensitivity and risk-neutral optimality conditions; in detail for unichain models and indicate their generalization to multichain Markov reward chains.

: BB

2019-01-07 08:39