create a website

Markov decision processes with risk-sensitive criteria: an overview. (2024). Jakiewicz, Anna ; Buerle, Nicole.
In: Mathematical Methods of Operations Research.
RePEc:spr:mathme:v:99:y:2024:i:1:d:10.1007_s00186-024-00857-0.

Full description at Econpapers || Download paper

Cited: 0

Citations received by this document

Cites: 173

References cited by this document

Cocites: 44

Documents which have cited the same bibliography

Coauthors: 0

Authors who have wrote about the same topic

Citations

Citations received by this document

    This document has not been cited yet.

References

References cited by this document

  1. Ahmed S, Çakmak U, Shapiro A (2007) Coherent risk measures in inventory problems. Eur J Oper Res 182:226–238.
    Paper not yet in RePEc: Add citation now
  2. Anantharam V, Borkar VS (2017) A variational formula for risk-sensitive reward. SIAM J Control Optim 55(2):961–988.
    Paper not yet in RePEc: Add citation now
  3. Anderson EW (2005) The dynamics of risk-sensitive allocations. J Econ Theory 125(2):93–150.

  4. Arapostathis A, Borkar VS (2021) Linear and dynamic programs for risk-sensitive cost minimization. In: Proceedings of the 60th IEEE conference on decision and control. IEEE, pp 3042–3047.
    Paper not yet in RePEc: Add citation now
  5. Arapostathis A, Borkar VS, Kumar SK (2016) Risk-sensitive control and an abstract Collatz–Wielandt formula. J Theor Probab 29(4):1458–1484.

  6. Arrow KJ (1971) The theory of risk aversion. In: Essays in the theory of risk-bearing. North Holland, pp 90–120.
    Paper not yet in RePEc: Add citation now
  7. Asienkiewicz H, Jaśkiewicz A (2017) A note on a new class of recursive utilities in Markov decision processes. Applicationes Mathematicae 44:149–161.
    Paper not yet in RePEc: Add citation now
  8. Balbus Ł, Jaśkiewicz A, Nowak AS (2015) The dynamics of risk-sensitive allocations. J Optim Theory Appl 165:295–315.
    Paper not yet in RePEc: Add citation now
  9. Barz C, Waldmann KH (2007) Risk-sensitive capacity control in revenue management. Math Methods Oper Res 65:565–579.

  10. Basu A, Bhattacharyya T, Borkar VS (2008) A learning algorithm for risk-sensitive cost. Math Oper Res 33(4):880–898.

  11. Bäuerle N, Glauner A (2022) Markov decision processes with recursive risk measures. Eur J Oper Res 296(3):953–966.
    Paper not yet in RePEc: Add citation now
  12. Bäuerle N, Jaśkiewicz A (2015) Risk-sensitive dividend problems. Eur J Oper Res 242(1):161–171.
    Paper not yet in RePEc: Add citation now
  13. Bäuerle N, Jaśkiewicz A (2017) Optimal dividend payout model with risk sensitive preferences. Insurance Math Econom 73:82–93.
    Paper not yet in RePEc: Add citation now
  14. Bäuerle N, Jaśkiewicz A (2018) Stochastic optimal growth model with risk sensitive preferences. J Econ Theory 173:181–200.
    Paper not yet in RePEc: Add citation now
  15. Bäuerle N, Mundt A (2009) Dynamic mean-risk optimization in a binomial model. Math Methods Oper Res 70:219–239.
    Paper not yet in RePEc: Add citation now
  16. Bäuerle N, Ott J (2011) Markov decision processes with average-value-at-risk criteria. Math Methods Oper Res 74:361–379.

  17. Bäuerle N, Rieder U (2011) Markov decision processes with applications to finance. Springer, Berlin.
    Paper not yet in RePEc: Add citation now
  18. Bäuerle N, Rieder U (2014) More risk-sensitive Markov decision processes. Math Oper Res 39(1):105–120.

  19. Bäuerle N, Rieder U (2015) Partially observable risk-sensitive stopping problems in discrete time. In: Piunovskiy AB (ed) Modern trends of controlled stochastic processes: theory and Applications, vol II. Luniver Press, pp 12–31.
    Paper not yet in RePEc: Add citation now
  20. Bäuerle N, Rieder U (2017) Partially observable risk-sensitive Markov decision processes. Math Oper Res 42(4):1180–1196.

  21. Befekadu GK, Gupta V, Antsaklis PJ (2015) Risk-sensitive control under Markov modulated denial-of-service (DoS) attack strategies. IEEE Trans Autom Control 60(12):3299–3304.
    Paper not yet in RePEc: Add citation now
  22. Ben-Tal A, Teboulle M (2007) An old-new concept of convex risk measures: the optimized certainty equivalent. Math Financ 17(3):449–476.

  23. Bernoulli D (1954) Exposition of a new theory on the measurement of risk. Econometrica 22:23–36.
    Paper not yet in RePEc: Add citation now
  24. Bielecki T, Hernández-Hernández D, Pliska SR (1999) Risk sensitive control of finite state Markov chains in discrete time, with applications to portfolio management. Math Methods Oper Res 50:167–188.

  25. Bielecki T, Hernandez-Hernandez D, Pliska SR (1999b) Value iteration for controlled Markov chains with risk sensitive cost criterion. In: Proceedings of the 38th IEEE conference on decision and control. IEEE, pp 126–130.
    Paper not yet in RePEc: Add citation now
  26. Biswas A, Borkar VS (2023) Ergodic risk-sensitive control—a survey. Annu Rev Control 55:118–141.
    Paper not yet in RePEc: Add citation now
  27. Biswas A, Pradhan S (2022) Ergodic risk-sensitive control of Markov processes on countable state space revisited. ESAIM: Control Optim Cal Variat 28:26.
    Paper not yet in RePEc: Add citation now
  28. Bloise G, Le Van C, Vailakis Y (2021) Do not blame Bellman: It is Koopmans’ fault. SSRN 3943709.
    Paper not yet in RePEc: Add citation now
  29. Bloise G, Vailakis Y (2018) Convex dynamic programming with (bounded) recursive utility. J Econ Theory 173:118–141.

  30. Bommier A, Le Grand F (2019) Risk aversion and precautionary savings in dynamic settings. Manage Sci 65(3):1386–1397.

  31. Borkar VS (2001) A sensitivity formula for risk-sensitive cost and the actor-critic algorithm. Syst Control Lett 44(5):339–346.
    Paper not yet in RePEc: Add citation now
  32. Borkar VS (2002) Q-learning for risk-sensitive control. Math Oper Res 27(2):294–311.

  33. Borkar VS (2017) Linear and dynamic programming approaches to degenerate risk-sensitive reward processes. In: 56th Annual IEEE conference on decision and control. IEEE, pp 3714–3718.
    Paper not yet in RePEc: Add citation now
  34. Borkar VS, Meyn SP (2002) Risk-sensitive optimal control for Markov decision processes with monotone cost. Math Oper Res 27(1):192–209.

  35. Bouakiz M, Sobel MJ (1992) Inventory control with an exponential utility criterion. Oper Res 40(3):603–608.

  36. Brau-Rojas A, Cavazos-Cadena R, Fernández-Gaucherand E (1998) Controlled Markov chains with risk-sensitive criteria: some (counter) examples. In: Proceedings of the 37th IEEE conference on decision and control. IEEE, pp 1853–1858.
    Paper not yet in RePEc: Add citation now
  37. Braun DA, Nagengast AJ, Wolpert DM (2011) Risk-sensitivity in sensorimotor control. Front Hum Neurosci 5:1.
    Paper not yet in RePEc: Add citation now
  38. Bushaj S, Büyüktahtakın İE, Haight RG (2022) Risk-averse multi-stage stochastic optimization for surveillance and operations planning of a forest insect infestation. Eur J Oper Res 299(3):1094–1110.

  39. Cavazos-Cadena R (2010) Optimality equations and inequalities in a class of risk-sensitive average cost Markov decision chains. Math Methods Oper Res 71(1):47–84.

  40. Cavazos-Cadena R (2018) Characterization of the optimal risk-sensitive average cost in denumerable Markov decision chains. Math Oper Res 43(3):1025–1050.

  41. Cavazos-Cadena R, Cruz-Suárez D (2017) Discounted approximations to the risk-sensitive average cost in finite Markov chains. J Math Anal Appl 450(2):1345–1362.
    Paper not yet in RePEc: Add citation now
  42. Cavazos-Cadena R, Fernández-Gaucherand E (2000) The vanishing discount approach in Markov chains with risk-sensitive criteria. IEEE Trans Autom Control 45(10):1800–1816.
    Paper not yet in RePEc: Add citation now
  43. Cavazos-Cadena R, Hernández-Hernández D (2002) Solution to the risk-sensitive average optimality equation in communicating Markov decision chains with finite state space: An alternative approach. Math Methods Oper Res 56:473–479.
    Paper not yet in RePEc: Add citation now
  44. Cavazos-Cadena R, Hernández-Hernández D (2005) A characterization of the optimal risk-sensitive average cost in finite controlled Markov chains. Ann Appl Probab 15(1A):175–212.
    Paper not yet in RePEc: Add citation now
  45. Cavazos-Cadena R, Hernández-Hernández D (2009) Necessary and sufficient conditions for a solution to the risk-sensitive Poisson equation on a finite state space. Syst Control Lett 58(4):254–258.
    Paper not yet in RePEc: Add citation now
  46. Cavazos-Cadena R, Hernández-Hernández D (2011) Discounted approximations for risk-sensitive average criteria in Markov decision chains with finite state space. Math Oper Res 36(1):133–146.

  47. Cavazos-Cadena R, Hernández-Hernández D (2016) A characterization of the optimal certainty equivalent of the average cost via the Arrow-Pratt sensitivity function. Math Oper Res 41(1):224–235.

  48. Cavazos-Cadena R, Montes-de Oca R (2003) The value iteration algorithm in risk-sensitive average Markov decision chains with finite state space. Math Oper Res 28(4):752–776.

  49. Cavazos-Cadena R, Montes-De-Oca R (2005) Nonstationary value iteration in controlled Markov chains with risk-sensitive average criterion. J Appl Probab 42(4):905–918.
    Paper not yet in RePEc: Add citation now
  50. Cavazos-Cadena R, Salem-Silva F (2010) The discounted method and equivalence of average criteria for risk-sensitive Markov decision processes on borel spaces. Appl Math Optim 61(2):167–190.
    Paper not yet in RePEc: Add citation now
  51. Çavuş O, Ruszczyński A (2014) Risk-averse control of undicounted transient Markov models. SIAM J Control Optim 52(6):3935–3966.
    Paper not yet in RePEc: Add citation now
  52. Chapman MP, Fauß M, Smith KM (2023) On optimizing the conditional value-at-risk of a maximum cost for risk-averse safety analysis. IEEE Trans Autom Control 68(6):3720–3727.
    Paper not yet in RePEc: Add citation now
  53. Chapman MP, Smith KM (2021) Classical risk-averse control for a finite-horizon Borel model. IEEE Control Syst Lett 6:1525–1530.
    Paper not yet in RePEc: Add citation now
  54. Chen X, Wei Q (2023) Risk-sensitive average optimality for discrete-time Markov decision processes. SIAM J Control Optim 61(1):72–104.
    Paper not yet in RePEc: Add citation now
  55. Choi S, Ruszczyński A (2011) A multi-product risk-averse newsvendor with exponential utility function. Eur J Oper Res 214:78–84.
    Paper not yet in RePEc: Add citation now
  56. Chow Y, Tamar A, Mannor S, et al (2015) Risk-sensitive and robust decision-making: a CVaR optimization approach. In: Proceedings of the 28th international conference on neural information processing systems, ACMDL, pp 1522–1530.
    Paper not yet in RePEc: Add citation now
  57. Chu S, Zhang Y (2014) Markov decision processes with iterated coherent risk measures. Int J Control 87(11):2286–2293.
    Paper not yet in RePEc: Add citation now
  58. Chung KJ, Sobel MJ (1987) Discounted MDP’s: distribution functions and exponential utility maximization. SIAM J Control Optim 25(1):49–62.
    Paper not yet in RePEc: Add citation now
  59. Coache A, Jaimungal S (2023) Reinforcement learning with dynamic convex risk measures. Math Financ. https://doi.org/10.1111/mafi.12388 .
    Paper not yet in RePEc: Add citation now
  60. Collins E, McNamara J (1998) Finite-horizon dynamic optimisation when the terminal reward is a concave functional of the distribution of the final state. Adv Appl Probab 30(1):122–136.
    Paper not yet in RePEc: Add citation now
  61. Coraluppi SP, Marcus SI (1999) Risk-sensitive and minimax control of discrete-time, finite-state Markov decision processes. Automatica 35(2):301–309.
    Paper not yet in RePEc: Add citation now
  62. Dai Pra P, Meneghini L, Runggaldier WJ (1996) Connections between Stochastic control and dynamic games. Math Control Signals Syst 9:303–326.
    Paper not yet in RePEc: Add citation now
  63. Dembo A, Zeitouni O (1998) Large deviations techniques and applications. Springer, Berlin.
    Paper not yet in RePEc: Add citation now
  64. Denardo EV, Park H, Rothblum UG (2007) Risk-sensitive and risk-neutral multiarmed bandits. Math Oper Res 32(2):374–394.

  65. Denardo EV, Rothblum UG (2006) A turnpike theorem for a risk-sensitive Markov decision process with stopping. SIAM J Control Optim 45(2):414–431.
    Paper not yet in RePEc: Add citation now
  66. Di Masi GB, Stettner Ł (1999) Risk-sensitive control of discrete-time Markov processes with infinite horizon. SIAM J Control Optim 38(1):61–78.
    Paper not yet in RePEc: Add citation now
  67. Di Masi GB, Stettner Ł (2000) Infinite horizon risk sensitive control of discrete time Markov processes with small risk. Syst Control Lett 40(1):15–20.
    Paper not yet in RePEc: Add citation now
  68. Di Masi GB, Stettner Ł (2007) Infinite horizon risk sensitive control of discrete time Markov processes under minorization property. SIAM J Control Optim 46(1):231–252.
    Paper not yet in RePEc: Add citation now
  69. Ding R, Feinberg EA (2022) Sequential optimization of CVaR. ArXiv preprint arXiv:2211.07288 .
    Paper not yet in RePEc: Add citation now
  70. Dowson O, Morton DP, Pagnoncelli BK (2020) Multistage stochastic programs with the entropic risk measure. Optim Online https://optimization-online.org/?p=16662 .
    Paper not yet in RePEc: Add citation now
  71. Dowson O, Morton DP, Pagnoncelli BK (2022) Incorporating convex risk measures into multistage stochastic programming algorithms. Ann Oper Res. https://doi.org/10.1007/s10479-022-04977-w .
    Paper not yet in RePEc: Add citation now
  72. Duffie D, Epstein LG (1992) Stochastic differential utility. Econometrica J Econom Soc 1:353–394.

  73. Dupačová J, Kozmík V (2015) Structure of risk-averse multistage stochastic programs. OR Spectrum 37:559–582.
    Paper not yet in RePEc: Add citation now
  74. Epstein LG, Zin SE (1989) Substitution, risk aversion and the temporal behavior of consumption and asset returns: A theoretical framework. Econometrica 57(4):937–969.

  75. Fei Y, Yang Z, Chen Y et al (2021) Exponential Bellman equation and improved regret bounds for risk-sensitive reinforcement learning. Adv Neural Inf Process Syst 34:20436–20446.
    Paper not yet in RePEc: Add citation now
  76. Feinstein Z, Rudloff B (2017) A recursive algorithm for multivariate risk measures and a set-valued Bellman’s principle. J Global Optim 68(1):47–69.

  77. Fernández-Gaucherand E, Marcus SI (1997) Risk-sensitive optimal control of hidden Markov models: Structural results. IEEE Trans Autom Control 42(10):1418–1422.
    Paper not yet in RePEc: Add citation now
  78. Filar J, Koos V (1997) Competitive Markov Decision Processes. Springer, Berlin.
    Paper not yet in RePEc: Add citation now
  79. Fleming WH, Hernández-Hernández D (1997) Risk-sensitive control of finite state machines on an infinite horizon I. SIAM J Control Optim 35(5):1790–1810.
    Paper not yet in RePEc: Add citation now
  80. Föllmer H, Schied A (2010) Convex and coherent risk measures. Encyclop Quant Financ 1:355–363.
    Paper not yet in RePEc: Add citation now
  81. Gönsch J (2017) A survey on risk-averse and robust revenue management. Eur J Oper Res 263(2):337–348.
    Paper not yet in RePEc: Add citation now
  82. Gönsch J, Hassler M, Schur R (2018) Optimizing Conditional Value-at-Risk in dynamic pricing. OR Spectrum 40:711–750.

  83. Goswami A, Rana N, Siu TK (2022) Regime switching optimal growth model with risk sensitive preferences. J Math Econ 101:102702.

  84. Guigues V (2016) Convergence analysis of sampling-based decomposition methods for risk-averse multistage stochastic convex programs. SIAM J Optim 26(4):2468–2494.
    Paper not yet in RePEc: Add citation now
  85. Guo X, Singh R, Kumar P et al (2018) A risk-sensitive approach for packet inter-delivery time optimization in networked cyber-physical systems. IEEE/ACM Trans Networking 26(4):1976–1989.
    Paper not yet in RePEc: Add citation now
  86. Hambly B, Xu R, Yang H (2023) Recent advances in reinforcement learning in finance. Math Financ 33(3):437–503.

  87. Hansen LP, Sargent TJ (1995) Discounted linear exponential quadratic Gaussian control. IEEE Trans Autom Control 40(5):968–971.
    Paper not yet in RePEc: Add citation now
  88. Hau JL, Petrik M, Ghavamzadeh M (2023) Entropic risk optimization in discounted MDPs. In: International conference on artificial intelligence and statistics. PMLR, pp 47–76.
    Paper not yet in RePEc: Add citation now
  89. Hernández-Hernández D, Marcus SI (1996) Risk sensitive control of Markov processes in countable state space. Syst Control Lett 29(3):147–155 (Corrigendum in System and Control Letters (1998) 34:105–106).
    Paper not yet in RePEc: Add citation now
  90. Hernández-Hernández D, Marcus SI (1999) Existence of risk-sensitive optimal stationary policies for controlled Markov processes. Appl Math Optim 40:273–285.
    Paper not yet in RePEc: Add citation now
  91. Hernández-Lerma O, Lasserre JB (1996) Discrete-time Markov control processes, basic optimality criteria. Springer, Berlin.
    Paper not yet in RePEc: Add citation now
  92. Homem-de-Mello T, Pagnoncelli BK (2016) Risk aversion in multistage stochastic programming: a modeling and algorithmic perspective. Eur J Oper Res 249(1):188–199.

  93. Howard RA, Matheson JE (1972) Risk-sensitive Markov decision processes. Manage Sci 18(7):356–369.

  94. Huang A, Leqi L, Lipton ZC, et al (2021) On the convergence and optimality of policy gradient for Markov coherent risk. arXiv preprint arXiv:2103.02827 .
    Paper not yet in RePEc: Add citation now
  95. Huang T, Chen J (2024) Markov decision processes under risk sensitivity: a discount vanishing approach. J Math Anal Appl 533(2):128026.
    Paper not yet in RePEc: Add citation now
  96. Iancu DA, Petrik M, Subramanian D (2015) Tight approximations of dynamic risk measures. Math Oper Res 40(3):655–682.

  97. Iwamoto S (1999) Conditional decision processes with recursive function. J Math Anal Appl 230(1):193–210.
    Paper not yet in RePEc: Add citation now
  98. Iwamoto S (2004) Stochastic optimization of forward recursive functions. J Math Anal Appl 292(1):73–83.
    Paper not yet in RePEc: Add citation now
  99. Jacobson D (1973) Optimal stochastic linear systems with exponential performance criteria and their relation to deterministic differential games. IEEE Trans Autom Control 18(2):124–131.
    Paper not yet in RePEc: Add citation now
  100. James MR, Baras JS, Elliott RJ (1994) Risk-sensitive control and dynamic games for partially observed discrete-time nonlinear systems. IEEE Trans Autom Control 39(4):780–792.
    Paper not yet in RePEc: Add citation now
  101. Jaquette SC (1976) A utility criterion for Markov decision processes. Manag Sci 23(1):43–49.

  102. Jaśkiewicz A (2007) A note on risk-sensitive control of invariant models. Syst Control Lett 56(11–12):663–668.
    Paper not yet in RePEc: Add citation now
  103. Jaśkiewicz A (2007) Average optimality for risk-sensitive control with general state space. Ann Appl Probab 17(2):654–675.
    Paper not yet in RePEc: Add citation now
  104. Jaśkiewicz A (2008) A note on negative dynamic programming for risk-sensitive control. Oper Res Lett 36(5):531–534.
    Paper not yet in RePEc: Add citation now
  105. Jaśkiewicz A, Nowak AS (2014) Robust Markov control processes. J Math Anal Appl 420(2):1337–1353.
    Paper not yet in RePEc: Add citation now
  106. Jiang DR, Powell WB (2016) Practicality of nested risk measures for dynamic electric vehicle charging. ArXiv preprint arXiv:1605.02848 .
    Paper not yet in RePEc: Add citation now
  107. Kadota Y, Kurano M, Yasuda M (2006) Discounted Markov decision processes with utility constraints. Comput Math Appl 51(2):279–284.
    Paper not yet in RePEc: Add citation now
  108. Koenig S, Simmons RG (1994) Risk-sensitive planning with probabilistic decision graphs. In: Principles of knowledge representation and reasoning. Elsevier, pp 363–373.
    Paper not yet in RePEc: Add citation now
  109. Kozmík V, Morton DP (2015) Evaluating policies in risk-averse multi-stage stochastic programming. Math Program 152:275–300.
    Paper not yet in RePEc: Add citation now
  110. Kraft H, Seifried FT, Steffensen M (2013) Consumption-portfolio optimization with recursive utility in incomplete markets. Finance Stochast 17:161–196.

  111. Kreps DM (1977) Decision problems with expected utility critera, I: upper and lower convergent utility. Math Oper Res 2(1):45–53.
    Paper not yet in RePEc: Add citation now
  112. Kreps DM (1977) Decision problems with expected utility criteria, II: stationarity. Math Oper Res 2(3):266–274.

  113. Kreps DM, Porteus EL (1978) Temporal resolution of uncertainty and dynamic choice theory. Econometrica 46(1):185–200.

  114. Le Tallec Y (2007) Robust, risk-sensitive, and data-driven control of Markov decision processes. Phd thesis, Massachusetts Institute of Technology, available at https://dspace.mit.edu/handle/1721.1/38598 .
    Paper not yet in RePEc: Add citation now
  115. Luenberger DG (2014) Investement Science. Oxford University Press, Oxford.
    Paper not yet in RePEc: Add citation now
  116. Luo Y, Young ER (2010) Risk-sensitive consumption and savings under rational inattention. Am Econ J Macroecon 2(4):281–325.

  117. Maceira MEP, Marzano L, Penna DDJ et al (2015) Application of CVaR risk aversion approach in the expansion and operation planning and for setting the spot price in the Brazilian hydrothermal interconnected system. Int J Electr Power Energy Syst 72:126–135.
    Paper not yet in RePEc: Add citation now
  118. Mannor S, Tsitsiklis J (2011) Mean-variance optimization in Markov decision processes. In: Proceedings of the 28th international conference on machine learning. ICML, pp 177–184.
    Paper not yet in RePEc: Add citation now
  119. Marinacci M, Montrucchio L (2010) Unique solutions for stochastic recursive utilities. J Econ Theory 145(5):1776–1804.

  120. Markowitz HM (1952) Portfolio selection. J Financ 7(1):77–91.
    Paper not yet in RePEc: Add citation now
  121. Martyr R, Moriarty J, Perninge M (2022) Discrete-time risk-aware optimal switching with non-adapted costs. Adv Appl Probab 54(2):625–655.
    Paper not yet in RePEc: Add citation now
  122. Mazouchi M, Nageshrao S, Modares H (2022) Automating vehicles by risk-averse preview-based Q-learning algorithm. IFAC-PapersOnLine 55(15):105–110.
    Paper not yet in RePEc: Add citation now
  123. Medina JR, Lee D, Hirche S (2012) Risk-sensitive optimal feedback control for haptic assistance. In: IEEE international conference on robotics and automation. IEEE, pp 1025–1031.
    Paper not yet in RePEc: Add citation now
  124. Miao J (2020) Economic Dynamics in Discrete Time. MIT press.
    Paper not yet in RePEc: Add citation now
  125. Moldovan T, Abbeel P (2012) Risk aversion in Markov decision processes via near-optimal Chernoff bounds. Adv Neural Inf Process Syst 4:3131–3139.
    Paper not yet in RePEc: Add citation now
  126. Osogami T (2011) Iterated risk measures for risk-sensitive Markov decision processes with discounted cost. In: Proceedings of the 27th conference on uncertainty in artificial intelligence, pp 573–580.
    Paper not yet in RePEc: Add citation now
  127. Ott J (2010) A Markov decision model for a surveillance application and risk-sensitive Markov decision processes. PhD Thesis, Karlsruhe Institute of Technology. https://publikationen.bibliothek.kit.edu/1000020835 .
    Paper not yet in RePEc: Add citation now
  128. Ozaki H, Streufert PA (1996) Dynamic programming for non-additive stochastic objectives. J Math Econ 25(4):391–442.

  129. Pflug GC (2006) A value-of-information approach to measuring risk in multi-period economic activity. J Bank Finance 30(2):695–715.
    Paper not yet in RePEc: Add citation now
  130. Pflug GC, Pichler A (2016) Time-inconsistent multistage stochastic programs: Martingale bounds. Eur J Oper Res 249(1):155–163.
    Paper not yet in RePEc: Add citation now
  131. Pflug GC, Ruszczyński (2005) Measuring risk for income streams. Comput Optim Appl 32:161–178.
    Paper not yet in RePEc: Add citation now
  132. Philpott A, de Matos V, Finardi E (2013) On solving multistage stochastic programs with coherent risk measures. Oper Res 61(4):957–970.

  133. Pitera M, Stettner Ł (2023) Discrete-time risk sensitive portfolio optimization with proportional transaction costs. Math Financ 33(4):1287–1313.

  134. Piunovskiy AB (2013) Examples in Markov decision processes. Imperial College Press, London.
    Paper not yet in RePEc: Add citation now
  135. Powell WB (2022) Reinforcement learning and Stochastic optimization: a unified framework for sequential decisions. Wiley, Boca Raton.
    Paper not yet in RePEc: Add citation now
  136. Pratt JW (1964) Risk aversion in the small and in the large. Econometrica 32:122–136.
    Paper not yet in RePEc: Add citation now
  137. Puterman ML (2014) Markov decision processes: discrete stochastic dynamic programming. Wiley, Boca Raton.
    Paper not yet in RePEc: Add citation now
  138. Ren G, Stachurski J (2018) Dynamic programming with recursive preferences: optimality and applications. ArXiv preprint arXiv:1812.05748 .
    Paper not yet in RePEc: Add citation now
  139. Rothblum UG (1984) Multiplicative Markov decision chains. Math Oper Res 9(1):6–24.

  140. Royden HL (1988) Real analysis. Prentice Hall, New Jersey.
    Paper not yet in RePEc: Add citation now
  141. Rudloff B, Street A, Valladão DM (2014) Time consistency and risk averse dynamic decision models: Definition, interpretation and practical consequences. Eur J Oper Res 234(3):743–750.

  142. Ruszczyński A (2010) Risk-averse dynamic programming for Markov decision processes. Math Program 125:235–261.
    Paper not yet in RePEc: Add citation now
  143. Sargent T, Stachurski J (2023) Dynamic Programming, Vol. I: Foundations. https://dp.quantecon.org .
    Paper not yet in RePEc: Add citation now
  144. Schäl M (1975) Conditions for optimality in dynamic programming and for the limit of n-stage optimal policies to be optimal. Zeitschrift für Wahrscheinlichkeitstheorie und Verwandte Gebiete 32:179–196.
    Paper not yet in RePEc: Add citation now
  145. Schäl M (1983) Stationary policies in dynamic programming models under compactness assumptions. Math Oper Res 8(3):366–372.
    Paper not yet in RePEc: Add citation now
  146. Schlosser R (2015) A stochastic dynamic pricing and advertising model under risk aversion. J Revenue Pricing Manag 14:451–468.
    Paper not yet in RePEc: Add citation now
  147. Schlosser R (2016) Stochastic dynamic multi-product pricing with dynamic advertising and adoption effects. J Revenue Pric Manag 15:153–169.

  148. Schlosser R (2020) Risk-sensitive control of Markov decision processes: A moment-based approach with target distributions. Comput Oper Res 123:104997.
    Paper not yet in RePEc: Add citation now
  149. Schur R, Gönsch J, Hassler M (2019) Time-consistent, risk-averse dynamic pricing. Eur J Oper Res 277(2):587–603.

  150. Shapiro A (2012) Minimax and risk averse multistage stochastic programming. Eur J Oper Res 219(3):719–726.

  151. Shapiro A (2021) Tutorial on risk neutral, distributionally robust and risk averse multistage stochastic programming. Eur J Oper Res 288(1):1–13.

  152. Shapiro A, Tekaya W, da Costa JP et al (2013) Risk neutral and risk averse stochastic dual dynamic programming method. Eur J Oper Res 224(2):375–391.

  153. Shen Y, Stannat W, Obermayer K (2013) Risk-sensitive Markov control processes. SIAM J Control Optim 51(5):3652–3672.
    Paper not yet in RePEc: Add citation now
  154. Shen Y, Stannat W, Obermayer K (2014) A unified framework for risk-sensitive Markov control processes. In: Proceedings of the 53rd IEEE Conference on Decision and Control, IEEE, pp 1073–1078.
    Paper not yet in RePEc: Add citation now
  155. Sladkỳ K (2008) Growth rates and average optimality in risk-sensitive Markov decision chains. Kybernetika 44(2):205–226.
    Paper not yet in RePEc: Add citation now
  156. Sladkỳ K (2018) Risk-sensitive average optimality in Markov decision processes. Kybernetika 54(6):1218–1230.
    Paper not yet in RePEc: Add citation now
  157. Staino A, Russo E (2020) Nested Conditional Value-at-Risk portfolio selection: a model with temporal dependence driven by market-index volatility. Eur J Oper Res 280(2):741–753.

  158. Stettner Ł (1999) Risk sensitive portfolio optimization. Math Methods Oper Res 50(3):463–474.

  159. Stettner Ł (2005) Discrete time risk sensitive portfolio optimization with consumption and proportional transaction costs. Applicationes Mathematicae 4(32):395–404.
    Paper not yet in RePEc: Add citation now
  160. Stettner Ł (2023) Certainty equivalent control of discrete time Markov processes with the average reward functional. Syst Control Lett 181:105627.
    Paper not yet in RePEc: Add citation now
  161. Sutton RS, Barto AG (2018) Reinforcement Learning: An Introduction. MIT Press, Cambridge.
    Paper not yet in RePEc: Add citation now
  162. Tamar A, Chow Y, Ghavamzadeh M et al (2016) Sequential decision making with coherent risk. IEEE Trans Autom Control 62(7):3323–3338.
    Paper not yet in RePEc: Add citation now
  163. Uğurlu K (2017) Controlled Markov decision processes with AVaR criteria for unbounded costs. J Comput Appl Math 319:24–37.
    Paper not yet in RePEc: Add citation now
  164. Uğurlu K (2018) Robust optimal control using conditional risk mappings in infinite horizon. J Comput Appl Math 344:275–287.
    Paper not yet in RePEc: Add citation now
  165. Von Neumann J, Morgenstern O (2007) Theory of Games and Economic Behavior (60th Anniversary Commemorative Edition). Princeton University Press, Princeton.
    Paper not yet in RePEc: Add citation now
  166. Weil P (1990) Nonexpected utility in macroeconomics. Q J Econ 105(1):29–42.

  167. Weil P (1993) Precautionary savings and the permanent income hypothesis. Rev Econ Stud 60(2):367–383.

  168. Whittle P (1981) Risk-sensitive linear/quadratic/Gaussian control. Adv Appl Probab 13(4):764–777.
    Paper not yet in RePEc: Add citation now
  169. Wozabal D, Rameseder G (2020) Optimal bidding of a virtual power plant on the spanish day-ahead and intraday market for electricity. Eur J Oper Res 280(2):639–655.

  170. Xia L (2020) Risk-sensitive Markov decision processes with combined metrics of mean and variance. Prod Oper Manag 29(12):2808–2827.

  171. Xia L, Glynn PW (2022) Risk-sensitive Markov decision processes with long-run CVaR criterion. ArXiv preprint arXiv:2210.08740 .
    Paper not yet in RePEc: Add citation now
  172. Xu W, Gao X, He X (2023) Regret bounds for Markov decision processes with recursive optimized certainty equivalents. ArXiv preprint arXiv:2301.12601 .
    Paper not yet in RePEc: Add citation now
  173. Zhang W, Rahimian H, Bayraksan G (2016) Decomposition algorithms for risk-averse multistage stochastic programs with application to water allocation under uncertainty. INFORMS J Comput 28(3):385–404.

Cocites

Documents in RePEc which have cited the same bibliography

  1. Recursive Preferences, Correlation Aversion, and the Temporal Resolution of Uncertainty. (2025). Stanca, Lorenzo.
    In: Carlo Alberto Notebooks.
    RePEc:cca:wpaper:693.

    Full description at Econpapers || Download paper

  2. Recursive Preferences, Correlation Aversion, and the Temporal Resolution of Uncertainty. (2025). Stanca, Lorenzo Maria.
    In: Papers.
    RePEc:arx:papers:2304.04599.

    Full description at Econpapers || Download paper

  3. Markov decision processes with risk-sensitive criteria: an overview. (2024). Jakiewicz, Anna ; Buerle, Nicole.
    In: Mathematical Methods of Operations Research.
    RePEc:spr:mathme:v:99:y:2024:i:1:d:10.1007_s00186-024-00857-0.

    Full description at Econpapers || Download paper

  4. Recursive preferences, correlation aversion, and the temporal resolution of uncertainty. (2023). Lorenzo, Stanca.
    In: Working papers.
    RePEc:tur:wpapnw:080.

    Full description at Econpapers || Download paper

  5. Optimal climate policy under tipping risk and temporal risk aversion. (2023). Guivarch, Céline ; Fillon, Romain ; Taconet, Nicolas.
    In: Post-Print.
    RePEc:hal:journl:hal-04250702.

    Full description at Econpapers || Download paper

  6. Value of Life and Annuity Demand. (2021). Porapakkarm, Ponpoje ; Pashchenko, Svetlana.
    In: MPRA Paper.
    RePEc:pra:mprapa:108886.

    Full description at Econpapers || Download paper

  7. Value of Life and Annuity Demand. (2021). Porapakkarm, Ponpoje ; Pashchenko, Svetlana.
    In: MPRA Paper.
    RePEc:pra:mprapa:107378.

    Full description at Econpapers || Download paper

  8. Asset pricing with heterogeneous agents and long-run risk. (2021). Schmedders, Karl ; Pohl, Walter ; Wilms, Ole.
    In: Journal of Financial Economics.
    RePEc:eee:jfinec:v:140:y:2021:i:3:p:941-964.

    Full description at Econpapers || Download paper

  9. On recursive utilities with non-affine aggregator and conditional certainty equivalent. (2020). Balbus, Łukasz.
    In: Economic Theory.
    RePEc:spr:joecth:v:70:y:2020:i:2:d:10.1007_s00199-019-01221-8.

    Full description at Econpapers || Download paper

  10. Existence of Nash equilibria in stochastic games of resource extraction with risk-sensitive players. (2019). Balbus, Łukasz ; Asienkiewicz, Hubert.
    In: TOP: An Official Journal of the Spanish Society of Statistics and Operations Research.
    RePEc:spr:topjnl:v:27:y:2019:i:3:d:10.1007_s11750-019-00516-2.

    Full description at Econpapers || Download paper

  11. Real Exchange Variability in a Two-Country Business Cycle Model. (2018). Tretvoll, Håkon.
    In: Review of Economic Dynamics.
    RePEc:red:issued:13-34.

    Full description at Econpapers || Download paper

  12. Volatility Risk Pass-through. (2018). Liu, Yang ; Croce, Mariano ; Colacito, Riccardo ; Shaliastovich, Ivan.
    In: NBER Working Papers.
    RePEc:nbr:nberwo:25276.

    Full description at Econpapers || Download paper

  13. Stochastic optimal growth model with risk sensitive preferences. (2018). Jaśkiewicz, Anna ; Bauerle, Nicole ; Jakiewicz, Anna.
    In: Journal of Economic Theory.
    RePEc:eee:jetheo:v:173:y:2018:i:c:p:181-200.

    Full description at Econpapers || Download paper

  14. Volatility Risk Pass-Through. (2018). Liu, Yang ; Colacito, Riccardo ; Croce, Mariano Massimiliano ; Shaliastovich, Ivan.
    In: CEPR Discussion Papers.
    RePEc:cpr:ceprdp:13325.

    Full description at Econpapers || Download paper

  15. BKK the EZ Way. International Long-Run Growth News and Capital Flows.. (2018). Ho, Steven ; Colacito, Riccardo ; Howard, Philip ; Croce, Mariano Massimiliano.
    In: CEPR Discussion Papers.
    RePEc:cpr:ceprdp:12783.

    Full description at Econpapers || Download paper

  16. Currency Risk Factors in a Recursive Multicountry Economy. (2018). Gavazzoni, Federico ; Eady, Robert R ; Colacito, Riccardo ; Croce, Mariano Massimiliano.
    In: CEPR Discussion Papers.
    RePEc:cpr:ceprdp:12610.

    Full description at Econpapers || Download paper

  17. Spatially Structured Deep Uncertainty, Robust Control, and Climate Change Policies. (2018). Xepapadeas, Anastasios ; Yannacopoulos, Athanasios.
    In: DEOS Working Papers.
    RePEc:aue:wpaper:1807.

    Full description at Econpapers || Download paper

  18. Optimal dividend payout model with risk sensitive preferences. (2017). Jaśkiewicz, Anna ; Bauerle, Nicole ; Jakiewicz, Anna.
    In: Insurance: Mathematics and Economics.
    RePEc:eee:insuma:v:73:y:2017:i:c:p:82-93.

    Full description at Econpapers || Download paper

  19. Pareto weights as wedges in two-country models. (2016). Ferriere, Axelle ; Lyon, Spencer ; Backus, David ; Coleman, Chase.
    In: Working Papers.
    RePEc:ste:nystbu:16-07.

    Full description at Econpapers || Download paper

  20. Currency Risk Factors in a Recursive Multi-Country Economy. (2016). Gavazzoni, Federico ; Eady, Robert R ; Colacito, Riccardo ; Croce, Mariano.
    In: 2016 Meeting Papers.
    RePEc:red:sed016:297.

    Full description at Econpapers || Download paper

  21. Skewness in Expected Macro Fundamentals and the Predictability of Equity Returns: Evidence and Theory. (2016). Siwasarit, Wasin ; Colacito, Riccardo ; Meng, Jinghan ; Ghysels, Eric.
    In: The Review of Financial Studies.
    RePEc:oup:rfinst:v:29:y:2016:i:8:p:2069-2109..

    Full description at Econpapers || Download paper

  22. Pareto weights as wedges in two-country models. (2016). Ferriere, Axelle ; Lyon, Spencer ; Backus, David ; Coleman, Chase.
    In: Journal of Economic Dynamics and Control.
    RePEc:eee:dyncon:v:72:y:2016:i:c:p:98-110.

    Full description at Econpapers || Download paper

  23. Pareto weights as wedges in two-country models. (2015). Ferriere, Axelle ; Lyon, Spencer ; Backus, David ; Coleman, Chase.
    In: Working Papers.
    RePEc:ste:nystbu:15-13.

    Full description at Econpapers || Download paper

  24. Pareto Weights as Wedges in Two-Country Models. (2015). Ferriere, Axelle ; Lyon, Spencer ; Coleman, Chase.
    In: NBER Working Papers.
    RePEc:nbr:nberwo:21773.

    Full description at Econpapers || Download paper

  25. Stochastic Optimal Growth Model with Risk Sensitive Preferences. (2015). Bauerle, Nicole ; Ja, Anna.
    In: Papers.
    RePEc:arx:papers:1509.05638.

    Full description at Econpapers || Download paper

  26. Managing pessimistic expectations and fiscal policy. (2013). Karantounias, Anastasios.
    In: Theoretical Economics.
    RePEc:the:publsh:899.

    Full description at Econpapers || Download paper

  27. Investment-Specific Technology Shocks and Recursive Preferences. (2013). Tretvoll, Håkon.
    In: 2013 Meeting Papers.
    RePEc:red:sed013:1207.

    Full description at Econpapers || Download paper

  28. Optimal Fiscal Policy with Recursive Preferences. (2013). Karantounias, Anastasios.
    In: FRB Atlanta Working Paper.
    RePEc:fip:fedawp:2013-07.

    Full description at Econpapers || Download paper

  29. International risk cycles. (2013). Verdelhan, Adrien ; Siemer, Michael ; Gourio, Francois.
    In: Journal of International Economics.
    RePEc:eee:inecon:v:89:y:2013:i:2:p:471-484.

    Full description at Econpapers || Download paper

  30. International Asset Pricing with Recursive Preferences. (2012). Colacito, Riccardo ; Croce, Mariano.
    In: 2012 Meeting Papers.
    RePEc:red:sed012:984.

    Full description at Econpapers || Download paper

  31. Real exchange rate variability in a two country business cycle model. (2012). Tretvoll, Håkon.
    In: 2012 Meeting Papers.
    RePEc:red:sed012:911.

    Full description at Econpapers || Download paper

  32. Trading Volume in General Equilibrium with Complete Markets. (2012). Aldrich, Eric.
    In: 2012 Meeting Papers.
    RePEc:red:sed012:36.

    Full description at Econpapers || Download paper

  33. Fiancial Innovation, Structuring and Risk Transfer. (2012). vanini, paolo.
    In: MPRA Paper.
    RePEc:pra:mprapa:42536.

    Full description at Econpapers || Download paper

  34. Three types of ambiguity. (2012). Sargent, Thomas ; Hansen, Lars.
    In: Journal of Monetary Economics.
    RePEc:eee:moneco:v:59:y:2012:i:5:p:422-445.

    Full description at Econpapers || Download paper

  35. Three Types of Ambiguity. (2012). .
    In: Working Papers.
    RePEc:bfi:wpaper:2012-006.

    Full description at Econpapers || Download paper

  36. International Robust Disagreement. (2012). Colacito, Riccardo ; CROCE, MARIANO M..
    In: American Economic Review.
    RePEc:aea:aecrev:v:102:y:2012:i:3:p:152-55.

    Full description at Econpapers || Download paper

  37. Risks for the Long Run and the Real Exchange Rate. (2011). Colacito, Riccardo ; CROCE, MARIANO M..
    In: Journal of Political Economy.
    RePEc:ucp:jpolec:doi:10.1086/659238.

    Full description at Econpapers || Download paper

  38. International Asset Pricing with Risk-Sensitive Rare Events. (2010). Colacito, Riccardo ; Croce, Mariano M.
    In: 2010 Meeting Papers.
    RePEc:red:sed010:176.

    Full description at Econpapers || Download paper

  39. Pareto optimal allocations and dynamic programming. (2009). Sitarz, Sebastian.
    In: Annals of Operations Research.
    RePEc:spr:annopr:v:172:y:2009:i:1:p:203-219:10.1007/s10479-009-0558-8.

    Full description at Econpapers || Download paper

  40. Risk sensitive allocations with multiple goods in international finance. Existence, survivorship, and dynamics.. (2009). Colacito, Riccardo ; Croce, Mariano.
    In: 2009 Meeting Papers.
    RePEc:red:sed009:1201.

    Full description at Econpapers || Download paper

  41. Managing expectations and fiscal policy. (2009). Sargent, Thomas ; Karantounias, Anastasios ; Hansen, Lars ; Anastasios G. Karantounias with Lars Peter Hansen, .
    In: FRB Atlanta Working Paper.
    RePEc:fip:fedawp:2009-29.

    Full description at Econpapers || Download paper

  42. Risk sharing for the long-run. The benefits from financial integration.. (2008). Colacito, Riccardo.
    In: 2008 Meeting Papers.
    RePEc:red:sed008:985.

    Full description at Econpapers || Download paper

  43. Recursive robust estimation and control without commitment. (2007). Sargent, Thomas ; Hansen, Lars.
    In: Journal of Economic Theory.
    RePEc:eee:jetheo:v:136:y:2007:i:1:p:1-27.

    Full description at Econpapers || Download paper

  44. Risks For The Long Run And The Real Exchange Rate. (2005). Croce, Mariano ; Colacito, Riccardo.
    In: 2005 Meeting Papers.
    RePEc:red:sed005:794.

    Full description at Econpapers || Download paper

Coauthors

Authors registered in RePEc who have wrote about the same topic

Report date: 2025-10-03 22:15:16 || Missing content? Let us know

CitEc is a RePEc service, providing citation data for Economics since 2001. Last updated August, 3 2024. Contact: Jose Manuel Barrueco.