Academic literature on the topic 'Markov processes'
Create a spot-on reference in APA, MLA, Chicago, Harvard, and other styles
Consult the lists of relevant articles, books, theses, conference reports, and other scholarly sources on the topic 'Markov processes.'
Next to every source in the list of references, there is an 'Add to bibliography' button. Press on it, and we will generate automatically the bibliographic reference to the chosen work in the citation style you need: APA, MLA, Harvard, Chicago, Vancouver, etc.
You can also download the full text of the academic publication as pdf and read online its abstract whenever available in the metadata.
Journal articles on the topic "Markov processes"
Demenkov, N. P., E. A. Mirkin, and I. A. Mochalov. "Markov and Semi-Markov Processes with Fuzzy States. Part 1. Markov Processes." Informacionnye tehnologii 26, no. 6 (June 23, 2020): 323–34. http://dx.doi.org/10.17587/it.26.323-334.
Full textFRANZ, UWE. "CLASSICAL MARKOV PROCESSES FROM QUANTUM LÉVY PROCESSES." Infinite Dimensional Analysis, Quantum Probability and Related Topics 02, no. 01 (March 1999): 105–29. http://dx.doi.org/10.1142/s0219025799000060.
Full textDemenkov, N. P., E. A. Mirkin, and I. A. Mochalov. "Markov and Semi-Markov Processes with Fuzzy States. Part 2. Semi-Markov Processes." INFORMACIONNYE TEHNOLOGII 26, no. 7 (July 17, 2020): 387–93. http://dx.doi.org/10.17587/it.26.387-393.
Full textWhittle, P., and M. L. Puterman. "Markov Decision Processes." Journal of the Royal Statistical Society. Series A (Statistics in Society) 158, no. 3 (1995): 636. http://dx.doi.org/10.2307/2983459.
Full textSmith, J. Q., and D. J. White. "Markov Decision Processes." Journal of the Royal Statistical Society. Series A (Statistics in Society) 157, no. 1 (1994): 164. http://dx.doi.org/10.2307/2983520.
Full textKing, Aaron A., Qianying Lin, and Edward L. Ionides. "Markov genealogy processes." Theoretical Population Biology 143 (February 2022): 77–91. http://dx.doi.org/10.1016/j.tpb.2021.11.003.
Full textThomas, L. C., D. J. White, and Martin L. Puterman. "Markov Decision Processes." Journal of the Operational Research Society 46, no. 6 (June 1995): 792. http://dx.doi.org/10.2307/2584317.
Full textEphraim, Y., and N. Merhav. "Hidden Markov processes." IEEE Transactions on Information Theory 48, no. 6 (June 2002): 1518–69. http://dx.doi.org/10.1109/tit.2002.1003838.
Full textBäuerle, Nicole, and Ulrich Rieder. "Markov Decision Processes." Jahresbericht der Deutschen Mathematiker-Vereinigung 112, no. 4 (September 8, 2010): 217–43. http://dx.doi.org/10.1365/s13291-010-0007-2.
Full textWal, J., and J. Wessels. "MARKOV DECISION PROCESSES." Statistica Neerlandica 39, no. 2 (June 1985): 219–33. http://dx.doi.org/10.1111/j.1467-9574.1985.tb01140.x.
Full textDissertations / Theses on the topic "Markov processes"
Desharnais, Josée. "Labelled Markov processes." Thesis, National Library of Canada = Bibliothèque nationale du Canada, 1999. http://www.collectionscanada.ca/obj/s4/f2/dsk1/tape3/PQDD_0031/NQ64546.pdf.
Full textBalan, Raluca M. "Set-Markov processes." Thesis, National Library of Canada = Bibliothèque nationale du Canada, 2001. http://www.collectionscanada.ca/obj/s4/f2/dsk3/ftp04/NQ66119.pdf.
Full textEltannir, Akram A. "Markov interactive processes." Diss., Georgia Institute of Technology, 1993. http://hdl.handle.net/1853/30745.
Full textHaugomat, Tristan. "Localisation en espace de la propriété de Feller avec application aux processus de type Lévy." Thesis, Rennes 1, 2018. http://www.theses.fr/2018REN1S046/document.
Full textIn this PhD thesis, we give a space localisation for the theory of Feller processes. A first objective is to obtain simple and precise results on the convergence of Markov processes. A second objective is to study the link between the notions of Feller property, martingale problem and Skorokhod topology. First we give a localised version of the Skorokhod topology. We study the notions of compactness and tightness for this topology. We make the connexion between localised and unlocalised Skorokhod topologies, by using the notion of time change. In a second step, using the localised Skorokhod topology and the time change, we study martingale problems. We show the equivalence between, on the one hand, to be solution of a well-posed martingale problem, on the other hand, to satisfy a localised version of the Feller property, and finally, to be a Markov process weakly continuous with respect to the initial condition. We characterise the weak convergence for solutions of martingale problems in terms of convergence of associated operators and give a similar result for discrete time approximations. Finally, we apply the theory of locally Feller process to some examples. We first apply it to the Lévy-type processes and obtain convergence results for discrete and continuous time processes, including simulation methods and Euler’s schemes. We then apply the same theory to one-dimensional diffusions in a potential and we obtain convergence results of diffusions or random walks towards singular diffusions. As a consequences, we deduce the convergence of random walks in random environment towards diffusions in random potential
莊競誠 and King-sing Chong. "Explorations in Markov processes." Thesis, The University of Hong Kong (Pokfulam, Hong Kong), 1997. http://hub.hku.hk/bib/B31235682.
Full textJames, Huw William. "Transient Markov decision processes." Thesis, University of Bristol, 2006. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.430192.
Full textKu, Ho Ming. "Interacting Markov branching processes." Thesis, University of Liverpool, 2014. http://livrepository.liverpool.ac.uk/2002759/.
Full textChong, King-sing. "Explorations in Markov processes /." Hong Kong : University of Hong Kong, 1997. http://sunzi.lib.hku.hk/hkuto/record.jsp?B18736105.
Full textPötzelberger, Klaus. "On the Approximation of finite Markov-exchangeable processes by mixtures of Markov Processes." Department of Statistics and Mathematics, WU Vienna University of Economics and Business, 1991. http://epub.wu.ac.at/526/1/document.pdf.
Full textSeries: Forschungsberichte / Institut für Statistik
Ferns, Norman Francis. "Metrics for Markov decision processes." Thesis, McGill University, 2003. http://digitool.Library.McGill.CA:80/R/?func=dbin-jump-full&object_id=80263.
Full textBooks on the topic "Markov processes"
White, D. J. Markov decision processes. New York: John Wiley & Sons, 1993.
Find full textEthier, Stewart N., and Thomas G. Kurtz, eds. Markov Processes. Hoboken, NJ, USA: John Wiley & Sons, Inc., 1986. http://dx.doi.org/10.1002/9780470316658.
Full textPuterman, Martin L., ed. Markov Decision Processes. Hoboken, NJ, USA: John Wiley & Sons, Inc., 1994. http://dx.doi.org/10.1002/9780470316887.
Full textHou, Zhenting, Jerzy A. Filar, and Anyue Chen, eds. Markov Processes and Controlled Markov Chains. Boston, MA: Springer US, 2002. http://dx.doi.org/10.1007/978-1-4613-0265-0.
Full textZhenting, Hou, Filar Jerzy A. 1949-, and Chen Anyue, eds. Markov processes and controlled Markov chains. Dordrecht: Kluwer Academic Publishers, 2002.
Find full textPardoux, Étienne. Markov Processes and Applications. Chichester, UK: John Wiley & Sons, Ltd, 2008. http://dx.doi.org/10.1002/9780470721872.
Full textZhenting, Hou, and Guo Qingfeng. Homogeneous Denumerable Markov Processes. Berlin, Heidelberg: Springer Berlin Heidelberg, 1988. http://dx.doi.org/10.1007/978-3-642-68127-1.
Full textKomorowski, Tomasz, Claudio Landim, and Stefano Olla. Fluctuations in Markov Processes. Berlin, Heidelberg: Springer Berlin Heidelberg, 2012. http://dx.doi.org/10.1007/978-3-642-29880-6.
Full textBlumenthal, Robert M. Excursions of Markov Processes. Boston, MA: Birkhäuser Boston, 1992. http://dx.doi.org/10.1007/978-1-4684-9412-9.
Full textHernández-Lerma, O. Adaptive Markov Control Processes. New York, NY: Springer New York, 1989. http://dx.doi.org/10.1007/978-1-4419-8714-3.
Full textBook chapters on the topic "Markov processes"
Itô, Kiyosi. "Markov Processes." In Stochastic Processes, 93–178. Berlin, Heidelberg: Springer Berlin Heidelberg, 2004. http://dx.doi.org/10.1007/978-3-662-10065-3_3.
Full textNagasawa, Masao. "Markov Processes." In Stochastic Processes in Quantum Physics, 1–26. Basel: Birkhäuser Basel, 2000. http://dx.doi.org/10.1007/978-3-0348-8383-2_1.
Full textGardiner, Crispin W. "Markov Processes." In Springer Series in Synergetics, 42–79. Berlin, Heidelberg: Springer Berlin Heidelberg, 1985. http://dx.doi.org/10.1007/978-3-662-02452-2_3.
Full textGardiner, Crispin W. "Markov Processes." In Springer Series in Synergetics, 42–79. Berlin, Heidelberg: Springer Berlin Heidelberg, 2004. http://dx.doi.org/10.1007/978-3-662-05389-8_3.
Full textPoler, Raúl, Josefa Mula, and Manuel Díaz-Madroñero. "Markov Processes." In Operations Research Problems, 375–419. London: Springer London, 2013. http://dx.doi.org/10.1007/978-1-4471-5577-5_10.
Full textČepin, Marko. "Markov Processes." In Assessment of Power System Reliability, 113–18. London: Springer London, 2011. http://dx.doi.org/10.1007/978-0-85729-688-7_8.
Full textJacobs, Konrad. "Markov Processes." In Discrete Stochastics, 119–54. Basel: Birkhäuser Basel, 1992. http://dx.doi.org/10.1007/978-3-0348-8645-1_6.
Full textRudnicki, Ryszard, and Marta Tyran-Kamińska. "Markov Processes." In Piecewise Deterministic Processes in Biological Models, 33–62. Cham: Springer International Publishing, 2017. http://dx.doi.org/10.1007/978-3-319-61295-9_2.
Full textNelson, Randolph. "Markov Processes." In Probability, Stochastic Processes, and Queueing Theory, 329–89. New York, NY: Springer New York, 1995. http://dx.doi.org/10.1007/978-1-4757-2426-4_8.
Full textAlfa, Attahiru Sule. "Markov Processes." In Queueing Theory for Telecommunications, 11–78. Boston, MA: Springer US, 2010. http://dx.doi.org/10.1007/978-1-4419-7314-6_2.
Full textConference papers on the topic "Markov processes"
Budgett, Stephanie, Azam Asanjarani, and Heti Afimeimounga. "Visualizing Markov Processes." In Bridging the Gap: Empowering and Educating Today’s Learners in Statistics. International Association for Statistical Education, 2022. http://dx.doi.org/10.52041/iase.icots11.t10f3.
Full textMladenov, Martin, Craig Boutilier, Dale Schuurmans, Ofer Meshi, Gal Elidan, and Tyler Lu. "Logistic Markov Decision Processes." In Twenty-Sixth International Joint Conference on Artificial Intelligence. California: International Joint Conferences on Artificial Intelligence Organization, 2017. http://dx.doi.org/10.24963/ijcai.2017/346.
Full textHutter, Marcus. "Feature Markov Decision Processes." In 2nd Conference on Artificial General Intelligence 2009. Paris, France: Atlantis Press, 2009. http://dx.doi.org/10.2991/agi.2009.30.
Full textHawkes, Alan G. "Markov processes in APL." In Conference proceedings. New York, New York, USA: ACM Press, 1990. http://dx.doi.org/10.1145/97808.97843.
Full textKumar, Ravi, Maithra Raghu, Tamás Sarlós, and Andrew Tomkins. "Linear Additive Markov Processes." In WWW '17: 26th International World Wide Web Conference. Republic and Canton of Geneva, Switzerland: International World Wide Web Conferences Steering Committee, 2017. http://dx.doi.org/10.1145/3038912.3052644.
Full textTzortzis, Ioannis, Charalambos D. Charalambous, Themistoklis Charalambous, Christoforos N. Hadjicostis, and Mikael Johansson. "Approximation of Markov processes by lower dimensional processes." In 2014 IEEE 53rd Annual Conference on Decision and Control (CDC). IEEE, 2014. http://dx.doi.org/10.1109/cdc.2014.7040082.
Full textYu, Jia Yuan, and Shie Mannor. "Arbitrarily modulated Markov decision processes." In 2009 Joint 48th IEEE Conference on Decision and Control (CDC) and 28th Chinese Control Conference (CCC). IEEE, 2009. http://dx.doi.org/10.1109/cdc.2009.5400662.
Full textKozen, Dexter, Kim G. Larsen, Radu Mardare, and Prakash Panangaden. "Stone Duality for Markov Processes." In 2013 Twenty-Eighth Annual IEEE/ACM Symposium on Logic in Computer Science (LICS 2013). IEEE, 2013. http://dx.doi.org/10.1109/lics.2013.38.
Full textBrázdil, T., V. Brožek, K. Etessami, A. Kučera, and D. Wojtczak. "One-Counter Markov Decision Processes." In Proceedings of the Twenty-First Annual ACM-SIAM Symposium on Discrete Algorithms. Philadelphia, PA: Society for Industrial and Applied Mathematics, 2010. http://dx.doi.org/10.1137/1.9781611973075.70.
Full textHölzl, Johannes. "Markov processes in Isabelle/HOL." In CPP '17: Certified Proofs and Programs. New York, NY, USA: ACM, 2017. http://dx.doi.org/10.1145/3018610.3018628.
Full textReports on the topic "Markov processes"
Adler, Robert J., Stamatis Gambanis, and Gennady Samorodnitsky. On Stable Markov Processes. Fort Belvoir, VA: Defense Technical Information Center, September 1987. http://dx.doi.org/10.21236/ada192892.
Full textAbdel-Hameed, M. Markovian Shock Models, Deterioration Processes, Stratified Markov Processes Replacement Policies. Fort Belvoir, VA: Defense Technical Information Center, December 1985. http://dx.doi.org/10.21236/ada174646.
Full textNewell, Alan. Markovian Shock Models, Deterioration Processes, Stratified Markov Processes and Replacement Policies. Fort Belvoir, VA: Defense Technical Information Center, May 1986. http://dx.doi.org/10.21236/ada174995.
Full textDueker, Michael J. Markov Switching in GARCH Processes and Mean Reverting Stock Market Volatility. Federal Reserve Bank of St. Louis, 1994. http://dx.doi.org/10.20955/wp.1994.015.
Full textCinlar, E. Markov Processes Applied to Control, Reliability and Replacement. Fort Belvoir, VA: Defense Technical Information Center, April 1989. http://dx.doi.org/10.21236/ada208634.
Full textRohlicek, J. R., and A. S. Willsky. Structural Decomposition of Multiple Time Scale Markov Processes,. Fort Belvoir, VA: Defense Technical Information Center, October 1987. http://dx.doi.org/10.21236/ada189739.
Full textSerfozo, Richard F. Poisson Functionals of Markov Processes and Queueing Networks. Fort Belvoir, VA: Defense Technical Information Center, December 1987. http://dx.doi.org/10.21236/ada191217.
Full textSerfozo, R. F. Poisson Functionals of Markov Processes and Queueing Networks,. Fort Belvoir, VA: Defense Technical Information Center, December 1987. http://dx.doi.org/10.21236/ada194289.
Full textDraper, Bruce A., and J. Ross Beveridge. Learning to Populate Geospatial Databases via Markov Processes. Fort Belvoir, VA: Defense Technical Information Center, December 1999. http://dx.doi.org/10.21236/ada374536.
Full textChang, Hyeong S., Michael C. Fu, and Steven I. Marcus. An Adaptive Sampling Algorithm for Solving Markov Decision Processes. Fort Belvoir, VA: Defense Technical Information Center, May 2002. http://dx.doi.org/10.21236/ada438505.
Full text