Relevant bibliographies by topics / Multi-Objective Markov Decision Processes

Academic literature on the topic 'Multi-Objective Markov Decision Processes'

Author: Grafiati
Published: 10 December 2022
Last updated: 29 January 2023

Create a spot-on reference in APA, MLA, Chicago, Harvard, and other styles

Select a source type:

Contents

Consult the lists of relevant articles, books, theses, conference reports, and other scholarly sources on the topic 'Multi-Objective Markov Decision Processes.'

Next to every source in the list of references, there is an 'Add to bibliography' button. Press on it, and we will generate automatically the bibliographic reference to the chosen work in the citation style you need: APA, MLA, Harvard, Chicago, Vancouver, etc.

You can also download the full text of the academic publication as pdf and read online its abstract whenever available in the metadata.

Journal articles on the topic "Multi-Objective Markov Decision Processes"

1

Wakuta, K., and K. Togawa. "Solution procedures for multi-objective markov decision processes." Optimization 43, no. 1 (January 1998): 29–46. http://dx.doi.org/10.1080/02331939808844372.

Full text
APA, Harvard, Vancouver, ISO, and other styles
2

Ahn, Hyun-Soo, and Rhonda Righter. "Multi-Actor Markov Decision Processes." Journal of Applied Probability 42, no. 1 (March 2005): 15–26. http://dx.doi.org/10.1239/jap/1110381367.

Full text
Abstract:
We give a very general reformulation of multi-actor Markov decision processes and show that there is a tendency for the actors to take the same action whenever possible. This considerably reduces the complexity of the problem, either facilitating numerical computation of the optimal policy or providing a basis for a heuristic.
APA, Harvard, Vancouver, ISO, and other styles
3

Ahn, Hyun-Soo, and Rhonda Righter. "Multi-Actor Markov Decision Processes." Journal of Applied Probability 42, no. 01 (March 2005): 15–26. http://dx.doi.org/10.1017/s0021900200000024.

Full text
Abstract:
We give a very general reformulation of multi-actor Markov decision processes and show that there is a tendency for the actors to take the same action whenever possible. This considerably reduces the complexity of the problem, either facilitating numerical computation of the optimal policy or providing a basis for a heuristic.
APA, Harvard, Vancouver, ISO, and other styles
4

LIU, QIU-SHENG, KATSUHISA OHNO, and HIROTAKA NAKAYAMA. "Multi-objective discounted Markov decision processes with expectation and variance criteria." International Journal of Systems Science 23, no. 6 (June 1992): 903–14. http://dx.doi.org/10.1080/00207729208949257.

Full text
APA, Harvard, Vancouver, ISO, and other styles
5

Fujita, Toshiharu, and Akifumi Kira. "Mutually Dependent Markov Decision Processes." Journal of Advanced Computational Intelligence and Intelligent Informatics 18, no. 6 (November 20, 2014): 992–98. http://dx.doi.org/10.20965/jaciii.2014.p0992.

Full text
Abstract:
In this paper, we introduce a basic framework for mutually dependent Markov decision processes (MDMDP) showing recursive mutual dependence. Our model is structured upon two types of finite-stage Markov decision processes. At each stage, the reward in one process is given by the optimal value of the alternative process problem, whose initial state is determined by the current state and decision in the original process. We formulate the MDMDP model and derive mutually dependent recursive equations by dynamic programming. Furthermore, MDMDP is illustrated in a numerical example. The model enables easier treatment of some classes of complex multi-stage decision processes.
APA, Harvard, Vancouver, ISO, and other styles
6

Mandow, L., J. L. Perez-de-la-Cruz, and N. Pozas. "Multi-objective dynamic programming with limited precision." Journal of Global Optimization 82, no. 3 (November 2, 2021): 595–614. http://dx.doi.org/10.1007/s10898-021-01096-x.

Full text
Abstract:
AbstractThis paper addresses the problem of approximating the set of all solutions for Multi-objective Markov Decision Processes. We show that in the vast majority of interesting cases, the number of solutions is exponential or even infinite. In order to overcome this difficulty we propose to approximate the set of all solutions by means of a limited precision approach based on White’s multi-objective value-iteration dynamic programming algorithm. We prove that the number of calculated solutions is tractable and show experimentally that the solutions obtained are a good approximation of the true Pareto front.
APA, Harvard, Vancouver, ISO, and other styles
7

Wernz, Christian. "Multi-time-scale Markov decision processes for organizational decision-making." EURO Journal on Decision Processes 1, no. 3-4 (November 2013): 299–324. http://dx.doi.org/10.1007/s40070-013-0020-7.

Full text
APA, Harvard, Vancouver, ISO, and other styles
8

Bouyer, Patricia, Mauricio González, Nicolas Markey, and Mickael Randour. "Multi-weighted Markov Decision Processes with Reachability Objectives." Electronic Proceedings in Theoretical Computer Science 277 (September 7, 2018): 250–64. http://dx.doi.org/10.4204/eptcs.277.18.

Full text
APA, Harvard, Vancouver, ISO, and other styles
9

White, D. J. "An Heuristic for Multi-Dimensional Markov Decision Processes." Journal of Information and Optimization Sciences 14, no. 2 (May 1993): 203–19. http://dx.doi.org/10.1080/02522667.1993.10699150.

Full text
APA, Harvard, Vancouver, ISO, and other styles
10

Randour, Mickael, Jean-François Raskin, and Ocan Sankur. "Percentile queries in multi-dimensional Markov decision processes." Formal Methods in System Design 50, no. 2-3 (January 5, 2017): 207–48. http://dx.doi.org/10.1007/s10703-016-0262-7.

Full text
APA, Harvard, Vancouver, ISO, and other styles
More sources

Dissertations / Theses on the topic "Multi-Objective Markov Decision Processes"

1

Pratikakis, Nikolaos. "Multistage decisions and risk in Markov decision processes towards effective approximate dynamic programming architectures /." Diss., Atlanta, Ga. : Georgia Institute of Technology, 2008. http://hdl.handle.net/1853/31654.

Full text
Abstract:
Thesis (Ph.D)--Chemical Engineering, Georgia Institute of Technology, 2009.
Committee Chair: Jay H. Lee; Committee Member: Martha Grover; Committee Member: Matthew J. Realff; Committee Member: Shabbir Ahmed; Committee Member: Stylianos Kavadias. Part of the SMARTech Electronic Thesis and Dissertation Collection.
APA, Harvard, Vancouver, ISO, and other styles
2

Dorff, Rebecca. "Modelling Infertility with Markov Chains." BYU ScholarsArchive, 2013. https://scholarsarchive.byu.edu/etd/4070.

Full text
Abstract:
Infertility affects approximately 15% of couples. Testing and interventions are costly, in time, money, and emotional energy. This paper will discuss using Markov decision and multi-armed bandit processes to identify a systematic approach of interventions that will lead to the desired baby while minimizing costs.
APA, Harvard, Vancouver, ISO, and other styles
3

Chen, Yu Fan Ph D. Massachusetts Institute of Technology. "Hierarchical decomposition of multi-agent Markov decision processes with application to health aware planning." Thesis, Massachusetts Institute of Technology, 2014. http://hdl.handle.net/1721.1/93795.

Full text
Abstract:
Thesis: S.M., Massachusetts Institute of Technology, Department of Aeronautics and Astronautics, 2014.
Cataloged from PDF version of thesis.
Includes bibliographical references (pages 99-104).
Multi-agent robotic systems have attracted the interests of both researchers and practitioners because they provide more capabilities and afford greater flexibility than single-agent systems. Coordination of individual agents within large teams is often challenging because of the combinatorial nature of such problems. In particular, the number of possible joint configurations is the product of that of every agent. Further, real world applications often contain various sources of uncertainties. This thesis investigates techniques to address the scalability issue of multi-agent planning under uncertainties. This thesis develops a novel hierarchical decomposition approach (HD-MMDP) for solving Multi-agent Markov Decision Processes (MMDPs), which is a natural framework for formulating stochastic sequential decision-making problems. In particular, the HD-MMDP algorithm builds a decomposition structure by exploiting coupling relationships in the reward function. A number of smaller subproblems are formed and are solved individually. The planning spaces of each subproblem are much smaller than that of the original problem, which improves the computational efficiency, and the solutions to the subproblems can be combined to form a solution (policy) to the original problem. The HD-MMDP algorithm is applied on a ten agent persistent search and track (PST) mission and shows more than 35% improvement over an existing algorithm developed specifically for this domain. This thesis also contributes to the development of the software infrastructure that enables hardware experiments involving multiple robots. In particular, the thesis presents a novel optimization based multi-agent path planning algorithm, which was tested in simulation and hardware (quadrotor) experiment. The HD-MMDP algorithm is also used to solve a multi-agent intruder monitoring mission implemented using real robots.
by Yu Fan Chen.
S.M.
APA, Harvard, Vancouver, ISO, and other styles
4

Omidshafiei, Shayegan. "Decentralized control of multi-robot systems using partially observable Markov Decision Processes and belief space macro-actions." Thesis, Massachusetts Institute of Technology, 2015. http://hdl.handle.net/1721.1/101447.

Full text
Abstract:
Thesis: S.M., Massachusetts Institute of Technology, Department of Aeronautics and Astronautics, 2015.
This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.
Cataloged from student-submitted PDF version of thesis.
Includes bibliographical references (pages 129-139).
Planning, control, perception, and learning for multi-robot systems present signicant challenges. Transition dynamics of the robots may be stochastic, making it difficult to select the best action each robot should take at a given time. The observation model, a function of the robots' sensors, may be noisy or partial, meaning that deterministic knowledge of the team's state is often impossible to attain. Robots designed for real-world applications require careful consideration of such sources of uncertainty. This thesis contributes a framework for multi-robot planning in continuous spaces with partial observability. Decentralized Partially Observable Markov Decision Processes (Dec-POMDPs) are general models for multi-robot coordination problems. However, representing and solving Dec-POMDPs is often intractable for large problems. This thesis extends the Dec-POMDP framework to the Decentralized Partially Observable Semi-Markov Decision Process (Dec-POSMDP), taking advantage of high- level representations that are natural for multi-robot problems. Dec-POSMDPs allow asynchronous decision-making, which is crucial in multi-robot domains. This thesis also presents algorithms for solving Dec-POSMDPs, which are more scalable than previous methods due to use of closed-loop macro-actions in planning. The proposed framework's performance is evaluated in a constrained multi-robot package delivery domain, showing its ability to provide high-quality solutions for large problems. Due to the probabilistic nature of state transitions and observations, robots operate in belief space, the space of probability distributions over all of their possible states. This thesis also contributes a hardware platform called Measurable Augmented Reality for Prototyping Cyber-Physical Systems (MAR-CPS). MAR-CPS allows real-time visualization of the belief space in laboratory settings.
by Shayegan Omidshafiei.
S.M.
APA, Harvard, Vancouver, ISO, and other styles
5

Dorini, Gianluca. "The neighbour search approach for solving multi-objectie Markov Decision Processes, and the application in reservoirs operation planning." Thesis, University of Exeter, 2007. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.445450.

Full text
APA, Harvard, Vancouver, ISO, and other styles
6

Fowler, Michael C. "Intelligent Knowledge Distribution for Multi-Agent Communication, Planning, and Learning." Diss., Virginia Tech, 2020. http://hdl.handle.net/10919/97996.

Full text
Abstract:
This dissertation addresses a fundamental question of multi-agent coordination: what infor- mation should be sent to whom and when, with the limited resources available to each agent? Communication requirements for multi-agent systems can be rather high when an accurate picture of the environment and the state of other agents must be maintained. To reduce the impact of multi-agent coordination on networked systems, e.g., power and bandwidth, this dissertation introduces new concepts to enable Intelligent Knowledge Distribution (IKD), including Constrained-action POMDPs (CA-POMDP) and concurrent decentralized (CoDec) POMDPs for an agnostic plug-and-play capability for fully autonomous systems. Each agent runs a CoDec POMDP where all the decision making (motion planning, task allocation, asset monitoring, and communication) are separated into concurrent individual MDPs to reduce the combinatorial explosion of the action and state space while maintaining dependencies between the models. We also introduce the CA-POMDP with action-based constraints on partially observable Markov decision processes, rewards driven by the value of information, and probabilistic constraint satisfaction through discrete optimization and Markov chain Monte Carlo analysis. IKD is adapted real-time through machine learning of the actual environmental impacts on the behavior of the system, including collaboration strategies between autonomous agents, the true value of information between heterogeneous systems, observation probabilities and resource utilization.
Doctor of Philosophy
This dissertation addresses a fundamental question behind when multiple autonomous sys- tems, like drone swarms, in the field need to coordinate and share data: what information should be sent to whom and when, with the limited resources available to each agent? Intelligent Knowledge Distribution is a framework that answers these questions. Communication requirements for multi-agent systems can be rather high when an accurate picture of the environment and the state of other agents must be maintained. To reduce the impact of multi-agent coordination on networked systems, e.g., power and bandwidth, this dissertation introduces new concepts to enable Intelligent Knowledge Distribution (IKD), including Constrained-action POMDPs and concurrent decentralized (CoDec) POMDPs for an agnostic plug-and-play capability for fully autonomous systems. The IKD model was able to demonstrate its validity as a "plug-and-play" library that manages communications between agents that ensures the right information is being transmitted at the right time to the right agent to ensure mission success.
APA, Harvard, Vancouver, ISO, and other styles
7

Leung, Hiu-lan, and 梁曉蘭. "Wandering ideal point models for single or multi-attribute ranking data: a Bayesian approach." Thesis, The University of Hong Kong (Pokfulam, Hong Kong), 2003. http://hub.hku.hk/bib/B29552357.

Full text
APA, Harvard, Vancouver, ISO, and other styles
8

Murugesan, Sugumar. "Opportunistic Scheduling Using Channel Memory in Markov-modeled Wireless Networks." The Ohio State University, 2010. http://rave.ohiolink.edu/etdc/view?acc_num=osu1282065836.

Full text
APA, Harvard, Vancouver, ISO, and other styles
9

Raffensperger, Peter Abraham. "Measuring and Influencing Sequential Joint Agent Behaviours." Thesis, University of Canterbury. Electrical and Computer Engineering, 2013. http://hdl.handle.net/10092/7472.

Full text
Abstract:
Algorithmically designed reward functions can influence groups of learning agents toward measurable desired sequential joint behaviours. Influencing learning agents toward desirable behaviours is non-trivial due to the difficulties of assigning credit for global success to the deserving agents and of inducing coordination. Quantifying joint behaviours lets us identify global success by ranking some behaviours as more desirable than others. We propose a real-valued metric for turn-taking, demonstrating how to measure one sequential joint behaviour. We describe how to identify the presence of turn-taking in simulation results and we calculate the quantity of turn-taking that could be observed between independent random agents. We demonstrate our turn-taking metric by reinterpreting previous work on turn-taking in emergent communication and by analysing a recorded human conversation. Given a metric, we can explore the space of reward functions and identify those reward functions that result in global success in groups of learning agents. We describe 'medium access games' as a model for human and machine communication and we present simulation results for an extensive range of reward functions for pairs of Q-learning agents. We use the Nash equilibria of medium access games to develop predictors for determining which reward functions result in turn-taking. Having demonstrated the predictive power of Nash equilibria for turn-taking in medium access games, we focus on synthesis of reward functions for stochastic games that result in arbitrary desirable Nash equilibria. Our method constructs a reward function such that a particular joint behaviour is the unique Nash equilibrium of a stochastic game, provided that such a reward function exists. This method builds on techniques for designing rewards for Markov decision processes and for normal form games. We explain our reward design methods in detail and formally prove that they are correct.
APA, Harvard, Vancouver, ISO, and other styles
10

Lafleur, Jarret Marshall. "A Markovian state-space framework for integrating flexibility into space system design decisions." Diss., Georgia Institute of Technology, 2011. http://hdl.handle.net/1853/43749.

Full text
Abstract:
The past decades have seen the state of the art in aerospace system design progress from a scope of simple optimization to one including robustness, with the objective of permitting a single system to perform well even in off-nominal future environments. Integrating flexibility, or the capability to easily modify a system after it has been fielded in response to changing environments, into system design represents a further step forward. One challenge in accomplishing this rests in that the decision-maker must consider not only the present system design decision, but also sequential future design and operation decisions. Despite extensive interest in the topic, the state of the art in designing flexibility into aerospace systems, and particularly space systems, tends to be limited to analyses that are qualitative, deterministic, single-objective, and/or limited to consider a single future time period. To address these gaps, this thesis develops a stochastic, multi-objective, and multi-period framework for integrating flexibility into space system design decisions. Central to the framework are five steps. First, system configuration options are identified and costs of switching from one configuration to another are compiled into a cost transition matrix. Second, probabilities that demand on the system will transition from one mission to another are compiled into a mission demand Markov chain. Third, one performance matrix for each design objective is populated to describe how well the identified system configurations perform in each of the identified mission demand environments. The fourth step employs multi-period decision analysis techniques, including Markov decision processes (MDPs) from the field of operations research, to find efficient paths and policies a decision-maker may follow. The final step examines the implications of these paths and policies for the primary goal of informing initial system selection. Overall, this thesis unifies state-centric concepts of flexibility from economics and engineering literature with sequential decision-making techniques from operations research. The end objective of this thesis' framework and its supporting analytic and computational tools is to enable selection of the next-generation space systems today, tailored to decision-maker budget and performance preferences, that will be best able to adapt and perform in a future of changing environments and requirements. Following extensive theoretical development, the framework and its steps are applied to space system planning problems of (1) DARPA-motivated multiple- or distributed-payload satellite selection and (2) NASA human space exploration architecture selection.
APA, Harvard, Vancouver, ISO, and other styles
More sources

Books on the topic "Multi-Objective Markov Decision Processes"

1

White, D. J. Dynamic programming, Markov decision processes and value, efficiency and multiple objective methods. Birmingham: University of Birmingham, 1986.

Find full text
APA, Harvard, Vancouver, ISO, and other styles
2

Kovalyov, Anatoliy, ed. Scientific problems of management at the macro-, meso- and microeconomic levels:Proceedings of the XIX International scientific-practical conference dedicated to the 100th anniversary of Odessa National Economic University, May 17-18, 2021. Odessa National Economic University, 2021. http://dx.doi.org/10.32680/978-966-992-589-3.

Full text
Abstract:
Peculiarities of Ukraine's economic development in recent years are characterized by the process of systemic institutional transformation. Deep economic changes are taking place, new approaches to economic management are being actively formed, market management methods are being improved, European integration processes are being implemented, and Ukrainian legislation is being adapted and changed in accordance with the EU regulatory framework. The complexity and contradictions of modern transformation processes, the urgency of solving these and other problems determines the relevance and application of their comprehensive study and objective economic and legal assessment. The current challenges and unfolding of the new global economic crisis in connection with the COVID-19 pandemic require a rethinking of the ongoing socio-economic processes and the adoption of adaptive or, in some cases, radical decisions in governing the country and protecting its national interests. The conference proceedings are aimed at scientists, graduate students and students of economic specialties of higher education institutions, as well as specialists of economic departments of enterprises and organizations.
APA, Harvard, Vancouver, ISO, and other styles
3

Kovalyov, Anatoliy, ed. Scientific problems of management at the macro-, meso- and microeconomic levels : Proceedings of the 20 th International Scientific and Practice Conference, April 14, 2022. Odessa. Odessa National Economic University, 2022. http://dx.doi.org/10.32680/npg.conf.oneu.2022.

Full text
Abstract:
The peculiarities of the Ukraine’s economy development during the last years are characterized by the process of systemic institutional transformation. Deep economic changes are occurring, new approaches to managing the economy are being actively formed, market management methods are being improved, European integration processes are being implemented, and Ukrainian legislation is being adapted and changed in accordance with the EU regulatory framework. The complexity and inconsistency of modern transformational processes, the urgency of solving these problems determines the relevance and applied meaning of their comprehensive study and objective economic and legal assessment. Modern challenges and unfolding of global economic crisis due to the COVID-19 pandemic, as well as the devastating consequences for all spheres of Ukraine’s vital activities in the conditions of military aggression by the Russian Federation, require a rethinking of the socio-economic processes that are taking place and making adaptive or radical decisions in managing the country and protecting its national interests The conference is designed to consolidate scientists and specialists around the solution of economic problems which appear before our country in these difficult conditions. The conference proceedings oriented towards scientists, postgraduate students and students of economic specialties of higher education institutions, as well as a specialists of economic divisions of enterprises and organizations.
APA, Harvard, Vancouver, ISO, and other styles
4

Keiser, Sandra, Deborah Vandermar, and Myrna B. Garner. Beyond Design. 5th ed. Fairchild Books, 2022. http://dx.doi.org/10.5040/9781501366581.

Full text
Abstract:
Beyond Design: The Synergy of Apparel Product Development, Fifth Edition maps the processes required to bring apparel products from concept to consumer. This full-color text takes students step-by-step through the decision-making involved in the pre-production processes of apparel product development including business, creative, technical, and production planning. Updated chapter content reflects evolving industry practice. It demonstrates how these processes must be coordinated to get the right product to market, when consumers want it, and at a price they are willing to pay in an increasingly digital environment. The text seeks to address how functional approaches vary depending on a business’s size and fashion focus. More global in scope, the fifth edition includes examples and case studies of multi-national companies and incorporates global nomenclature when it differs from the US industry. This new edition also advances its discussion of how new technologies continue to shorten the product development calendar. The book is written to help students anticipate the chaotic pace of change not only in fashion trends, but also in the fashion system itself. New to this Edition • Updated references and examples demonstrate how industry practice is changing to meet market demands • New case studies illustrate the impact of new technology and an evolving fashion system • An understanding of a circular economy expands upon how sustainability and social justice issues impact every function of product development, distribution, and consumption • The slow fashion/fast fashion dichotomy is considered as it impacts the fashion ecosystem • The issues of cultural appropriation and influencer culture are discussed Beyond Design STUDIO • Study smarter with self-quizzes featuring scored results and personalized study tips • Review concepts with flashcards of essential vocabulary Instructor Resources • Instructor's Guide provides suggestions for planning the course and using the text in the classroom, supplemental assignments, and lecture notes • PowerPoint® presentations include images from the book and provide a framework for lecture and discussion
APA, Harvard, Vancouver, ISO, and other styles
5

Grare, Frédéric. India’s and China’s Economic Standing in Asia. Oxford University Press, 2017. http://dx.doi.org/10.1093/oso/9780190859336.003.0008.

Full text
Abstract:
Although entwined with other motivations, the primary objective of the Look East Policy was and remains economic. Indian policy makers felt the need to bridge the gap caused by China’s twelve years year head start in liberalizing its economy or risk being marginalized in Asia. The two countries choose, however, radically different strategies:, China becoming became in the process a massive exporter of manufactured goods while India while India specializedspecialized in high-skill service exports, alongside manufactures but failing failed to expand the latter as much as expected. Foreign direct investment played a key role in the strategies of both countries, leading to substantial differences in export output. Because it was meant to develop an export strategy, FDI gave China a decisive advantage in the region. In India, FDI essentially targeted the domestic market and its contribution to manufactured product exports remained limited. China rapidly emerged as the pivot of the Asian export platform, a position that also enhanced its political influence across Asia.
APA, Harvard, Vancouver, ISO, and other styles
6

Trepulė, Elena, Airina Volungevičienė, Margarita Teresevičienė, Estela Daukšienė, Rasa Greenspon, Giedrė Tamoliūnė, Marius Šadauskas, and Gintarė Vaitonytė. Guidelines for open and online learning assessment and recognition with reference to the National and European qualification framework: micro-credentials as a proposal for tuning and transparency. Vytauto Didžiojo universitetas, 2021. http://dx.doi.org/10.7220/9786094674792.

Full text
Abstract:
These Guidelines are one of the results of the four-year research project “Open Online Learning for Digital and Networked Society” (2017-2021). The project objective was to enable university teachers to design open and online learning through open and online learning curriculum and environment applying learning analytics as a metacognitive tool and creating open and online learning assessment and recognition practices, responding to the needs of digital and networked society. The research of the project resulted in 10 scientific publications and 2 studies prepared by Vytautas Magnus university Institute of Innovative Studies research team in collaboration with their international research partners from Germany, Spain and Portugal. The final stage of the research attempted creating open and online learning assessment and recognition practices, responding to the learner needs in contemporary digital and networked society. The need for open learning recognition has been increasing during the recent decade while the developments of open learning related to the Covid 19 pandemics have dramatically increased the need for systematic and high-quality assessment and recognition of learning acquired online. The given time also relates to the increased need to offer micro-credentials to learners, as well as a rising need for universities to prepare for micro-credentialization and issue new digital credentials to learners who are regular students, as well as adult learners joining for single courses. The increased need of all labour - market participants for frequent and fast renewal of competences requires a well working and easy to use system of open learning assessment and recognition. For learners, it is critical that the micro-credentials are well linked to national and European qualification frameworks, as well as European digital credential infrastructures (e.g., Europass and similar). For employers, it is important to receive requested quality information that is encrypted in the metadata of the credential. While for universities, there is the need to properly prepare institutional digital infrastructure, organizational procedures, descriptions of open learning opportunities and virtual learning environments to share, import and export the meta-data easily and seamlessly through European Digital Hub service infrastructures, as well as ensure that academic and administrative staff has digital competencies to design, issue and recognise open learning through digital and micro-credentials. The first chapter of the Guidelines provides a background view of the European Qualification Framework and National Qualification frameworks for the further system of gaining, stacking and modelling further qualifications through open online learning. The second chapter suggests the review of current European policy papers and consultations on the establishment of micro-credentials in European higher education. The findings of the report of micro-credentials higher education consultation group “European Approach to Micro-credentials” is shortly introduced, as well as important policy discussions taking place. Responding to the Rome Bologna Comunique 2020, where the ministers responsible for higher education agreed to support lifelong learning through issuing micro-credentials, a joint endeavour of DG Employment, Social Affairs and Inclusion and DG Research and Innovation resulted in one of the most important political documents highlighting the potential of micro-credentials towards economic, social and education innovations. The consultation group of experts from the Member States defined the approach to micro-credentials to facilitate their validation, recognition and portability, as well as to foster a larger uptake to support individual learning in any subject area and at any stage of life or career. The Consultation Group also suggested further urgent topics to be discussed, including the storage, data exchange, portability, and data standards of micro-credentials and proposed EU Standard of constitutive elements of micro-credentials. The third chapter is devoted to the institutional readiness to issue and to recognize digital and micro-credentials. Universities need strategic decisions and procedures ready to be enacted for assessment of open learning and issuing micro-credentials. The administrative and academic staff needs to be aware and confident to follow these procedures while keeping the quality assurance procedures in place, as well. The process needs to include increasing teacher awareness in the processes of open learning assessment and the role of micro-credentials for the competitiveness of lifelong learners in general. When the strategic documents and procedures to assess open learning are in place and the staff is ready and well aware of the processes, the description of the courses and the virtual learning environment needs to be prepared to provide the necessary metadata for the assessment of open learning and issuing of micro-credentials. Different innovation-driven projects offer solutions: OEPass developed a pilot Learning Passport, based on European Diploma Supplement, MicroHE developed a portal Credentify for displaying, verifying and sharing micro-credential data. Credentify platform is using Blockchain technology and is developed to comply with European Qualifications Framework. Institutions, willing to join Credentify platform, should make strategic discussions to apply micro-credential metadata standards. The ECCOE project building on outcomes of OEPass and MicroHE offers an all-encompassing set of quality descriptors for credentials and the descriptions of learning opportunities in higher education. The third chapter also describes the requirements for university structures to interact with the Europass digital credentials infrastructure. In 2020, European Commission launched a new Europass platform with Digital Credential Infrastructure in place. Higher education institutions issuing micro-credentials linked to Europass digital credentials infrastructure may offer added value for the learners and can increase reliability and fraud-resistant information for the employers. However, before using Europass Digital Credentials, universities should fulfil the necessary preconditions that include obtaining a qualified electronic seal, installing additional software and preparing the necessary data templates. Moreover, the virtual learning environment needs to be prepared to export learning outcomes to a digital credential, maintaining and securing learner authentication. Open learning opportunity descriptions also need to be adjusted to transfer and match information for the credential meta-data. The Fourth chapter illustrates how digital badges as a type of micro-credentials in open online learning assessment may be used in higher education to create added value for the learners and employers. An adequately provided metadata allows using digital badges as a valuable tool for recognition in all learning settings, including formal, non-formal and informal.
APA, Harvard, Vancouver, ISO, and other styles
7

Sobczyk, Eugeniusz Jacek. Uciążliwość eksploatacji złóż węgla kamiennego wynikająca z warunków geologicznych i górniczych. Instytut Gospodarki Surowcami Mineralnymi i Energią PAN, 2022. http://dx.doi.org/10.33223/onermin/0222.

Full text
Abstract:
Hard coal mining is characterised by features that pose numerous challenges to its current operations and cause strategic and operational problems in planning its development. The most important of these include the high capital intensity of mining investment projects and the dynamically changing environment in which the sector operates, while the long-term role of the sector is dependent on factors originating at both national and international level. At the same time, the conditions for coal mining are deteriorating, the resources more readily available in active mines are being exhausted, mining depths are increasing, temperature levels in pits are rising, transport routes for staff and materials are getting longer, effective working time is decreasing, natural hazards are increasing, and seams with an increasing content of waste rock are being mined. The mining industry is currently in a very difficult situation, both in technical (mining) and economic terms. It cannot be ignored, however, that the difficult financial situation of Polish mining companies is largely exacerbated by their high operating costs. The cost of obtaining coal and its price are two key elements that determine the level of efficiency of Polish mines. This situation could be improved by streamlining the planning processes. This would involve striving for production planning that is as predictable as possible and, on the other hand, economically efficient. In this respect, it is helpful to plan the production from operating longwalls with full awareness of the complexity of geological and mining conditions and the resulting economic consequences. The constraints on increasing the efficiency of the mining process are due to the technical potential of the mining process, organisational factors and, above all, geological and mining conditions. The main objective of the monograph is to identify relations between geological and mining parameters and the level of longwall mining costs, and their daily output. In view of the above, it was assumed that it was possible to present the relationship between the costs of longwall mining and the daily coal output from a longwall as a function of onerous geological and mining factors. The monograph presents two models of onerous geological and mining conditions, including natural hazards, deposit (seam) parameters, mining (technical) parameters and environmental factors. The models were used to calculate two onerousness indicators, Wue and WUt, which synthetically define the level of impact of onerous geological and mining conditions on the mining process in relation to: —— operating costs at longwall faces – indicator WUe, —— daily longwall mining output – indicator WUt. In the next research step, the analysis of direct relationships of selected geological and mining factors with longwall costs and the mining output level was conducted. For this purpose, two statistical models were built for the following dependent variables: unit operating cost (Model 1) and daily longwall mining output (Model 2). The models served two additional sub-objectives: interpretation of the influence of independent variables on dependent variables and point forecasting. The models were also used for forecasting purposes. Statistical models were built on the basis of historical production results of selected seven Polish mines. On the basis of variability of geological and mining conditions at 120 longwalls, the influence of individual parameters on longwall mining between 2010 and 2019 was determined. The identified relationships made it possible to formulate numerical forecast of unit production cost and daily longwall mining output in relation to the level of expected onerousness. The projection period was assumed to be 2020–2030. On this basis, an opinion was formulated on the forecast of the expected unit production costs and the output of the 259 longwalls planned to be mined at these mines. A procedure scheme was developed using the following methods: 1) Analytic Hierarchy Process (AHP) – mathematical multi-criteria decision-making method, 2) comparative multivariate analysis, 3) regression analysis, 4) Monte Carlo simulation. The utilitarian purpose of the monograph is to provide the research community with the concept of building models that can be used to solve real decision-making problems during longwall planning in hard coal mines. The layout of the monograph, consisting of an introduction, eight main sections and a conclusion, follows the objectives set out above. Section One presents the methodology used to assess the impact of onerous geological and mining conditions on the mining process. Multi-Criteria Decision Analysis (MCDA) is reviewed and basic definitions used in the following part of the paper are introduced. The section includes a description of AHP which was used in the presented analysis. Individual factors resulting from natural hazards, from the geological structure of the deposit (seam), from limitations caused by technical requirements, from the impact of mining on the environment, which affect the mining process, are described exhaustively in Section Two. Sections Three and Four present the construction of two hierarchical models of geological and mining conditions onerousness: the first in the context of extraction costs and the second in relation to daily longwall mining. The procedure for valuing the importance of their components by a group of experts (pairwise comparison of criteria and sub-criteria on the basis of Saaty’s 9-point comparison scale) is presented. The AHP method is very sensitive to even small changes in the value of the comparison matrix. In order to determine the stability of the valuation of both onerousness models, a sensitivity analysis was carried out, which is described in detail in Section Five. Section Six is devoted to the issue of constructing aggregate indices, WUe and WUt, which synthetically measure the impact of onerous geological and mining conditions on the mining process in individual longwalls and allow for a linear ordering of longwalls according to increasing levels of onerousness. Section Seven opens the research part of the work, which analyses the results of the developed models and indicators in individual mines. A detailed analysis is presented of the assessment of the impact of onerous mining conditions on mining costs in selected seams of the analysed mines, and in the case of the impact of onerous mining on daily longwall mining output, the variability of this process in individual fields (lots) of the mines is characterised. Section Eight presents the regression equations for the dependence of the costs and level of extraction on the aggregated onerousness indicators, WUe and WUt. The regression models f(KJC_N) and f(W) developed in this way are used to forecast the unit mining costs and daily output of the designed longwalls in the context of diversified geological and mining conditions. The use of regression models is of great practical importance. It makes it possible to approximate unit costs and daily output for newly designed longwall workings. The use of this knowledge may significantly improve the quality of planning processes and the effectiveness of the mining process.
APA, Harvard, Vancouver, ISO, and other styles

Book chapters on the topic "Multi-Objective Markov Decision Processes"

1

Sedova, Ekaterina, Lawrence Mandow, and José-Luis Pérez-de-la-Cruz. "Asynchronous Vector Iteration in Multi-objective Markov Decision Processes." In Advances in Artificial Intelligence, 129–38. Cham: Springer International Publishing, 2021. http://dx.doi.org/10.1007/978-3-030-85713-4_13.

Full text
APA, Harvard, Vancouver, ISO, and other styles
2

Hahn, Ernst Moritz, Vahid Hashemi, Holger Hermanns, Morteza Lahijanian, and Andrea Turrini. "Multi-objective Robust Strategy Synthesis for Interval Markov Decision Processes." In Quantitative Evaluation of Systems, 207–23. Cham: Springer International Publishing, 2017. http://dx.doi.org/10.1007/978-3-319-66335-7_13.

Full text
APA, Harvard, Vancouver, ISO, and other styles
3

Randour, Mickael, Jean-François Raskin, and Ocan Sankur. "Percentile Queries in Multi-dimensional Markov Decision Processes." In Computer Aided Verification, 123–39. Cham: Springer International Publishing, 2015. http://dx.doi.org/10.1007/978-3-319-21690-4_8.

Full text
APA, Harvard, Vancouver, ISO, and other styles
4

Quatmann, Tim, and Joost-Pieter Katoen. "Multi-objective Optimization of Long-run Average and Total Rewards." In Tools and Algorithms for the Construction and Analysis of Systems, 230–49. Cham: Springer International Publishing, 2021. http://dx.doi.org/10.1007/978-3-030-72016-2_13.

Full text
Abstract:
AbstractThis paper presents an efficient procedure for multi-objective model checking of long-run average reward (aka: mean pay-off) and total reward objectives as well as their combination. We consider this for Markov automata, a compositional model that captures both traditional Markov decision processes (MDPs) as well as a continuous-time variant thereof. The crux of our procedure is a generalization of Forejt et al.’s approach for total rewards on MDPs to arbitrary combinations of long-run and total reward objectives on Markov automata. Experiments with a prototypical implementation on top of the Storm model checker show encouraging results for both model types and indicate a substantial improved performance over existing multi-objective long-run MDP model checking based on linear programming.
APA, Harvard, Vancouver, ISO, and other styles
5

Even-Dar, Eyal, Shie Mannor, and Yishay Mansour. "PAC Bounds for Multi-armed Bandit and Markov Decision Processes." In Lecture Notes in Computer Science, 255–70. Berlin, Heidelberg: Springer Berlin Heidelberg, 2002. http://dx.doi.org/10.1007/3-540-45435-7_18.

Full text
APA, Harvard, Vancouver, ISO, and other styles
6

Dutta, Ayan, O. Patrick Kreidl, and Jason M. O’Kane. "Opportunistic Multi-robot Environmental Sampling via Decentralized Markov Decision Processes." In Distributed Autonomous Robotic Systems, 163–75. Cham: Springer International Publishing, 2022. http://dx.doi.org/10.1007/978-3-030-92790-5_13.

Full text
APA, Harvard, Vancouver, ISO, and other styles
7

Ponomarenko, Leonid, Che Soong Kim, and Agassi Melikov. "Markov Decision Processes (MDP) Approach to Optimization Problems for Multi-Rate Systems." In Performance Analysis and Optimization of Multi-Traffic on Communication Networks, 167–86. Berlin, Heidelberg: Springer Berlin Heidelberg, 2010. http://dx.doi.org/10.1007/978-3-642-15458-4_7.

Full text
APA, Harvard, Vancouver, ISO, and other styles
8

Radoszycki, Julia, Nathalie Peyrard, and Régis Sabbadin. "Solving F $$^3$$ MDPs: Collaborative Multiagent Markov Decision Processes with Factored Transitions, Rewards and Stochastic Policies." In PRIMA 2015: Principles and Practice of Multi-Agent Systems, 3–19. Cham: Springer International Publishing, 2015. http://dx.doi.org/10.1007/978-3-319-25524-8_1.

Full text
APA, Harvard, Vancouver, ISO, and other styles
9

Dimuro, Graçaliz P., and Antônio C. R. Costa. "Interval-Based Markov Decision Processes for Regulating Interactions Between Two Agents in Multi-agent Systems." In Applied Parallel Computing. State of the Art in Scientific Computing, 102–11. Berlin, Heidelberg: Springer Berlin Heidelberg, 2006. http://dx.doi.org/10.1007/11558958_12.

Full text
APA, Harvard, Vancouver, ISO, and other styles
10

Yi, Sha, Changjoo Nam, and Katia Sycara. "Indoor Pursuit-Evasion with Hybrid Hierarchical Partially Observable Markov Decision Processes for Multi-robot Systems." In Distributed Autonomous Robotic Systems, 251–64. Cham: Springer International Publishing, 2019. http://dx.doi.org/10.1007/978-3-030-05816-6_18.

Full text
APA, Harvard, Vancouver, ISO, and other styles

Conference papers on the topic "Multi-Objective Markov Decision Processes"

1

Eddy, Duncan, and Mykel Kochenderfer. "Markov Decision Processes For Multi-Objective Satellite Task Planning." In 2020 IEEE Aerospace Conference. IEEE, 2020. http://dx.doi.org/10.1109/aero47225.2020.9172258.

Full text
APA, Harvard, Vancouver, ISO, and other styles
2

Wiering, Marco A., and Edwin D. de Jong. "Computing Optimal Stationary Policies for Multi-Objective Markov Decision Processes." In 2007 IEEE International Symposium on Approximate Dynamic Programming and Reinforcement Learning. IEEE, 2007. http://dx.doi.org/10.1109/adprl.2007.368183.

Full text
APA, Harvard, Vancouver, ISO, and other styles
3

Scheftelowitsch, Dimitri, Peter Buchholz, Vahid Hashemi, and Holger Hermanns. "Multi-Objective Approaches to Markov Decision Processes with Uncertain Transition Parameters." In VALUETOOLS 2017: 11th EAI International Conference on Performance Evaluation Methodologies and Tools. New York, NY, USA: ACM, 2017. http://dx.doi.org/10.1145/3150928.3150945.

Full text
APA, Harvard, Vancouver, ISO, and other styles
4

Gimbert, Hugo, and Wieslaw Zielonka. "Limits of Multi-Discounted Markov Decision Processes." In 22nd Annual IEEE Symposium on Logic in Computer Science (LICS 2007). IEEE, 2007. http://dx.doi.org/10.1109/lics.2007.28.

Full text
APA, Harvard, Vancouver, ISO, and other styles
5

Sui, Qi, and Hai-yang Wang. "A Dynamic Generation Algorithm for Meta Process Using Markov Decision Processes." In 2006 International Multi-Symposiums on Computer and Computational Sciences (IMSCCS). IEEE, 2006. http://dx.doi.org/10.1109/imsccs.2006.5.

Full text
APA, Harvard, Vancouver, ISO, and other styles
6

Abtahi, Farnaz, and Mohammad Reza Meybodi. "Solving Multi-Agent Markov Decision Processes using learning automata." In 2008 6th International Symposium on Intelligent Systems and Informatics (SISY 2008). IEEE, 2008. http://dx.doi.org/10.1109/sisy.2008.4664909.

Full text
APA, Harvard, Vancouver, ISO, and other styles
7

Bertuccelli, Luca F., Brett Bethke, and Jonathan P. How. "Robust adaptive Markov Decision Processes in multi-vehicle applications." In 2009 American Control Conference. IEEE, 2009. http://dx.doi.org/10.1109/acc.2009.5160511.

Full text
APA, Harvard, Vancouver, ISO, and other styles
8

Tahir, M., and R. Farrell. "Optimal Resource Control of Multi-Processor Multi-Radio Nodes Using Semi-Markov Decision Processes." In ICC 2010 - 2010 IEEE International Conference on Communications. IEEE, 2010. http://dx.doi.org/10.1109/icc.2010.5502144.

Full text
APA, Harvard, Vancouver, ISO, and other styles
9

Zhiyuan Ren and B. H. Krogh. "Mode-matching control policies for multi-mode Markov decision processes." In Proceedings of American Control Conference. IEEE, 2001. http://dx.doi.org/10.1109/acc.2001.945521.

Full text
APA, Harvard, Vancouver, ISO, and other styles
10

Panigrahi, J. R., and S. Bhatnagar. "Hierarchical decision making in semiconductor fabs using multi-time scale Markov decision processes." In 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601). IEEE, 2004. http://dx.doi.org/10.1109/cdc.2004.1429441.

Full text
APA, Harvard, Vancouver, ISO, and other styles

Reports on the topic "Multi-Objective Markov Decision Processes"

1

Führ, Martin, Julian Schenten, and Silke Kleihauer. Integrating "Green Chemistry" into the Regulatory Framework of European Chemicals Policy. Sonderforschungsgruppe Institutionenanalyse, July 2019. http://dx.doi.org/10.46850/sofia.9783941627727.

Full text
Abstract:
20 years ago a concept of “Green Chemistry” was formulated by Paul Anastas and John Warner, aiming at an ambitious agenda to “green” chemical products and processes. Today the concept, laid down in a set of 12 principles, has found support in various arenas. This diffusion was supported by enhancements of the legislative framework; not only in the European Union. Nevertheless industry actors – whilst generally supporting the idea – still see “cost and perception remain barriers to green chemistry uptake”. Thus, the questions arise how additional incentives as well as measures to address the barriers and impediments can be provided. An analysis addressing these questions has to take into account the institutional context for the relevant actors involved in the issue. And it has to reflect the problem perception of the different stakeholders. The supply chain into which the chemicals are distributed are of pivotal importance since they create the demand pull for chemicals designed in accordance with the “Green Chemistry Principles”. Consequently, the scope of this study includes all stages in a chemical’s life-cycle, including the process of designing and producing the final products to which chemical substances contribute. For each stage the most relevant legislative acts, together establishing the regulatory framework of the “chemicals policy” in the EU are analysed. In a nutshell the main elements of the study can be summarized as follows: Green Chemistry (GC) is the utilisation of a set of principles that reduces or eliminates the use or generation of hazardous substances in the design, manufacture and application of chemical products. Besides, reaction efficiency, including energy efficiency, and the use of renewable resources are other motives of Green Chemistry. Putting the GC concept in a broader market context, however, it can only prevail if in the perception of the relevant actors it is linked to tangible business cases. Therefore, the study analyses the product context in which chemistry is to be applied, as well as the substance’s entire life-cycle – in other words, the six stages in product innovation processes): 1. Substance design, 2. Production process, 3. Interaction in the supply chain, 4. Product design, 5. Use phase and 6. After use phase of the product (towards a “circular economy”). The report presents an overview to what extent the existing framework, i.e. legislation and the wider institutional context along the six stages, is setting incentives for actors to adequately address problematic substances and their potential impacts, including the learning processes intended to invoke creativity of various actors to solve challenges posed by these substances. In this respect, measured against the GC and Learning Process assessment criteria, the study identified shortcomings (“delta”) at each stage of product innovation. Some criteria are covered by the regulatory framework and to a relevant extent implemented by the actors. With respect to those criteria, there is thus no priority need for further action. Other criteria are only to a certain degree covered by the regulatory framework, due to various and often interlinked reasons. For those criteria, entry points for options to strengthen or further nuance coverage of the respective principle already exist. Most relevant are the deltas with regard to those instruments that influence the design phase; both for the chemical substance as such and for the end-product containing the substance. Due to the multi-tier supply chains, provisions fostering information, communication and cooperation of the various actors are crucial to underpin the learning processes towards the GCP. The policy options aim to tackle these shortcomings in the context of the respective stage in order to support those actors who are willing to change their attitude and their business decisions towards GC. The findings are in general coherence with the strategies to foster GC identified by the Green Chemistry & Commerce Council.
APA, Harvard, Vancouver, ISO, and other styles
2

Motel-Klingebiel, Andreas, and Gerhard Naegele. Exclusion and inequality in late working life in the political context of the EU. Linköping University Electronic Press, November 2022. http://dx.doi.org/10.3384/9789179293215.

Full text
Abstract:
European societies need to increase the participation in work over the life course to support the provision of qualified labour and to meet the challenges for social security systems under the condition of their ageing populations. One of the key ambitions is to extend people’s working lives and to postpone labour market exit and retirement where possible. This requires informed policies, and the research programme EIWO – ‘Exclusion and Inequality in Late Working Life: Evidence for Policy Innovation towards Inclusive Extended Work and Sustainable Working Conditions in Sweden and Europe’ – aims to push the boundaries of knowledge about late working life and the potential of its inclusive and equal prolongation via a theoretically driven, gender-sensitive combination of multi-level perspectives. EIWO takes a life course approach on exclusion and inequality by security of tenure, quality of work, workplaces, and their consequences. It identifies life course policies, promoting lifelong learning processes and flexible adaptation to prolong working lives and to avoid increased exclusion and inequality. Moreover, it provides evidence for policies to ensure both individual, company and societal benefits from longer lives. To do so, EIWO orientates its analyses systematically to the macro-political contexts at the European Union level and to the policy goals expressed in the respective official statements, reports and plans. This report systematizes this ambitious approach. Relevant documents such as reports, green books and other publications of the European Commission (EC), the European Parliament (EP), the Organisation for Economic Co-operation and Development (OECD), as well as those of social partners and research institutions, have been systematically scanned and evaluated. In addition, relevant decisions of European summits have been considered. The selection of documents claims completeness regarding relevant and generally available publication, while relevance is defined from the point of view of EIWO’s interests. It is the aim of this report to provide a sound knowledge base for EIWO’s analyses and impact strategies and to contribute to the emerging research on the connection between population ageing and the European policies towards productivity, inclusiveness, equity, resilience and sustainability. This report aims to answer the following questions: How are EIWO’s conceptual classification and programme objectives reflected in the European Union’s policy programming? How can EIWO’s analyses and impact benefit from a reference to current EU policy considerations, and how does this focus support the outline of policy options and the formulating of possible proposals to Swedish and European stakeholders? The present report was written during early 2022; analyses were finalized in February 2022 and represent the status until this date.
APA, Harvard, Vancouver, ISO, and other styles
You might also be interested in the extended bibliographies on the topic 'Multi-Objective Markov Decision Processes' for particular source types:
Journal articles Dissertations / Theses
We offer discounts on all premium plans for authors whose works are included in thematic literature selections. Contact us to get a unique promo code!

To the bibliography