東華大學圖書館 |

Language: English

Help

回圖書館首頁

手機版館藏查詢

Back

Switch To: Labeled | MARC Mode | ISBD

Markov decision processes in practice

Boucherie, Richard J.

Linked to FindBook

Google Book

Amazon

博客來

Markov decision processes in practice

Record Type:	Electronic resources : Monograph/item
Title/Author:	Markov decision processes in practice/ edited by Richard J. Boucherie, Nico M. van Dijk.
other author:	Boucherie, Richard J.
Published:	Cham :Springer International Publishing : : 2017.,
Description:	xxxii, 552 p. :ill., digital ;24 cm.
[NT 15003449]:	One-Step Improvement Ideas And Computational Aspects -- Value Function Approximation In Complex Queueing Systems -- Approximate Dynamic Programming By Practical Examples -- Server Optimization Of Infinite Queueing Systems -- Structures Of Optimal Policies In Mdps With Unbounded Jumps: The State Of Our Art -- Markov Decision Processes For Screening And Treatment Of Chronic Diseases -- Stratified Breast Cancer Follow-Up Using A Partially Observable MDP -- Advance Patient Appointment Scheduling -- Optimal Ambulance Dispatching -- Blood Platelet Inventory Management -- Stochastic Dynamic Programming For Noise Load Management -- Allocation In A Vertical Rotary Car Park -- Dynamic Control Of Traffic Lights -- Smart Charging Of Electric Vehicles -- Analysis Of A Stochastic Lot Scheduling Problem With Strict Due-Dates -- Optimal Fishery Policies -- Near-Optimal Switching Strategies For A Tandem Queue -- Wireless Channel Selection With Restless Bandits -- Flexible Staffing For Call Centers With Non-Stationary Arrival Rates -- MDP For Query-Based Wireless Sensor Networks -- Optimal Portfolios And Pricing Of Financial Derivatives Under Proportional Transaction Costs.
Contained By:	Springer eBooks
Subject:	Markov processes. -
Online resource:	http://dx.doi.org/10.1007/978-3-319-47766-4
ISBN:	9783319477664

Markov decision processes in practice
Markov decision processes in practice[electronic resource] /edited by Richard J. Boucherie, Nico M. van Dijk. - Cham :Springer International Publishing :2017. - xxxii, 552 p. :ill., digital ;24 cm. - International series in operations research & management science,v.2480884-8289 ;. - International series in operations research & management science ;v.248..

One-Step Improvement Ideas And Computational Aspects -- Value Function Approximation In Complex Queueing Systems -- Approximate Dynamic Programming By Practical Examples -- Server Optimization Of Infinite Queueing Systems -- Structures Of Optimal Policies In Mdps With Unbounded Jumps: The State Of Our Art -- Markov Decision Processes For Screening And Treatment Of Chronic Diseases -- Stratified Breast Cancer Follow-Up Using A Partially Observable MDP -- Advance Patient Appointment Scheduling -- Optimal Ambulance Dispatching -- Blood Platelet Inventory Management -- Stochastic Dynamic Programming For Noise Load Management -- Allocation In A Vertical Rotary Car Park -- Dynamic Control Of Traffic Lights -- Smart Charging Of Electric Vehicles -- Analysis Of A Stochastic Lot Scheduling Problem With Strict Due-Dates -- Optimal Fishery Policies -- Near-Optimal Switching Strategies For A Tandem Queue -- Wireless Channel Selection With Restless Bandits -- Flexible Staffing For Call Centers With Non-Stationary Arrival Rates -- MDP For Query-Based Wireless Sensor Networks -- Optimal Portfolios And Pricing Of Financial Derivatives Under Proportional Transaction Costs.

This book presents classical Markov Decision Processes (MDP) for real-life applications and optimization. MDP allows users to develop and formally support approximate and simple decision rules, and this book showcases state-of-the-art applications in which MDP was key to the solution approach. The book is divided into six parts. Part 1 is devoted to the state-of-the-art theoretical foundation of MDP, including approximate methods such as policy improvement, successive approximation and infinite state spaces as well as an instructive chapter on Approximate Dynamic Programming. It then continues with five parts of specific and non-exhaustive application areas. Part 2 covers MDP healthcare applications, which includes different screening procedures, appointment scheduling, ambulance scheduling and blood management. Part 3 explores MDP modeling within transportation. This ranges from public to private transportation, from airports and traffic lights to car parking or charging your electric car. Part 4 contains three chapters that illustrates the structure of approximate policies for production or manufacturing structures. In Part 5, communications is highlighted as an important application area for MDP. It includes Gittins indices, down-to-earth call centers and wireless sensor networks. Finally Part 6 is dedicated to financial modeling, offering an instructive review to account for financial portfolios and derivatives under proportional transactional costs. The MDP applications in this book illustrate a variety of both standard and non-standard aspects of MDP modeling and its practical use. This book should appeal to readers for practitioning, academic research and educational purposes, with a background in, among others, operations research, mathematics, computer science, and industrial engineering.

ISBN: 9783319477664

Standard No.: 10.1007/978-3-319-47766-4doiSubjects--Topical Terms:

532104
Markov processes.

LC Class. No.: QA274.7

Dewey Class. No.: 519.233

Markov decision processes in practice
LDR:04082nmm a2200337 a 4500 001 2092516
003 DE-He213
005 20170311021229.0
006 m d
007 cr nn 008maaau
008 171117s2017 gw s 0 eng d
020 $a 9783319477664 $q (electronic bk.)
020 $a 9783319477640 $q (paper)
024 7 $a 10.1007/978-3-319-47766-4 $2 doi
035 $a 978-3-319-47766-4
040 $a GP $c GP
041 0 $a eng
050 4 $a QA274.7
072 7 $a KJT $2 bicssc
072 7 $a KJMD $2 bicssc
072 7 $a BUS049000 $2 bisacsh
082 0 4 $a 519.233 $2 23
090 $a QA274.7 $b .M346 2017
245 0 0 $a Markov decision processes in practice $h [electronic resource] / $c edited by Richard J. Boucherie, Nico M. van Dijk.
260 $a Cham : $b Springer International Publishing : $b Imprint: Springer, $c 2017.
300 $a xxxii, 552 p. : $b ill., digital ; $c 24 cm.
490 1 $a International series in operations research & management science, $x 0884-8289 ; $v v.248
505 0 $a One-Step Improvement Ideas And Computational Aspects -- Value Function Approximation In Complex Queueing Systems -- Approximate Dynamic Programming By Practical Examples -- Server Optimization Of Infinite Queueing Systems -- Structures Of Optimal Policies In Mdps With Unbounded Jumps: The State Of Our Art -- Markov Decision Processes For Screening And Treatment Of Chronic Diseases -- Stratified Breast Cancer Follow-Up Using A Partially Observable MDP -- Advance Patient Appointment Scheduling -- Optimal Ambulance Dispatching -- Blood Platelet Inventory Management -- Stochastic Dynamic Programming For Noise Load Management -- Allocation In A Vertical Rotary Car Park -- Dynamic Control Of Traffic Lights -- Smart Charging Of Electric Vehicles -- Analysis Of A Stochastic Lot Scheduling Problem With Strict Due-Dates -- Optimal Fishery Policies -- Near-Optimal Switching Strategies For A Tandem Queue -- Wireless Channel Selection With Restless Bandits -- Flexible Staffing For Call Centers With Non-Stationary Arrival Rates -- MDP For Query-Based Wireless Sensor Networks -- Optimal Portfolios And Pricing Of Financial Derivatives Under Proportional Transaction Costs.
520 $a This book presents classical Markov Decision Processes (MDP) for real-life applications and optimization. MDP allows users to develop and formally support approximate and simple decision rules, and this book showcases state-of-the-art applications in which MDP was key to the solution approach. The book is divided into six parts. Part 1 is devoted to the state-of-the-art theoretical foundation of MDP, including approximate methods such as policy improvement, successive approximation and infinite state spaces as well as an instructive chapter on Approximate Dynamic Programming. It then continues with five parts of specific and non-exhaustive application areas. Part 2 covers MDP healthcare applications, which includes different screening procedures, appointment scheduling, ambulance scheduling and blood management. Part 3 explores MDP modeling within transportation. This ranges from public to private transportation, from airports and traffic lights to car parking or charging your electric car. Part 4 contains three chapters that illustrates the structure of approximate policies for production or manufacturing structures. In Part 5, communications is highlighted as an important application area for MDP. It includes Gittins indices, down-to-earth call centers and wireless sensor networks. Finally Part 6 is dedicated to financial modeling, offering an instructive review to account for financial portfolios and derivatives under proportional transactional costs. The MDP applications in this book illustrate a variety of both standard and non-standard aspects of MDP modeling and its practical use. This book should appeal to readers for practitioning, academic research and educational purposes, with a background in, among others, operations research, mathematics, computer science, and industrial engineering.
650 0 $a Markov processes. $3 532104
650 0 $a Decision making. $3 517204
650 1 4 $a Business and Management. $2 eflch $3 1485455
650 2 4 $a Operation Research/Decision Theory. $3 1620900
650 2 4 $a Operations Research, Management Science. $3 1532996
650 2 4 $a Probability Theory and Stochastic Processes. $3 891080
700 1 $a Boucherie, Richard J. $3 1531166
700 1 $a Dijk, Nico M. van. $3 3226453
710 2 $a SpringerLink (Online service) $3 836513
773 0 $t Springer eBooks
830 0 $a International series in operations research & management science ; $v v.248. $3 3226454
856 4 0 $u http://dx.doi.org/10.1007/978-3-319-47766-4
950 $a Business and Management (Springer-41169)