東華大學圖書館 |

Language: English

Help

回圖書館首頁

手機版館藏查詢

Back

Switch To: Labeled | MARC Mode | ISBD

Deep Reinforcement Learning Approach...

Zhou, Dongqin,

Linked to FindBook

Google Book

Amazon

博客來

Deep Reinforcement Learning Approaches to Perimeter Metering Control Problems /

Record Type:	Electronic resources : Monograph/item
Title/Author:	Deep Reinforcement Learning Approaches to Perimeter Metering Control Problems // Dongqin Zhou.
Author:	Zhou, Dongqin,
Description:	1 electronic resource (233 pages)
Notes:	Source: Dissertations Abstracts International, Volume: 86-03, Section: A.
Contained By:	Dissertations Abstracts International86-03A.
Subject:	Control theory. -
Online resource:	https://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=31353868
ISBN:	9798384211471

Deep Reinforcement Learning Approaches to Perimeter Metering Control Problems /
Zhou, Dongqin,

Deep Reinforcement Learning Approaches to Perimeter Metering Control Problems /Dongqin Zhou. - 1 electronic resource (233 pages)

Source: Dissertations Abstracts International, Volume: 86-03, Section: A.

Perimeter metering control has long been an active research topic since well-defined relationships between network productivity and usage, i.e., network macroscopic fundamental diagrams (MFD), were shown capable of describing regional traffic dynamics. This control scheme provides a convenient way to mitigate urban congestion by manipulating vehicular movements across homogeneous regions without modeling the detailed behaviors and interactions involved with individual vehicle presence. Numerous methods have been proposed to solve perimeter metering control problems, but most existing strategies require accurate modeling of traffic dynamics with full knowledge of the network MFD and dynamic equations to describe how vehicles move across regions of the network. However, such information is generally difficult to obtain and subject to significant estimation errors. For these limitations, this dissertation investigates the applicability of (model-free) deep reinforcement learning approaches to perimeter metering control problems.For two-region urban networks, a model free deep reinforcement learning perimeter control scheme is proposed that features agents with either continuous or discrete action spaces. The proposed agents learn to select control actions through a reinforcement learning process without assuming any information about environment dynamics. This scheme has shown comparable performances to the model predictive control method, particularly when uncertainty exists. To further improve its learning and control performances as well as scalability to slightly larger urban networks, domain control knowledge of congestion dynamics is integrated into the agent designs that provides knowledge-guided exploration strategies for the agents such that they can explore around the most rewarding part of the action spaces. Building upon these successes, the multi-region perimeter metering control problem, which holds promise for efficient traffic management in large-scale urban networks, is studied. A novel scalable model-free scheme based on model-free multi-agent deep reinforcement learning is proposed, which features value function decomposition in the paradigm of centralized training with decentralized execution, coupled with critical advances of single-agent deep reinforcement learning and problem reformulation guided by domain expertise. Further, for realistic evaluation, a microsimulation environment is utilized to gauge the effectiveness and transferability of a reinforcement learning-based perimeter controller, noting that the ability of such methods to transfer the learned knowledge and quickly adapt control policies to a new setting is critical, particularly in real-life situations where training a method from scratch is intractable. Last but not least, this dissertation presents a joint framework for inter-regional perimeter metering control and intra-regional traffic signal control, which yields effective and implementable city-level traffic management policies.

English

ISBN: 9798384211471Subjects--Topical Terms:

535880
Control theory.

Deep Reinforcement Learning Approaches to Perimeter Metering Control Problems /
LDR:04452nmm a22004213i 4500 001 2428580
005 20250414021902.5
006 m o d
007 cr|nu||||||||
008 261011s2024 miu||||||m |||||||eng d
020 $a 9798384211471
035 $a (MiAaPQD)AAI31353868
035 $a (MiAaPQD)PennState22809dfz5094
035 $a AAI31353868
040 $a MiAaPQD $b eng $c MiAaPQD $e rda
100 1 $a Zhou, Dongqin, $e author. $3 3815895
245 1 0 $a Deep Reinforcement Learning Approaches to Perimeter Metering Control Problems / $c Dongqin Zhou.
264 1 $a Ann Arbor : $b ProQuest Dissertations & Theses, $c 2024
300 $a 1 electronic resource (233 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertations Abstracts International, Volume: 86-03, Section: A.
500 $a Advisors: Gayah, Vikash V. Committee members: Rajabipour, Farshad; Guler, S. Ilgin; Dey, Satadru; Papakonstantinou, Kostas.
502 $b Ph.D. $c The Pennsylvania State University $d 2024.
520 $a Perimeter metering control has long been an active research topic since well-defined relationships between network productivity and usage, i.e., network macroscopic fundamental diagrams (MFD), were shown capable of describing regional traffic dynamics. This control scheme provides a convenient way to mitigate urban congestion by manipulating vehicular movements across homogeneous regions without modeling the detailed behaviors and interactions involved with individual vehicle presence. Numerous methods have been proposed to solve perimeter metering control problems, but most existing strategies require accurate modeling of traffic dynamics with full knowledge of the network MFD and dynamic equations to describe how vehicles move across regions of the network. However, such information is generally difficult to obtain and subject to significant estimation errors. For these limitations, this dissertation investigates the applicability of (model-free) deep reinforcement learning approaches to perimeter metering control problems.For two-region urban networks, a model free deep reinforcement learning perimeter control scheme is proposed that features agents with either continuous or discrete action spaces. The proposed agents learn to select control actions through a reinforcement learning process without assuming any information about environment dynamics. This scheme has shown comparable performances to the model predictive control method, particularly when uncertainty exists. To further improve its learning and control performances as well as scalability to slightly larger urban networks, domain control knowledge of congestion dynamics is integrated into the agent designs that provides knowledge-guided exploration strategies for the agents such that they can explore around the most rewarding part of the action spaces. Building upon these successes, the multi-region perimeter metering control problem, which holds promise for efficient traffic management in large-scale urban networks, is studied. A novel scalable model-free scheme based on model-free multi-agent deep reinforcement learning is proposed, which features value function decomposition in the paradigm of centralized training with decentralized execution, coupled with critical advances of single-agent deep reinforcement learning and problem reformulation guided by domain expertise. Further, for realistic evaluation, a microsimulation environment is utilized to gauge the effectiveness and transferability of a reinforcement learning-based perimeter controller, noting that the ability of such methods to transfer the learned knowledge and quickly adapt control policies to a new setting is critical, particularly in real-life situations where training a method from scratch is intractable. Last but not least, this dissertation presents a joint framework for inter-regional perimeter metering control and intra-regional traffic signal control, which yields effective and implementable city-level traffic management policies.
546 $a English
590 $a School code: 0176
650 4 $a Control theory. $3 535880
650 4 $a Deep learning. $3 3554982
650 4 $a Success. $3 518195
650 4 $a Neural networks. $3 677449
650 4 $a Controllers. $3 3559217
650 4 $a Traffic control. $3 3686354
650 4 $a Travel. $3 585743
650 4 $a Ordinary differential equations. $3 3563004
650 4 $a Traffic congestion. $3 706812
650 4 $a Vehicles. $3 2145288
650 4 $a Mathematics. $3 515831
650 4 $a Recreation. $3 535376
650 4 $a Systems science. $3 3168411
650 4 $a Transportation. $3 555912
690 $a 0800
690 $a 0543
690 $a 0405
690 $a 0814
690 $a 0790
690 $a 0709
710 2 $a The Pennsylvania State University. $e degree granting institution. $3 3765934
720 1 $a Gayah, Vikash V. $e degree supervisor.
773 0 $t Dissertations Abstracts International $g 86-03A.
790 $a 0176
791 $a Ph.D.
792 $a 2024
856 4 0 $u https://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=31353868