東華大學圖書館 |

Language: English

Help

回圖書館首頁

手機版館藏查詢

Back

Switch To: Labeled | MARC Mode | ISBD

Reinforcement Learning-Based Human O...

Ruan, Jianqi,

Linked to FindBook

Google Book

Amazon

博客來

Reinforcement Learning-Based Human Operator Decision Support Agent for Highly Transient Industrial Processes /

Record Type:	Electronic resources : Monograph/item
Title/Author:	Reinforcement Learning-Based Human Operator Decision Support Agent for Highly Transient Industrial Processes // Jianqi Ruan.
Author:	Ruan, Jianqi,
Description:	1 electronic resource (103 pages)
Notes:	Source: Dissertations Abstracts International, Volume: 86-04, Section: B.
Contained By:	Dissertations Abstracts International86-04B.
Subject:	Dynamical systems. -
Online resource:	https://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=31285273
ISBN:	9798342102131

Reinforcement Learning-Based Human Operator Decision Support Agent for Highly Transient Industrial Processes /
Ruan, Jianqi,

Reinforcement Learning-Based Human Operator Decision Support Agent for Highly Transient Industrial Processes /Jianqi Ruan. - 1 electronic resource (103 pages)

Source: Dissertations Abstracts International, Volume: 86-04, Section: B.

Most industrial processes are not fully-automated. Although reference tracking can be handled by low-level controllers, initializing and adjusting the reference, or setpoint, values, are commonly tasks assigned to human operators. A major challenge that arises, though, is control policy variation among operators which in turn results in inconsistencies in the final product. In order to guide operators to pursue better and more consistent performance, researchers have explored the optimal control policy through different approaches. Although in different applications, researchers use different approaches, an accurate process model is still crucial to the approaches. However, for a highly transient process (e.g., the startup of a manufacturing process), modeling can be challenging and inaccurate, and approaches highly relying on a process model may not work well. One example is process startup in a twin-roll steel strip casting process and motivates this work.In this dissertation, I propose three offline reinforcement learning (RL) algorithms which require the RL agent to learn a control policy from a fixed dataset that is pre-collected by human operators during operations of the twin-roll casting process. Compared to existing offline RL algorithms, the proposed algorithms focus on exploiting the best control policy used by human operators rather than exploring new control policies constrained by the existing policies. In addition, in existing offline RL algorithms, there is not enough consideration of the imbalanced dataset problem. In the second and the third proposed algorithms, I leverage the idea of cost sensitive learning to incentivize the RL agent to learn the most valuable control policy, rather than the most common one represented in the dataset. In addition, since the process model is not available, I propose a performance metric that does not require a process model or simulator for agent testing. The third proposed algorithm is compared with benchmark offline RL algorithms and achieves better and more consistent performance.

English

ISBN: 9798342102131Subjects--Topical Terms:

3219613
Dynamical systems.

Reinforcement Learning-Based Human Operator Decision Support Agent for Highly Transient Industrial Processes /
LDR:03396nmm a22003853i 4500 001 2429344
005 20250430100804.5
006 m o d
007 cr|nu||||||||
008 261011s2024 miu||||||m |||||||eng d
020 $a 9798342102131
035 $a (MiAaPQD)AAI31285273
035 $a (MiAaPQD)25302148
035 $a AAI31285273
040 $a MiAaPQD $b eng $c MiAaPQD $e rda
100 1 $a Ruan, Jianqi, $e author. $3 3817140
245 1 0 $a Reinforcement Learning-Based Human Operator Decision Support Agent for Highly Transient Industrial Processes / $c Jianqi Ruan.
264 1 $a Ann Arbor : $b ProQuest Dissertations & Theses, $c 2024
300 $a 1 electronic resource (103 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertations Abstracts International, Volume: 86-04, Section: B.
500 $a Advisors: Jain, Neera Committee members: Chiu, George; Corless, Martin; Meckl, Peter.
502 $b Ph.D. $c Purdue University $d 2024.
520 $a Most industrial processes are not fully-automated. Although reference tracking can be handled by low-level controllers, initializing and adjusting the reference, or setpoint, values, are commonly tasks assigned to human operators. A major challenge that arises, though, is control policy variation among operators which in turn results in inconsistencies in the final product. In order to guide operators to pursue better and more consistent performance, researchers have explored the optimal control policy through different approaches. Although in different applications, researchers use different approaches, an accurate process model is still crucial to the approaches. However, for a highly transient process (e.g., the startup of a manufacturing process), modeling can be challenging and inaccurate, and approaches highly relying on a process model may not work well. One example is process startup in a twin-roll steel strip casting process and motivates this work.In this dissertation, I propose three offline reinforcement learning (RL) algorithms which require the RL agent to learn a control policy from a fixed dataset that is pre-collected by human operators during operations of the twin-roll casting process. Compared to existing offline RL algorithms, the proposed algorithms focus on exploiting the best control policy used by human operators rather than exploring new control policies constrained by the existing policies. In addition, in existing offline RL algorithms, there is not enough consideration of the imbalanced dataset problem. In the second and the third proposed algorithms, I leverage the idea of cost sensitive learning to incentivize the RL agent to learn the most valuable control policy, rather than the most common one represented in the dataset. In addition, since the process model is not available, I propose a performance metric that does not require a process model or simulator for agent testing. The third proposed algorithm is compared with benchmark offline RL algorithms and achieves better and more consistent performance.
546 $a English
590 $a School code: 0183
650 4 $a Dynamical systems. $3 3219613
650 4 $a Decision making. $3 517204
650 4 $a Neural networks. $3 677449
650 4 $a Mathematics. $3 515831
650 4 $a Statistics. $3 517247
690 $a 0800
690 $a 0405
690 $a 0463
710 2 $a Purdue University. $e degree granting institution. $3 3759105
720 1 $a Jain, Neera $e degree supervisor.
773 0 $t Dissertations Abstracts International $g 86-04B.
790 $a 0183
791 $a Ph.D.
792 $a 2024
856 4 0 $u https://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=31285273