東華大學圖書館 |

Language: English

Help

回圖書館首頁

手機版館藏查詢

Back

Switch To: Labeled | MARC Mode | ISBD

Linked to FindBook

Google Book

Amazon

博客來

Habits of Thought : = Model-Free Reinforcement Learning over Cognitive Operations.

Record Type:	Electronic resources : Monograph/item
Title/Author:	Habits of Thought :/
Reminder of title:	Model-Free Reinforcement Learning over Cognitive Operations.
Author:	Morris, Adam.
Description:	1 online resource (185 pages)
Notes:	Source: Dissertations Abstracts International, Volume: 83-12, Section: B.
Contained By:	Dissertations Abstracts International83-12B.
Subject:	Cognitive psychology. -
Online resource:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=29170649click for full text (PQDT)
ISBN:	9798819372241

Habits of Thought : = Model-Free Reinforcement Learning over Cognitive Operations.
Morris, Adam.

Habits of Thought :Model-Free Reinforcement Learning over Cognitive Operations. - 1 online resource (185 pages)

Source: Dissertations Abstracts International, Volume: 83-12, Section: B.

Thesis (Ph.D.)--Harvard University, 2022.

Includes bibliographical references

People often persist in doing things that they know intellectually are no longer good for them. They mindlessly take their usual route to work, even though they know it's closed for construction, or reach for their morning coffee even though they're trying to quit caffeine. These persistent behaviors often go under the label of habits, and contemporary theories have had great success characterizing the computational cognitive mechanisms underlying them. In particular, work on model-free reinforcement learning has shown how habits can arise from direct associations between actions and reward (e.g. representations of the form "reaching for morning coffee = ++", computed through past experience with the action).Yet, computational accounts of habits are lacking in a key way. Intuitively, people don't just persist in external actions, like reaching for morning coffee. They also persist in internal, cognitive patterns. For instance, a person might form a habit of fantasizing about coffee, or of planning how to get her next cup. Despite the purported importance of these "habits of thought" for people's mental lives, they are noticeably absent from computational accounts of habits. These accounts have typically modeled habits as forming over simple motor actions (like pulling a lever) or external choices (like selecting buttons in a laboratory decision task) -- and have not investigated habits over more internal, abstract types of cognitive operations (like setting the goal of getting coffee).This dissertation fills that gap. Here, I demonstrate that people inflexibly persist in two types of internal, cognitive operations -- setting a goal to pursue (Chapter 1) and generating a decision option to consider (Chapter 2) -- after being rewarded for them, even when those rewards are known to be irrelevant for the present context. I formally model these patterns as model-free reinforcement learning over internal operations, and show that habits of thought can serve a useful function: They help make model-based planning tractable by narrowing its scope and channeling it down a small number of promising paths. Finally, I also find that there are cognitive operations which don't exhibit this type of habit of thought: In our experiments (Chapter 3), people don't employ model-free reinforcement learning to select chunked action sequences (e.g. sequences of button presses mentally chunked together as a unit), and instead use only model-based planning to choose sequences. Together, this work provides a precise account of the cognitive mechanisms that can underlie habits of thought; rigorously demonstrates the existence of such habits; suggests their adaptive function; and begins to map out their boundary conditions.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2023

Mode of access: World Wide Web

ISBN: 9798819372241Subjects--Topical Terms:

523881
Cognitive psychology.
Subjects--Index Terms:

Consideration setsIndex Terms--Genre/Form:

542853
Electronic books.

Habits of Thought : = Model-Free Reinforcement Learning over Cognitive Operations.
LDR:04088nmm a2200385K 4500 001 2359759
005 20230917195238.5
006 m o d
007 cr mn ---uuuuu
008 241011s2022 xx obm 000 0 eng d
020 $a 9798819372241
035 $a (MiAaPQ)AAI29170649
035 $a AAI29170649
040 $a MiAaPQ $b eng $c MiAaPQ $d NTU
100 1 $a Morris, Adam. $3 3332519
245 1 0 $a Habits of Thought : $b Model-Free Reinforcement Learning over Cognitive Operations.
264 0 $c 2022
300 $a 1 online resource (185 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertations Abstracts International, Volume: 83-12, Section: B.
500 $a Advisor: Cushman, Fiery.
502 $a Thesis (Ph.D.)--Harvard University, 2022.
504 $a Includes bibliographical references
520 $a People often persist in doing things that they know intellectually are no longer good for them. They mindlessly take their usual route to work, even though they know it's closed for construction, or reach for their morning coffee even though they're trying to quit caffeine. These persistent behaviors often go under the label of habits, and contemporary theories have had great success characterizing the computational cognitive mechanisms underlying them. In particular, work on model-free reinforcement learning has shown how habits can arise from direct associations between actions and reward (e.g. representations of the form "reaching for morning coffee = ++", computed through past experience with the action).Yet, computational accounts of habits are lacking in a key way. Intuitively, people don't just persist in external actions, like reaching for morning coffee. They also persist in internal, cognitive patterns. For instance, a person might form a habit of fantasizing about coffee, or of planning how to get her next cup. Despite the purported importance of these "habits of thought" for people's mental lives, they are noticeably absent from computational accounts of habits. These accounts have typically modeled habits as forming over simple motor actions (like pulling a lever) or external choices (like selecting buttons in a laboratory decision task) -- and have not investigated habits over more internal, abstract types of cognitive operations (like setting the goal of getting coffee).This dissertation fills that gap. Here, I demonstrate that people inflexibly persist in two types of internal, cognitive operations -- setting a goal to pursue (Chapter 1) and generating a decision option to consider (Chapter 2) -- after being rewarded for them, even when those rewards are known to be irrelevant for the present context. I formally model these patterns as model-free reinforcement learning over internal operations, and show that habits of thought can serve a useful function: They help make model-based planning tractable by narrowing its scope and channeling it down a small number of promising paths. Finally, I also find that there are cognitive operations which don't exhibit this type of habit of thought: In our experiments (Chapter 3), people don't employ model-free reinforcement learning to select chunked action sequences (e.g. sequences of button presses mentally chunked together as a unit), and instead use only model-based planning to choose sequences. Together, this work provides a precise account of the cognitive mechanisms that can underlie habits of thought; rigorously demonstrates the existence of such habits; suggests their adaptive function; and begins to map out their boundary conditions.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2023
538 $a Mode of access: World Wide Web
650 4 $a Cognitive psychology. $3 523881
653 $a Consideration sets
653 $a Decision making
653 $a Goals
653 $a Habits
653 $a Planning
653 $a Reinforcement learning
655 7 $a Electronic books. $2 lcsh $3 542853
690 $a 0633
710 2 $a ProQuest Information and Learning Co. $3 783688
710 2 $a Harvard University. $b Psychology. $3 2099009
773 0 $t Dissertations Abstracts International $g 83-12B.
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=29170649 $z click for full text (PQDT)