東華大學圖書館 |

Language: English

Help

回圖書館首頁

手機版館藏查詢

Back

Switch To: Labeled | MARC Mode | ISBD

A Multi-Fidelity Approach to Testing...

Seif, Robert Joseph,

Linked to FindBook

Google Book

Amazon

博客來

A Multi-Fidelity Approach to Testing and Evaluation of Ai-Enabled Systems /

Record Type:	Electronic resources : Monograph/item
Title/Author:	A Multi-Fidelity Approach to Testing and Evaluation of Ai-Enabled Systems // Robert Joseph Seif.
Author:	Seif, Robert Joseph,
Description:	1 electronic resource (72 pages)
Notes:	Source: Masters Abstracts International, Volume: 86-04.
Contained By:	Masters Abstracts International86-04.
Subject:	Defense contracts. -
Online resource:	https://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=31606898
ISBN:	9798342142670

A Multi-Fidelity Approach to Testing and Evaluation of Ai-Enabled Systems /
Seif, Robert Joseph,

A Multi-Fidelity Approach to Testing and Evaluation of Ai-Enabled Systems /Robert Joseph Seif. - 1 electronic resource (72 pages)

Source: Masters Abstracts International, Volume: 86-04.

Approaches to system testing and evaluation (T&E) are becoming increasingly relevant as artificial intelligence (AI)/machine learning (ML) technology expands across the industry's current landscape. As the AI/ML landscape continues to develop, greater amounts of data are required to build the next generation of technology. Multiple communities have worked to create frameworks to interact with such scales of data, yet a gap persists in the ability to utilize data generated throughout the development process to support the for use in a T&E program. The objective of this thesis is to address this gap through a multi-fidelity approach to the test and evaluation of AI-enabled systems. This approach is constructed using a space of models to visualize similarities and differences between each individual model. Once requirements and potential tests that models can be employed to fulfill are organized, a method to sequentially select models for testing is utilized. Models are selected to maximize utility, dependent on model performance and cost to the T&E team. Experimentation was conducted through the case of an autonomous vehicle (AV) perception system, where models were constructed using a simulation of the Purdue University campus for AVs to drive around. Results show that the proposed approach, when paired with Bayesian Optimization for sequential test selection through an expected improvement acquisition function, can effectively select models in a manner that works to minimize uncertainty and cost for the test team. Through computational experiments, the proposed approach can be used to develop test combinations that minimize costs and maximize utility while maximizing the information a T&E team has on how well a system can meet a set of testing requirements in operational conditions.

English

ISBN: 9798342142670Subjects--Topical Terms:

3764566
Defense contracts.

A Multi-Fidelity Approach to Testing and Evaluation of Ai-Enabled Systems /
LDR:03181nmm a22004333i 4500 001 2429074
005 20250428055558.5
006 m o d
007 cr|nu||||||||
008 261011s2024 miu||||||m |||||||eng d
020 $a 9798342142670
035 $a (MiAaPQD)AAI31606898
035 $a (MiAaPQD)Purdue26364277
035 $a AAI31606898
040 $a MiAaPQD $b eng $c MiAaPQD $e rda
100 1 $a Seif, Robert Joseph, $e author. $3 3816703
245 1 2 $a A Multi-Fidelity Approach to Testing and Evaluation of Ai-Enabled Systems / $c Robert Joseph Seif.
264 1 $a Ann Arbor : $b ProQuest Dissertations & Theses, $c 2024
300 $a 1 electronic resource (72 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Masters Abstracts International, Volume: 86-04.
500 $a Advisors: Panchal, Jitesh H. Committee members: Wang, Ziran; DeLaurentis, Daniel A.
502 $b M.M.E. $c Purdue University $d 2024.
520 $a Approaches to system testing and evaluation (T&E) are becoming increasingly relevant as artificial intelligence (AI)/machine learning (ML) technology expands across the industry's current landscape. As the AI/ML landscape continues to develop, greater amounts of data are required to build the next generation of technology. Multiple communities have worked to create frameworks to interact with such scales of data, yet a gap persists in the ability to utilize data generated throughout the development process to support the for use in a T&E program. The objective of this thesis is to address this gap through a multi-fidelity approach to the test and evaluation of AI-enabled systems. This approach is constructed using a space of models to visualize similarities and differences between each individual model. Once requirements and potential tests that models can be employed to fulfill are organized, a method to sequentially select models for testing is utilized. Models are selected to maximize utility, dependent on model performance and cost to the T&E team. Experimentation was conducted through the case of an autonomous vehicle (AV) perception system, where models were constructed using a simulation of the Purdue University campus for AVs to drive around. Results show that the proposed approach, when paired with Bayesian Optimization for sequential test selection through an expected improvement acquisition function, can effectively select models in a manner that works to minimize uncertainty and cost for the test team. Through computational experiments, the proposed approach can be used to develop test combinations that minimize costs and maximize utility while maximizing the information a T&E team has on how well a system can meet a set of testing requirements in operational conditions.
546 $a English
590 $a School code: 0183
650 4 $a Defense contracts. $3 3764566
650 4 $a Computer vision. $3 540671
650 4 $a Open source software. $3 581998
650 4 $a Digital twins. $3 3816704
650 4 $a Autonomous vehicles. $3 2179092
650 4 $a Neural networks. $3 677449
650 4 $a Decision making. $3 517204
650 4 $a Taxonomy. $3 3556303
650 4 $a Breakdowns. $3 3682712
650 4 $a Documents. $3 3815417
650 4 $a Technology. $3 531676
650 4 $a Computer engineering. $3 621879
650 4 $a Computer science. $3 523869
650 4 $a Mechanical engineering. $3 649730
650 4 $a Military studies. $3 2197382
650 4 $a Transportation. $3 555912
690 $a 0800
690 $a 0464
690 $a 0984
690 $a 0338
690 $a 0548
690 $a 0750
690 $a 0709
710 2 $a Purdue University. $e degree granting institution. $3 3759105
720 1 $a Panchal, Jitesh H. $e degree supervisor.
773 0 $t Masters Abstracts International $g 86-04.
790 $a 0183
791 $a M.M.E.
792 $a 2024
856 4 0 $u https://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=31606898