東華大學圖書館 |

Language: English

Help

回圖書館首頁

手機版館藏查詢

Back

Switch To: Labeled | MARC Mode | ISBD

Linked to FindBook

Google Book

Amazon

博客來

A Scalable and Distributed AI-Assisted Human Behavior Analytics Platform Integrating Visual IOT Devices on the Edge.

Record Type:	Electronic resources : Monograph/item
Title/Author:	A Scalable and Distributed AI-Assisted Human Behavior Analytics Platform Integrating Visual IOT Devices on the Edge./
Author:	Guzman, Herbert Manolo.
Published:	Ann Arbor : ProQuest Dissertations & Theses, : 2020,
Description:	85 p.
Notes:	Source: Masters Abstracts International, Volume: 82-04.
Contained By:	Masters Abstracts International82-04.
Subject:	Artificial intelligence. -
Online resource:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=28087452
ISBN:	9798672147215

A Scalable and Distributed AI-Assisted Human Behavior Analytics Platform Integrating Visual IOT Devices on the Edge.
Guzman, Herbert Manolo.

A Scalable and Distributed AI-Assisted Human Behavior Analytics Platform Integrating Visual IOT Devices on the Edge. - Ann Arbor : ProQuest Dissertations & Theses, 2020 - 85 p.

Source: Masters Abstracts International, Volume: 82-04.

Thesis (M.S.)--The University of Texas at San Antonio, 2020.

This item is not available from ProQuest Dissertations & Theses.

Computer vision and the Internet of Things (IoT) have brought about marked improvements in Visual IoT devices. These are increasingly becoming a more powerful means for analyzing human behavior by leveraging their embedded deep-learning or artificial intelligence (AI) models. Amid the current COVID-19 pandemic, these devices facilitate the implementation of AI-assisted human behavior platforms for remote monitoring of in-home health, remote aid to physicians in ICU rooms, or remote monitoring of delicate older people at senior centers. This work presents the feasibility study of a prototype Platform-as-a-Service (PaaS) IT ecosystem for human behavior analytics that was developed to be scalable by the number of visual IoT devices integrated in edge devices distributed across multiple locations. The service is customizable so that it can be implemented for use in environments where patients need close monitoring from clinicians because of risk of abnormal human activity behavior. Once deployed, this platform is designed to automatically detect, acquire and pipe its raw data to the cloud. These data include human skeleton joint tracking, RGB-color, Infra-red, and depth imaging. The edge device pushes these data to cloud search engines such as Elasticsearch, Amazon Web Services, and Microsoft Azure. The skeleton or body tracking is an embedded deep neural network model characteristic of the Microsoft Kinect IV Azure development kit. The body tracking, image, and optional audio signals are all synchronized in time. The body tracking data from the Kinects can be viewed in real-time with Kibana or extracted from the cloud in pseudo-real-time for complex data analytics and modeling by developers at another end of the ecosystem. We show that our platform is capable of tracking human behavior while effectively and accurately piping this information to various cloud services in pseudo real-time. We profiled the performance of our custom Kinect software through a parametric study with four edge-device benchmarks and multiple configurations of our software. We also demonstrate that we can achieve very high correlations between the data acquired at the edge, with two Kinect IV Azure visual IoT devices, as well as the data fetched from the cloud at other endpoints of the infrastructure. In addition, we provide examples of how raw body tracking data can be fetched from the cloud, numerically fused, and visualized in various forms. We also tested our platform with skeleton joint tracking and with hand keypoints tracking using a custom deep-learning model.

ISBN: 9798672147215Subjects--Topical Terms:

516317
Artificial intelligence.
Subjects--Index Terms:

Behavior monitoring

A Scalable and Distributed AI-Assisted Human Behavior Analytics Platform Integrating Visual IOT Devices on the Edge.
LDR:03882nmm a2200397 4500 001 2348543
005 20220912135603.5
008 241004s2020 ||||||||||||||||| ||eng d
020 $a 9798672147215
035 $a (MiAaPQ)AAI28087452
035 $a AAI28087452
040 $a MiAaPQ $c MiAaPQ
100 1 $a Guzman, Herbert Manolo. $0 (orcid)0000-0002-8105-5788 $3 3687910
245 1 0 $a A Scalable and Distributed AI-Assisted Human Behavior Analytics Platform Integrating Visual IOT Devices on the Edge.
260 1 $a Ann Arbor : $b ProQuest Dissertations & Theses, $c 2020
300 $a 85 p.
500 $a Source: Masters Abstracts International, Volume: 82-04.
500 $a Advisor: Rad, Paul.
502 $a Thesis (M.S.)--The University of Texas at San Antonio, 2020.
506 $a This item is not available from ProQuest Dissertations & Theses.
506 $a This item must not be sold to any third party vendors.
520 $a Computer vision and the Internet of Things (IoT) have brought about marked improvements in Visual IoT devices. These are increasingly becoming a more powerful means for analyzing human behavior by leveraging their embedded deep-learning or artificial intelligence (AI) models. Amid the current COVID-19 pandemic, these devices facilitate the implementation of AI-assisted human behavior platforms for remote monitoring of in-home health, remote aid to physicians in ICU rooms, or remote monitoring of delicate older people at senior centers. This work presents the feasibility study of a prototype Platform-as-a-Service (PaaS) IT ecosystem for human behavior analytics that was developed to be scalable by the number of visual IoT devices integrated in edge devices distributed across multiple locations. The service is customizable so that it can be implemented for use in environments where patients need close monitoring from clinicians because of risk of abnormal human activity behavior. Once deployed, this platform is designed to automatically detect, acquire and pipe its raw data to the cloud. These data include human skeleton joint tracking, RGB-color, Infra-red, and depth imaging. The edge device pushes these data to cloud search engines such as Elasticsearch, Amazon Web Services, and Microsoft Azure. The skeleton or body tracking is an embedded deep neural network model characteristic of the Microsoft Kinect IV Azure development kit. The body tracking, image, and optional audio signals are all synchronized in time. The body tracking data from the Kinects can be viewed in real-time with Kibana or extracted from the cloud in pseudo-real-time for complex data analytics and modeling by developers at another end of the ecosystem. We show that our platform is capable of tracking human behavior while effectively and accurately piping this information to various cloud services in pseudo real-time. We profiled the performance of our custom Kinect software through a parametric study with four edge-device benchmarks and multiple configurations of our software. We also demonstrate that we can achieve very high correlations between the data acquired at the edge, with two Kinect IV Azure visual IoT devices, as well as the data fetched from the cloud at other endpoints of the infrastructure. In addition, we provide examples of how raw body tracking data can be fetched from the cloud, numerically fused, and visualized in various forms. We also tested our platform with skeleton joint tracking and with hand keypoints tracking using a custom deep-learning model.
590 $a School code: 1283.
650 4 $a Artificial intelligence. $3 516317
650 4 $a Computer engineering. $3 621879
650 4 $a Computer science. $3 523869
650 4 $a Internet of Things. $3 3538511
650 4 $a COVID-19. $3 3554449
653 $a Behavior monitoring
653 $a Elasticsearch
653 $a Hand keypoints
653 $a Kinect azure
653 $a Skeleton tracking
653 $a Unity
690 $a 0800
690 $a 0464
690 $a 0984
710 2 $a The University of Texas at San Antonio. $b Electrical & Computer Engineering. $3 1018585
773 0 $t Masters Abstracts International $g 82-04.
790 $a 1283
791 $a M.S.
792 $a 2020
793 $a English
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=28087452