東華大學圖書館 |

Language: English

Help

回圖書館首頁

手機版館藏查詢

Back

Switch To: Labeled | MARC Mode | ISBD

Improving Ml Applications in Shared ...

Harlap, Aaron.

Linked to FindBook

Google Book

Amazon

博客來

Improving Ml Applications in Shared Computing Environments.

Record Type:	Electronic resources : Monograph/item
Title/Author:	Improving Ml Applications in Shared Computing Environments./
Author:	Harlap, Aaron.
Published:	Ann Arbor : ProQuest Dissertations & Theses, : 2019,
Description:	110 p.
Notes:	Source: Dissertations Abstracts International, Volume: 80-12, Section: B.
Contained By:	Dissertations Abstracts International80-12B.
Subject:	Computer Engineering. -
Online resource:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=13883838
ISBN:	9781392186848

Improving Ml Applications in Shared Computing Environments.
Harlap, Aaron.

Improving Ml Applications in Shared Computing Environments. - Ann Arbor : ProQuest Dissertations & Theses, 2019 - 110 p.

Source: Dissertations Abstracts International, Volume: 80-12, Section: B.

Thesis (Ph.D.)--Carnegie Mellon University, 2019.

This item must not be sold to any third party vendors.

Machine learning (ML) has become a powerful building block for modern services, scientific endeavors and enterprise processes. The expensive computations required for training ML models often makes it desirable to run them in a distributed manner in shared computing environments (e.g., Amazon EC2, Microsoft Azure, in-house shared clusters). Shared computing environments introduce a number of challenges, including uncorrelated performance jitter, heterogeneous resources, transient resources and limited bandwidth. This dissertation demonstrates that, by structuring software frameworks and work distribution to exploit transient resources and address performance jitter and communication bandwidth limitations, we can improve the efficiency of training machine learning models.We support this assertion with three case study systems: FlexRR, Proteus, and PipeDream. FlexRR is a distributed machine learning training system that combines a flexible synchronization model with dynamic peer-to-peer re-assignment of work among workers to address stragglers caused by performance jitter. FlexRR observes near ideal run-time, mitigating the adverse effects of stragglers observed in shared computing environments. Proteus is an agile elastic machine learning training system that uses tiers of reliability and intelligent resource management to efficiently utilize transient compute resources. Evaluations on AWS EC2 show that Proteus reduces cost by 85% relative to non-transient pricing, and by 43% relative to previous approaches, while simultaneously reducing runtimes by up to 37%. PipeDream is a distributed training system for deep neural networks (DNNs) that partitions ranges of DNN layers among machines and aggressively pipelines computation and communication. By reducing the amount of communication, and overlapping communication and computation, PipeDream provides a 5x or more improvement in "time to accuracy" for training large DNN models.

ISBN: 9781392186848Subjects--Topical Terms:

1567821
Computer Engineering.

Improving Ml Applications in Shared Computing Environments.
LDR:03029nmm a2200325 4500 001 2210827
005 20191121124318.5
008 201008s2019 ||||||||||||||||| ||eng d
020 $a 9781392186848
035 $a (MiAaPQ)AAI13883838
035 $a (MiAaPQ)cmu:10407
035 $a AAI13883838
040 $a MiAaPQ $c MiAaPQ
100 1 $a Harlap, Aaron. $3 3437969
245 1 0 $a Improving Ml Applications in Shared Computing Environments.
260 1 $a Ann Arbor : $b ProQuest Dissertations & Theses, $c 2019
300 $a 110 p.
500 $a Source: Dissertations Abstracts International, Volume: 80-12, Section: B.
500 $a Publisher info.: Dissertation/Thesis.
500 $a Advisor: Ganger, Gregory R.;Gibbons, Phillip B.
502 $a Thesis (Ph.D.)--Carnegie Mellon University, 2019.
506 $a This item must not be sold to any third party vendors.
520 $a Machine learning (ML) has become a powerful building block for modern services, scientific endeavors and enterprise processes. The expensive computations required for training ML models often makes it desirable to run them in a distributed manner in shared computing environments (e.g., Amazon EC2, Microsoft Azure, in-house shared clusters). Shared computing environments introduce a number of challenges, including uncorrelated performance jitter, heterogeneous resources, transient resources and limited bandwidth. This dissertation demonstrates that, by structuring software frameworks and work distribution to exploit transient resources and address performance jitter and communication bandwidth limitations, we can improve the efficiency of training machine learning models.We support this assertion with three case study systems: FlexRR, Proteus, and PipeDream. FlexRR is a distributed machine learning training system that combines a flexible synchronization model with dynamic peer-to-peer re-assignment of work among workers to address stragglers caused by performance jitter. FlexRR observes near ideal run-time, mitigating the adverse effects of stragglers observed in shared computing environments. Proteus is an agile elastic machine learning training system that uses tiers of reliability and intelligent resource management to efficiently utilize transient compute resources. Evaluations on AWS EC2 show that Proteus reduces cost by 85% relative to non-transient pricing, and by 43% relative to previous approaches, while simultaneously reducing runtimes by up to 37%. PipeDream is a distributed training system for deep neural networks (DNNs) that partitions ranges of DNN layers among machines and aggressively pipelines computation and communication. By reducing the amount of communication, and overlapping communication and computation, PipeDream provides a 5x or more improvement in "time to accuracy" for training large DNN models.
590 $a School code: 0041.
650 4 $a Computer Engineering. $3 1567821
650 4 $a Computer science. $3 523869
690 $a 0464
690 $a 0984
710 2 $a Carnegie Mellon University. $b Electrical and Computer Engineering. $3 2094139
773 0 $t Dissertations Abstracts International $g 80-12B.
790 $a 0041
791 $a Ph.D.
792 $a 2019
793 $a English
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=13883838