東華大學圖書館 |

Language: English

Help

回圖書館首頁

手機版館藏查詢

Back

Switch To: Labeled | MARC Mode | ISBD

Hardware accelerated redundancy elim...

Diao, Kelu.

Linked to FindBook

Google Book

Amazon

博客來

Hardware accelerated redundancy elimination in network system.

Record Type:	Electronic resources : Monograph/item
Title/Author:	Hardware accelerated redundancy elimination in network system./
Author:	Diao, Kelu.
Published:	Ann Arbor : ProQuest Dissertations & Theses, : 2016,
Description:	63 p.
Notes:	Source: Masters Abstracts International, Volume: 78-04.
Contained By:	Masters Abstracts International78-04.
Subject:	Information Technology. -
Online resource:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=10146375
ISBN:	9781369017359

Hardware accelerated redundancy elimination in network system.
Diao, Kelu.

Hardware accelerated redundancy elimination in network system. - Ann Arbor : ProQuest Dissertations & Theses, 2016 - 63 p.

Source: Masters Abstracts International, Volume: 78-04.

Thesis (M.S.)--Purdue University, 2016.

This item is not available from ProQuest Dissertations & Theses.

With the tremendous growth in the amount of information stored on remote locations and cloud systems, many service providers are seeking ways to reduce the amount of redundant information sent across networks by using data de-duplication techniques. Data de-duplication can reduce network traffic without the loss of information, and consequently increase available network bandwidth by reducing redundant traffic. However, due to the heavy computation required for detecting and reducing redundant data transmission, de-duplication itself can become a bottleneck in high capacity links. We completed two parts of work in this research study, Hardware Accelerated Redundancy Elimination in Network Systems (HARENS) and Distributed Redundancy Elimination System Simulation (DRESS). HARENS can significantly improve the performance of redundancy elimination algorithm in a network system by leveraging General Purpose Graphic Processing Unit (GPGPU) techniques as well as other big data optimizations such as the use of a hierarchical multi-threaded pipeline, single machine Map-Reduce, and memory efficiency techniques. Our results indicate that throughput can be increased by a factor of 9 times compared to a naive implementation of the data de-duplication algorithm, providing a net transmission increase of up to 3.0 Gigabits per second (Gbps). DRESS provides further acceleration to the redundancy elimination in network system by deploying HARENS as the server's side redundancy elimination module, and four cooperative distributed byte caches on the clients' side. A client's side distributed byte cache broadcast its cached chunks by sending hash values to other byte caches, so that they can keep a record of all the chunks in the cooperative distributed cache system. When duplications are detected, a client's side byte cache can fetch a chunk directly from either its own cache or peer byte caches rather than server's side redundancy elimination module. Our results indicate that bandwidth savings of the redundancy elimination system with cooperative distributed byte cache can be increased by 12% compared to the one without distributed byte cache, when transferring about 48 Gigabits of data.

ISBN: 9781369017359Subjects--Topical Terms:

1030799
Information Technology.
Subjects--Index Terms:

Accleration

Hardware accelerated redundancy elimination in network system.
LDR:03566nmm a2200421 4500 001 2267225
005 20200623064711.5
008 220629s2016 ||||||||||||||||| ||eng d
020 $a 9781369017359
035 $a (MiAaPQ)AAI10146375
035 $a (MiAaPQ)purdue:19953
035 $a AAI10146375
040 $a MiAaPQ $c MiAaPQ
100 1 $a Diao, Kelu. $3 3544468
245 1 0 $a Hardware accelerated redundancy elimination in network system.
260 1 $a Ann Arbor : $b ProQuest Dissertations & Theses, $c 2016
300 $a 63 p.
500 $a Source: Masters Abstracts International, Volume: 78-04.
500 $a Publisher info.: Dissertation/Thesis.
500 $a Advisor: Papapanagiotou, Ioannis;Hacker, Thomas J.
502 $a Thesis (M.S.)--Purdue University, 2016.
506 $a This item is not available from ProQuest Dissertations & Theses.
506 $a This item must not be added to any third party search indexes.
506 $a This item must not be sold to any third party vendors.
520 $a With the tremendous growth in the amount of information stored on remote locations and cloud systems, many service providers are seeking ways to reduce the amount of redundant information sent across networks by using data de-duplication techniques. Data de-duplication can reduce network traffic without the loss of information, and consequently increase available network bandwidth by reducing redundant traffic. However, due to the heavy computation required for detecting and reducing redundant data transmission, de-duplication itself can become a bottleneck in high capacity links. We completed two parts of work in this research study, Hardware Accelerated Redundancy Elimination in Network Systems (HARENS) and Distributed Redundancy Elimination System Simulation (DRESS). HARENS can significantly improve the performance of redundancy elimination algorithm in a network system by leveraging General Purpose Graphic Processing Unit (GPGPU) techniques as well as other big data optimizations such as the use of a hierarchical multi-threaded pipeline, single machine Map-Reduce, and memory efficiency techniques. Our results indicate that throughput can be increased by a factor of 9 times compared to a naive implementation of the data de-duplication algorithm, providing a net transmission increase of up to 3.0 Gigabits per second (Gbps). DRESS provides further acceleration to the redundancy elimination in network system by deploying HARENS as the server's side redundancy elimination module, and four cooperative distributed byte caches on the clients' side. A client's side distributed byte cache broadcast its cached chunks by sending hash values to other byte caches, so that they can keep a record of all the chunks in the cooperative distributed cache system. When duplications are detected, a client's side byte cache can fetch a chunk directly from either its own cache or peer byte caches rather than server's side redundancy elimination module. Our results indicate that bandwidth savings of the redundancy elimination system with cooperative distributed byte cache can be increased by 12% compared to the one without distributed byte cache, when transferring about 48 Gigabits of data.
590 $a School code: 0183.
650 4 $a Information Technology. $3 1030799
650 4 $a Computer science. $3 523869
653 $a Accleration
653 $a CUDA
653 $a GPU
653 $a Network
653 $a Ns-3
653 $a Redundancy elimination
690 $a 0489
690 $a 0984
710 2 $a Purdue University. $b Computer and Information Technology. $3 2094900
773 0 $t Masters Abstracts International $g 78-04.
790 $a 0183
791 $a M.S.
792 $a 2016
793 $a English
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=10146375