Application �Aware Big Data Duplication In Cloud Environment

BALE SREELATHA; A LIZI

Application �Aware Big Data Duplication In Cloud Environment

Authors: BALE SREELATHA, A LIZI

Unique Paper ID: 146092
Volume: 4
Issue: 11
PageNo: 1887-1895

Keywords: No Keywords Found

Abstract:
Deduplication has become a widely deployed technology in cloud data centers to improve IT resources efficiency. However, traditional techniques face a great challenge in big data deduplication to strike a sensible tradeoff between the conflicting goals of scalable deduplication throughput and high duplicate elimination ratio. We propose AppDedupe, an application-aware scalable inline distributed deduplication framework in cloud environment, to meet this challenge by exploiting application awareness, data similarity and locality to optimize distributed deduplication with inter-node two-tiered data routing and intra-node application-aware deduplication. It first dispenses application data at file level with an application-aware routing to keep application locality, then assigns similar application data to the same storage node at the super-chunk granularity using a hand printing-based stateful data routing scheme to maintain high global deduplication efficiency, meanwhile balances the workload across nodes. AppDedupe builds application-aware similarity indices with super-chunk handprints to speed up the intra-node deduplication process with high efficiency. Our experimental evaluation of AppDedupe against state-of-the-art, driven by real-world datasets, demonstrates that AppDedupe achieves the highest global deduplication efficiency with a higher global deduplication effectiveness than the high-overhead and poorly scalable traditional scheme, but at an overhead only slightly higher than that of the scalable but low duplicate-elimination-ratio approaches.

Download article

email to a friend

Cite This Article

ISSN: 2349-6002
Volume: 4
Issue: 11
PageNo: 1887-1895

Application �Aware Big Data Duplication In Cloud Environment

Available:https://ijirt.org/Article?manuscript=146092

18 Apr, 2018

Event-based Fault Detection Filtering for Complex

04 Apr, 2018

On the Maximum Rate of Networked Computation in a Capacitated Network

29 Mar, 2018

Efficient and Expressive Keyword Search Over Encrypted Data in Cloud

Impact Factor
8.01 (Year 2024)

UGC Approved
Journal no 47859

Join Our IPN

IJIRT Partner Network

Submit your research paper and those of your network (friends, colleagues, or peers) through your IPN account, and receive 800 INR for each paper that gets published.

Join Now

Latest Publication

Recent Conferences

NCSEM 2024

National Conference on Sustainable Engineering and Management - 2024 Last Date: 15th March 2024

Submit inquiry