Big File Cloud Storage System: High-Performance Secure Storage Service Based On De-duplication And File Compression

Sukruti Bhimrao Gajare

Abstract


Nowadays, cloud-based storage systems are advancing and has become an emerging trend in storing of big data
files. Many complications arise while designing an efficient and
low intricate storage engine for cloud-based systems considering
the major issues like metadata size, latency for uploading and
downloading, big files processing, parallel Input and Output,
deduplication, distributed nature, high scalability. Key value
stores has a major and important role and have given many
advantages when solving those issues. This paper presents about
Big File Cloud Based Storage System (BFCSS) with its modules
and architecture that aims to handle most of problems in a Cloud
Storage System for storing big files, which is based on key value
store. Here we are proposing less-intricate, fixed metadata design,
which allows fast as well as highly-concurrent, distributed file
Input/Output, and simple file and data de-duplication method
for static data. For storing big files of nearly terabytes of data
, this method can be used to build the Cloud Based Storage
System.

Full Text:

PDF

References


Thanh Trung Nguyen, Tin Khac Vu, Ha Noi, Minh Hieu Nguyen, Viet

Nam, BFC: High-Performance Distributed Big-File Cloud Storage Based

On Key value Store, June 1-3 2015, IEEE SNPD 2015, 978-1- 4799-

-7/15(Base Paper).

M.H.Nguyen and T.T.Nguyen, Design Sequential Chunk identity with

Lightweight Metadata for Big File Cloud Storage, IJCSNS International

Journal of Computer Science and Network Security, VOL.15 No.9,

September 2015.

Jin Li, Xinyi Huang, Xiaofeng Chen, Shaohua Tang and Yang

Xiang, Mohammad Mehedi Hassan, Abdulhameed Alelaiwi, Secure

Distributed Deduplication Systems with Improved Reliability, 2015,

1109/TC.2015.2401017, IEEE Transactions on Computers.

Sukruti Gajare, R. A. Khan, Big File Cloud Storage (BFCS): Distributed

Storage Service with De-Duplication and Secure Storage, International

Journal of Science and Research(IJSR), Volume 5 Issue 1 January 2016,

Pages 573-576.

Sukruti B Gajare, R.A.Khan, Big File Cloud Based Storage System

(BFCSS): High-Performance Secure Storage Service Based On Deduplication And Key-Value Store, in Proceedings : Sixth Post Graduate

Conference of Computer Engineering (cPGCON 2017), Organized by

SPPU, Pune and SITRC, Nashik, March 2017, Pages 174-179.

Sukruti B.Gajare, Rubeena A.Khan, Secure Cloud Storage Service Based

on De-duplication and Compression”, International Journal of Computer

Science and Information Security, Vol. 15, No. 4, April 2017, Pages 422-

A Minh Hieu Nguyen, Thanh Trung Nguyen , Zing Database: HighPerformance Key value Store For Large-Scale Storage Service, 17 August

, Springer - Vietnam J Comput Sci (2015), DOI 10.1007/s40595-014-

-4.

V Ravi Shankar,Joshi Vinay Kumar, Deduplication and Encryption in

Cloud Storage, May 2015, International Journal of Innovative Research

in Science, Engineering and Technology, Vol. 4, Special Issue 6.

Mihir Bellare, Sriram Keelveedhi, Thomas Ristenpart, DupLESS: ServerAided Encryption for Deduplicated Storage, 2013, USENIX Security

Symposium.

Po-ChingChien, Iuon-Chang Lin, Data Deduplication Scheme for Cloud

Storage, 2012, International Journal of Computer, Consumer and Control

(IJ3C), Vol. 1, No.2.

Idilio Drago, Anna Sperotto, Marco Mellia, Maurizio M. Munafa, Ramin

Sadre, Aiko Pras, Inside Dropbox: Understanding Personal Cloud Storage

Services, November 1416, 2012, ACM, 978-1- 4503-XXXX-X/12/11.

Fay Chang, Jeffrey Dean, Sanjay Ghemawat, Wilson C. Hsieh, Deborah

A. Wallach, Mike Burrows, Tushar Chandra, Andrew Fikes, Robert E.

Gruber, Bigtable: A Distributed Storage System for Structured Data,

Google, Inc.

Secure Hash Standard, Computer Systems Laboratory National Institute

of Standards and Technology Gaithersburg, MD 2089, Issued April 17,

Dhruba Borthakur, HDFS Architecture Guide, Copyright 2008 The

Apache Software Foundation.

Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leung, The Google

File System, October 1922, 2003, ACM, 1- 58113-757-5/03/0010.




 

Copyright © IJETT, International Journal on Emerging Trends in Technology