Skip navigation
Skip navigation

Collaboration- and Fairness-Aware Big Data Management in Distributed Clouds

Xia, Qiufen; Xu, Zichuan (Edward); Liang, Weifa; Zomaya, Albert Y

Description

With the advancement of information and communication technology, data are being generated at an exponential rate via various instruments and collected at an unprecedented scale. Such large volume of data generated is referred to as big data, which now are revolutionizing all aspects of our life ranging from enterprises to individuals, from science communities to governments, as they exhibit great potentials to improve efficiency of enterprises and the quality of life. To obtain nontrivial...[Show more]

dc.contributor.authorXia, Qiufen
dc.contributor.authorXu, Zichuan (Edward)
dc.contributor.authorLiang, Weifa
dc.contributor.authorZomaya, Albert Y
dc.date.accessioned2016-02-24T22:41:56Z
dc.identifier.issn1045-9219
dc.identifier.urihttp://hdl.handle.net/1885/98865
dc.description.abstractWith the advancement of information and communication technology, data are being generated at an exponential rate via various instruments and collected at an unprecedented scale. Such large volume of data generated is referred to as big data, which now are revolutionizing all aspects of our life ranging from enterprises to individuals, from science communities to governments, as they exhibit great potentials to improve efficiency of enterprises and the quality of life. To obtain nontrivial patterns and derive valuable information from big data, a fundamental problem is how to properly place the collected data by different users to distributed clouds and to efficiently analyze the collected data to save user costs in data storage and processing, particularly the cost savings of users who share data. By doing so, it needs the close collaborations among the users, by sharing and utilizing the big data in distributed clouds due to the complexity and volume of big data. Since computing, storage and bandwidth resources in a distributed cloud usually are limited, and such resource provisioning typically is expensive, the collaborative users require to make use of the resources fairly. In this paper, we study a novel collaboration- and fairness-aware big data management problem in distributed cloud environments that aims to maximize the system throughout, while minimizing the operational cost of service providers to achieve the system throughput, subject to resource capacity and users fairness constraints. We first propose a novel optimization framework for the problem. We then devise a fast yet scalable approximation algorithm based on the built optimization framework. We also analyze the time complexity and approximation ratio of the proposed algorithm. We finally conduct experiments by simulations to evaluate the performance of the proposed algorithm. Experimental results demonstrate that the proposed algorithm is promising, and outperforms other heuristics.
dc.publisherInstitute of Electrical and Electronics Engineers (IEEE Inc)
dc.sourceIEEE Transactions on Parallel and Distributed Systems
dc.titleCollaboration- and Fairness-Aware Big Data Management in Distributed Clouds
dc.typeJournal article
local.description.notesImported from ARIES
local.identifier.citationvolume99
dc.date.issued2015
local.identifier.absfor080403 - Data Structures
local.identifier.ariespublicationu4056230xPUB565
local.type.statusPublished Version
local.contributor.affiliationXia, Qiufen, College of Engineering and Computer Science, ANU
local.contributor.affiliationXu, Zichuan (Edward), College of Engineering and Computer Science, ANU
local.contributor.affiliationLiang, Weifa, College of Engineering and Computer Science, ANU
local.contributor.affiliationZomaya, Albert Y, University of Sydney
local.description.embargo2037-12-31
local.bibliographicCitation.issue99
local.identifier.doi10.1109/TPDS.2015.2473174
local.identifier.absseo970108 - Expanding Knowledge in the Information and Computing Sciences
dc.date.updated2016-06-14T08:58:38Z
CollectionsANU Research Publications

Download

File Description SizeFormat Image
01_Xia_Collaboration-_and_2015.pdf1.12 MBAdobe PDF    Request a copy


Items in Open Research are protected by copyright, with all rights reserved, unless otherwise indicated.

Updated:  19 May 2020/ Responsible Officer:  University Librarian/ Page Contact:  Library Systems & Web Coordinator