Efficient Dynamic Load-Balance Flow Scheduling in Cloud for Big Data Centers

Snehal Ghodake, Sulochana Sonkamble

Abstract


Big data centers in cloud, large amount of data needs to be transferred frequently among thousands of interconnected servers. In which load balancing and flow scheduling is a challenging issue. The OpenFlow is a auspicious solution to balance data flows in big data center network through programmatic traffic controller. Existing solution can able to statically set up routes only at initialization stage of data transmissions, which experiences from dynamical ow distribution and network changing state so it results in decrease system performance. In this paper, we will propose a new dynamical load-balanced scheduling (DLBS) approach for increase the network throughput to dynamically balance workload. This approach formulate the DLBS problem, and then develop a set of improved heuristic scheduling algorithms for the two typical OpenFlow network models, which balance data flows time slot by time slot. Experimental results demonstrate that our DLBS approach signicantly outperforms other load-balanced scheduling algorithms Round Robin and LOBUS; and the higher imbalance degree data ows in data centers exhibit, the more improvement our DLBS approach will bring to the data centers.

Full Text:

PDF

References


Z.Z.Cao, M.Kodialam and T.V.Lakshman. Joint Static and Dynamic

Traffic Scheduling in Data Center Networks. in Proceedings of IEEE

INFOCOM 2014, pp.2445-2553.

J.Lu, D.Li, Bias Correction in Small Sample from Big Data, IEEE

Transactions on Knowledge and Data Engineering, Vol.25, No.11, 2013,

pp.2658-2663.

A.G.Erdman, D.F.Keefe, R. Schiestl, Grand Challenge: Applying Regulatory

Science and Big Data to Improve Medical Device Innovation, IEEE

Transactions on Biomedical Engineering, 60(3) (2013) 700-706.

X.Han, J.Li, D.Yang et al., Efficient Skyline Computation on Big Data,

IEEE Transactions on Knowledge and Data Engineering, Vol.25, No.11,

, pp.2521-2535.

A.G.Erdman, D.F.Keefe, R.Schiestl, Grand Challenge: Applying Regulatory

Science and Big Data to Improve Medical Device Innovation, IEEE

Transactions on Biomedical Engineering, Vol.60, No.3, 2013, pp.700-706.

K.Greene, TR10: Software-Defined Networking, MIT Technology Review,

Retrieved Oct. 7, 2011.

R.M.Pathan and J.Jonsson. Load regulating algorithm for staticpriority

task scheduling on multiprocessors. Proc. of 2010 IEEE International

Symposium on Parallel and Distributed Processing (IPDPS), 2010, pp.

-12.

N.Handigol, S.Seetharaman, M.Flajslik, N.McKeown, and R.Johari, Plugn-Serve:

Load-balancing web traffic using OpenFlow, Demo at ACM

SIGCOMM, Aug. 2009.

.Schlansker, Y.Turner, J.Tourrilhes, and A.Karp, Ensemble Routing for

Datacenter Networks, In ACM ANCS, La Jolla, CA, 2010.

R.Wang, D.Butnariu, and J. Rexford, OpenFlow-Based Server Load

Balancing Gone Wild, in: Proceedings of Workshop on HotICE, Mar.

N.Gude, T.Koponen, Justin Pettit et al., NOX: Towards an Operating

System for Networks, SIGCOMM Comput. Commun. Rev., Vol.38, July

, pp. 105-110.

N.McKeown, T.Anderson, H.Balakrishnan, G.Parulkar, L.Peterson,

J.Rexford, S.Shenker, and J.Turner, OpenFlow: Enabling Innovation in

Campus Networks, SIGCOMM Comput. Commun. Rev., 2008.

C.-W Tsai, W.-C. Huang, M.-Hsiu et al. A Hyper-Heuristic Scheduling

Algorithm for Cloud. IEEE Transactions on Cloud Computing, Vol.2,

No.2, pp.236-249, 2014.

F.Zhang, J.Cao, K.Hwang et al. Adaptive Workflow Scheduling on

Cloud Computing Platforms with Iterative Ordinal Optimization. IEEE

Transactions on Cloud Computing, Vol.PP, No.99, 2014.

S.Sharma, S.Singh, and M.Sharma, Performance Analysis of Load

Balancing Algorithms for cluster of Video on Demand Servers, in:

Proceedings of IACC, 2011.

T.N.Anitha, R.Balakrishna, An Efficient and Scalable Content Based Dynamic

Load Balancing Using Multiparameters on Load Aware Distributed

Multi-Cluster Servers, IJEST, 2008.

M.Al-Fares, S.Radhakrishnan, B.Raghavan, N.Huang and A.Vahdat.

Hedera: Dynamic flow scheduling for data center networks. Proc. of

Networked Systems Design and Implementation (NSDI) Symposium,

M.Chowdhury, Y.Zhong and I.Stoica. Efficient coflow scheduling with

Varys. Proc. of the 2014 ACM conference on SIGCOMM, vol.44, No.4,

pp.443-454, 2014.

Z.Cao, M.Kodialam and T.V. Lakshman. Joint static and dynamic traffic

scheduling in data center networks. Proc. of IEEE INFOCOM, 2014,

pp.2445-2453.

Q.Zhang, M.F.Zhani, Y.Yang et al. PRISM: Fine-Grained ResourceAware

Scheduling for MapReduce. IEEE Transactions on Cloud Computing,

Vol.PP, No.99, 2015.

Y.Shi, C.Tian, Y.Zhang, and S.Lu, BCube: A High Performance,Servercentric

Network Architecture for Modular Data Center, In Proceedings

of SIGCOMM 2009.

Z.Xu, R.Huang, Performance Study of Load Balancing Algorithms

in Distributed Web Server Systems, CS213 Parallel and Distributed

Processing Project Report.

N.Handigol et al., Aster*x: Load-balancing web traffic over widearea

networks, in: Proceedings of GENI Engineering Conf. 9, 2010.




 

Copyright © IJETT, International Journal on Emerging Trends in Technology