Open Access Open Access  Restricted Access Subscription Access

Reactive Monitoring Adaptation for Dynamic Dataflow on Variable Infrastructure

Chethana R M, Megha G S, Gavina C G, Veeranna Kotagi

Abstract


The important and key concept of the clouds is sharing their resources on many different nodes that are making beneficial for any application. Among these according to the user requirements scheduling the resource is very challenging in cloud environment indeed for the low latency over high velocity data streams. As the resources vary in their performance while allocating to the streaming application on infrastructure , which leads to the distraction of QoS of the application meanwhile the resource cost also should be concise to balance the deployment cost. To formalize the optimization with respect to balance the application cost (domain value) QoS, and resource cost by representing the deployment and runtime (dynamic) resource allocation .So we are proposing a new concept alternate path for the dataflow which dynamic in nature to the infrastructure. We propose a Ranking with deadline based algorithm that will implement in the alternative path to provide the end users with more sophisticated control and resource mapping heuristics for communal of dataflow to give near optimal solution. The effect of both variable dynamic data rate and reactive resource performance should be maintained to balance the throughput constraint and application value.

Full Text:

PDF

References


L. Douglas. 3d data management: Controlling data volume, velocity, and variety. Gartner, Tech. Rep., 2001

Y. Simmhan, S. Aman, A. Kumbhare, R. Liu, S. Stevens, Q. Zhou,and V. Prasanna. Cloud-based software platform for big data analytics in smart grids. Computing in Science Engineering, July 2013.15(4):38–47p.

A. Biem, E. Bouillet, H. Feng, A. Ranganathan, A. Riabov,O. Verscheure, H. Koutsopoulos, and C. Moran. Ibm infosphere streams for scalable, real-time, intelligent transportation service. International Conference on Management of data. ACM SIGMOD,2010:1093–1104p.

M. Gatti, P. Cavalin, S. B. Neto, C. Pinhanez, C. dos Santos, D. Gribel, and A. P. Appel. Large-scale multi- agent-based modeling and simulation of microblogging- based online social network. Multi-Agent-Based Simulation XIV. Springer, 2014:17–33p.

Y. Simmhan, S. Aman, A. Kumbhare, R. Liu, S. Stevens, Q. Zhou, and V. Prasanna. Cloud-based software platform for big data analytics in smart grids. Computing in Science Engineering, July 2013.15(4):8–47p.

J. Dean and S. Ghemawat. Mapreduce: simplified data processing on large clusters. Communications. ACM, 2008.51(1):107–113p.

L. Neumeyer, B. Robbins, A. Nair, and A. Kesari. S4: Distributed stream computing platform. IEEE International Conference on Data Mining Workshops (ICDMW), 2010.

Storm: Distributed and fault-tolerant realtime computation. http://storm.incubator.apache.org/, accessed: 2014-06-30.

M. Zaharia, T. Das, H. Li, S. Shenker, and I. Stoica. Discretized streams: an efficient and fault-tolerant model for stream processing on large clusters. USENIX conference on Hot Topics in Cloud Ccomputing.2012:10–10p.

B. Satzger, W. Hummer, P. Leitner, and S. Dustdar. Esc: Towards an elastic stream computing platform for the cloud. IEEE. International Conference on Cloud Computing (CLOUD), July 2011:348–355p.


Refbacks

  • There are currently no refbacks.