Abstract
The integration of the Internet of Things (IoT) and cloud environment has led to the creation of Cloud of Things, which has given rise to new challenges in IoT area. In this paper, using the Markov model learning method and calculating the need probability of each object to resources shortly to reduce latency and maximize network utilization, allocating resources in the fog layer has been possible and processed. By using simulations in the CloudSim platform, it is examined the processor productivity for the number of tasks, the workflow overhead for the number of tasks, physical machine’s energy consumption for the number of tasks, the data locality for the number of tasks, resource utilization for the number of tasks, and completion of task for the number of tasks and compared with the SMDP (SemiMarkov decision processes) and MDP methods, results show that the proposed research is effective and promising.











Similar content being viewed by others
References
Javadpour, A. (2019). Providing a way to create balance between reliability and delays in SDN networks by using the appropriate placement of controllers. Wireless Personal Communications. https://doi.org/10.1007/s11277-019-06773-5.
Javadpour, A., Abharian, S. K., Wang, G. (2017). Feature selection and intrusion detection in cloud environment based on machine learning algorithms. In 2017 IEEE international symposium on parallel and distributed processing with applications and 2017 IEEE international conference on ubiquitous computing and communications (ISPA/IUCC) (pp. 1417–1421).
Liyanage, M., Braeken, A., Kumar, P., & Ylianttila, M. (2019). IoT security: Advances in authentication. Hoboken: Wiley.
Park, J., Salim, M. M., Jo, J. H., Sicato, J. C. S., Rathore, S., & Park, J. H. (2019). CIoT-Net: A scalable cognitive IoT based smart city network architecture. Human-centric Comput. Inf. Sci., 9(1), 29.
Javadpour, A., Wang, G., Rezaei, S., Chend, S. (2018). Power curtailment in cloud environment utilising load balancing machine allocation. In 2018 IEEE SmartWorld, ubiquitous intelligence computing, advanced trusted computing, scalable computing communications, cloud big data computing, internet of people and smart city innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI) (pp. 1364–1370).
Javadpour, A., Saedifar, K., Wang, G., & Li, K.-C. (2020). Optimal execution strategy for large orders in big data: Order type using Q-learning considerations. Wireless Personal Communications, 112, 123–148.
Javadpour, A. (2019). An optimize-aware target tracking method combining MAC layer and active nodes in wireless sensor networks. Wireless Personal Communications, 108, 711–728.
Chowdary, E. D., Yakobu, D. (2016). Cloud of things (CoT) integration challenges. In 2016 IEEE international conference on computational intelligence and computing research (ICCIC) (pp. 1–5).
Atlam, H., Walters, R., & Wills, G. (2018). Fog computing and the internet of things: A review. Big Data and Cognitive Computing, 2(2), 10.
Yousefpour, A., et al. (2019). All one needs to know about fog computing and related edge computing paradigms: A complete survey. Journal of Systems Architecture, 98, 289–330.
Tekinerdogan, B., & Oral, A. (2017). Chapter 8—Performance isolation in cloud-based big data architectures. In I. Mistrik, R. Bahsoon, N. Ali, M. Heisel, & B. Maxim (Eds.), Software architecture for big data and the cloud (pp. 127–145). Boston: Morgan Kaufmann.
Javadpour, A., Wang, G., Xing, X. (2018). Managing heterogeneous substrate resources by mapping and visualization based on software-defined network. In 2018 IEEE international conference on parallel distributed processing with applications, ubiquitous computing communications, big data cloud computing, social computing networking, sustainable computing communications (ISPA/IUCC/BDCloud/SocialCom/SustainCom) (pp. 316–321).
Ashrafi, T. H., Hossain, M. A., Arefin, S. E., Das, K. D. J., & Chakrabarty, A. (2017). Service based FOG computing MODEL for IoT. In 2017 IEEE 3rd international conference on collaboration and internet computing (CIC) (pp. 163–172).
Javadpour, A., Adelpour, N., Wang, G., & Peng, T. (2018). Combing fuzzy clustering and PSO algorithms to optimize energy consumption in WSN networks. In 2018 IEEE SmartWorld, ubiquitous intelligence & computing, advanced & trusted computing, scalable computing & communications, cloud & big data computing, internet of people and smart city innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI) (pp. 1371–1377).
Javadpour, A., Wang, G., Rezaei, S., & Li, K.-C. (2020). Detecting straggler MapReduce tasks in big data processing infrastructure by neural network. The Journal of Supercomputing. https://doi.org/10.1007/s11227-019-03136-6.
Javadpour, A., & Memarzadeh-Tehran, H. (2015). A wearable medical sensor for provisional healthcare. In: ISPTS 2015 - 2nd international symposium on physics and technology of sensors dive deep into sensors (pp. 293–296).
Javadpour, A., Wang, G., & Li, K.-C. (2019). A high throughput MAC protocol for wireless body area networks in intensive care. In Smart city and informatization (pp. 23–34).
Javadpour, A., & Memarzadeh-Tehran, H. (2015). Implementing a smart method to eliminate artifacts of life signals. In 2015 international conference on smart sensors and application (ICSSA) (pp. 155–160).
Javadpour, A., & Mohammadi, A. R. (2016). Improving brain magnetic resonance image (MRI) segmentation via a novel algorithm based on genetic and regional growth. Journal of Biomedical Physics and Engineering, 6(2), 95–108.
Javadpour, A. (2019). Improving resources management in network virtualization by utilizing a software-based network. Wireless Personal Communications, 106(2), 505–519.
Javadpour, A., Rezaei, S., Li, K.-C., Wang, G. (2020) A scalable feature selection and opinion miner using whale optimization algorithm. In Advances in signal processing and intelligent recognition systems (pp. 237–247).
Kling, A. A. (2014). Cloud computing. Lucent Books, A part of Gale, Cengage Learning.
Zykov, S., & Shumsky, L. (2016). Application of information processes applicative modelling to virtual machines auto configuration. Procedia Computer Science, 96, 1041–1048.
Alohali, B., Merabti, M., & Kifayat, K. (2014). A cloud of things (CoT) based security for home area network (HAN) in the smart grid. In 2014 eighth international conference on next generation mobile apps, services and technologies (pp. 326–330).
Bonomi, F., Milito, R., Zhu, J., & Addepalli, S. (2012). Fog computing and its role in the internet of things. In Proceedings of the first edition of the MCC workshop on mobile cloud computing (pp. 13–16).
El Kafhali, S., & Salah, K. (2017). Efficient and dynamic scaling of fog nodes for IoT devices. The Journal of Supercomputing, 73(12), 5261–5284.
Santos, J., Wauters, T., Volckaert, B., & de Turck, F. (2018). Fog computing: Enabling the management and orchestration of smart city applications in 5G networks. Entropy, 20(1), 4.
P. Marie, T. Desprats, S. Chabridon, M. Sibilla (2016) Enabling self-configuration of QoC-centric fog computing entities. In: 2016 international IEEE conferences on ubiquitous intelligence computing, advanced and trusted computing, scalable computing and communications, cloud and big data computing, internet of people, and smart world congress (UIC/ATC/ScalCom/CBDCom/IoP/SmartWorld) (pp. 526–533).
Niknejad, N., Hussin, A. R. C., & Amiri, I. S. (2019). Introduction of service-oriented architecture (SOA) adoption. In The impact of service oriented architecture adoption on organizations. Cham: Springer International Publishing.
Delicato, F. C., Pires, P. F., & Batista, T. (2017). Resource management for internet of things. Cham: Springer International Publishing.
Vasconcelos, D. R., Andrade, R. M. C., Severino, V., & de Souza, J. N. (2019). Cloud, fog, or mist in IoT? That is the question. ACM Transactions on Internet Technology, 19(2), 1–20.
Lin, C., Deng, D., & Yao, C. (2019). Resource allocation in vehicular cloud computing systems with heterogeneous vehicles and roadside units. IEEE Internet of Things Journal, 5(5), 3692–3700.
Madni, S. H. H., Latiff, M. S. A., Coulibaly, Y., & Abdulhamid, S. M. (2017). Resource scheduling for infrastructure as a service (IaaS) in cloud computing. Journal of Network and Computer Applications, 68(C), 173–200.
Nassar, A., Yilmaz, Y. (2019). Resource allocation in fog RAN for heterogeneous IoT environments based on reinforcement learning. In ICC 2019–2019 IEEE international conference on communications (ICC) (pp. 1–6).
Chen, J., & Menzies, T. (2018). {RIOT:} {A} Stochastic-based method for workflow scheduling in the cloud. In: 11th {IEEE} international conference on cloud computing, {CLOUD} 2018, San Francisco, CA, USA, July 2–7, 2018 (pp. 318–325).
Deldari, A., Naghibzadeh, M., & Abrishami, S. (2017). CCA: A deadline-constrained workflow scheduling algorithm for multicore resources on the cloud. The Journal of Supercomputing, 73(2), 756–781.
Chrysikos, A., & Ward, R. (2014). Cloud computing within higher education: Applying knowledge as a service (KaaS). In Z. Mahmood (Ed.), Continued rise of the cloud: advances and trends in cloud computing (pp. 339–362). London: Springer.
Nasim, R., Zola, E., & Kassler, A. J. (2018). Robust optimization for energy-efficient virtual machine consolidation in modern datacenters. Cluster Computing, 21(3), 1681–1709.
Quang-Hung, N., Nien, P. D., Nam, N. H., Huynh Tuong, N., Thoai, N. (2013). A genetic algorithm for power-aware virtual machine allocation in private cloud. In: Proceedings of the 2013 international conference on information and communication technology (pp. 183–191).
Ebrahimirad, V., Goudarzi, M., & Rajabi, A. (2015). Energy-aware scheduling for precedence-constrained parallel virtual machines in virtualized data centers. Journal of Grid Computing, 13(2), 233–253.
Ding, Y., Qin, X., Liu, L., & Wang, T. (2015). Energy efficient scheduling of virtual machines in cloud with deadline constraint. Future Generation Computer Systems, 50, 62–74.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Mirmohseni, S.M., Tang, C. & Javadpour, A. Using Markov Learning Utilization Model for Resource Allocation in Cloud of Thing Network. Wireless Pers Commun 115, 653–677 (2020). https://doi.org/10.1007/s11277-020-07591-w
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11277-020-07591-w