Skip to main content

Advertisement

Log in

A Heterogeneous Cloud-Edge Collaborative Computing Architecture with Affinity-Based Workflow Scheduling and Resource Allocation for Internet-of-Things Applications

  • Published:
Mobile Networks and Applications Aims and scope Submit manuscript

Abstract

Cloud-edge collaborative computing (CECC) is a critical way to solve the real-time problems in the Medical Internet of Things (MIoT) and Industrial IoT (IIoT) applications. However, how to efficiently schedule the real-time and non real-time tasks to the cloud or edge servers that are configured with heterogeneous computing resources such as GPUs, NPUs and FGPAs remains a critical challenge. To address this challenge, this paper first defines the capability elements of CECC architecture, and then formally describes the workflow containerized tasks and heterogeneous computing resources of CECC system. Next, it proposes a heuristic task scheduling algorithm based on the affinity between tasks and nodes (physical machines or virtual machines) by matching the task resource requests with the node resource configurations. Later, it generates the initial mapping matrix between tasks and nodes with the affinity sorting result. And finally, it optimizes the mapping results under the constraints of limited resources and task dependency, which consequently generates an efficient scheduling scheme for the real-time IoT tasks in the CECC system. Experimental results demonstrate that the proposed algorithm can effectively increases the utilization efficiency of heterogeneous resources and improves the scheduling performance of real-time IoT tasks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Algorithm 1
Algorithm 2
Algorithm 3
Algorithm 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Demirel BU, Bayoumy IA, MaA F (2022) Energy-efficient real-time heart monitoring on edge-fog-cloud internet of medical things. IEEE Internet Things J 9:12472–12481

    Article  Google Scholar 

  2. Sánchez-Gallegos DD, Galaviz-Mosqueda A, Gonzalez-Compean JL et al (2020) On the continuous processing of health data in edge-fog-cloud computing by using micro/nanoservice composition. IEEE Access 8:120255–120281

    Article  Google Scholar 

  3. Kajati E, Papcun P, Liu C et al (2019) Cloud based cyber-physical systems: network evaluation study. Adv Eng Inform 42:100988

    Article  Google Scholar 

  4. Hao Y, Chen M, Gharavi H et al (2021) Deep reinforcement learning for edge service placement in softwarized industrial cyber-physical system. IEEE Trans Industr Inf 17:5552–5561

    Article  Google Scholar 

  5. Lin B, Huang Y, Zhang J et al (2020) Cost-driven off-loading for DNN-based applications over cloud, edge, and end devices. IEEE Trans Industr Inf 16:5456–5466

    Article  Google Scholar 

  6. Satyanarayanan M (2017) The emergence of edge computing. Computer 50:30–39

    Article  Google Scholar 

  7. Hu M, Xie Z, Wu D et al (2020) Heterogeneous edge offloading with incomplete information: a minority game approach. IEEE Trans Parallel Distrib Syst 31:2139–2154

    Article  Google Scholar 

  8. Qiu T, Chi J, Zhou X et al (2020) Edge computing in industrial internet of things: architecture, advances and challenges. IEEE Commun Surv Tutorials 22:2462–2488

    Article  Google Scholar 

  9. Vasconcelos FFX, Sarmento RM, Rebouças Filho PP et al (2020) Artificial intelligence techniques empowered edge-cloud architecture for brain CT image analysis. Eng Appl Artif Intell 91:103585

    Article  Google Scholar 

  10. Kaur K, Garg S, Aujla GS et al (2018) Edge computing in the industrial internet of things environment: software-defined-networks-based edge-cloud interplay. IEEE Commun Mag 56:44–51

    Article  Google Scholar 

  11. Xia C, Zhang Y, Wang L et al (2018) Microservice-based cloud robotics system for intelligent space. Robot Auton Syst 110:139–150

    Article  Google Scholar 

  12. Jiang Q, Leung VCM, Tang H et al (2019) Adaptive scheduling of stochastic task sequence for energy-efficient mobile cloud computing. IEEE Syst J 13:3022–3025

    Article  Google Scholar 

  13. Yuan H, Bi J, Zhou M (2019) Spatiotemporal task scheduling for heterogeneous delay-tolerant applications in distributed green data centers. IEEE Trans Autom Sci Eng 16:1686–1697

    Article  Google Scholar 

  14. Li K, Tang X, Li K (2014) Energy-efficient stochastic task scheduling on heterogeneous computing systems. IEEE Trans Parallel Distrib Syst 25:2867–2876

    Article  Google Scholar 

  15. Ghodsi A, Zaharia M, Hindman B et al (2011) Dominant resource fairness: fair allocation of multiple resource types. In: Proceedings of the 8th USENIX conference on Networked systems design and implementation. USENIX Association, Boston, MA, pp 323–336

  16. Abrishami S, Naghibzadeh M, Epema D (2013) Deadline-constrained workflow scheduling algorithms for Infrastructure as a Service Clouds. Futur Gener Comput Syst 29:158–169

    Article  Google Scholar 

  17. Lakhan A, Sodhro AH, Majumdar A et al (2022) A lightweight secure adaptive approach for internet-of-medical-things healthcare applications in edge-cloud-based networks. Sensors 22

  18. Aujla GS, Kumar N, Zomaya AY et al (2018) Optimal decision making for big data processing at edge-cloud environment: an SDN perspective. IEEE Trans Industr Inf 14:778–789

    Article  Google Scholar 

  19. Wen Z, Garg S, Aujla GS et al (2021) Running industrial workflow applications in a software-defined multicloud environment using green energy aware scheduling algorithm. IEEE Trans Industr Inf 17:5645–5656

    Article  Google Scholar 

  20. Chekired DA, Khoukhi L, Mouftah HT (2018) Industrial IoT data scheduling based on hierarchical fog computing: a key for enabling smart factory. IEEE Trans Industr Inf 14:4590–4602

    Article  Google Scholar 

  21. Du R, Liu C, Gao Y et al (2022) Collaborative cloud-edge-end task offloading in NOMA-enabled mobile edge computing using deep learning. J Grid Comput 20:14

    Article  Google Scholar 

  22. Yin L, Luo J, Luo H (2018) Tasks scheduling and resource allocation in fog computing based on containers for smart manufacturing. IEEE Trans Industr Inf 14:4712–4721

    Article  Google Scholar 

  23. Medel V, Tolosana-Calasanz R, Bañares J et al (2018) Characterising resource management performance in Kubernetes. Comput Electr Eng 68:286–297

    Article  Google Scholar 

  24. Kaur K, Garg S, Kaddoum G et al (2020) KEIDS: kubernetes-based energy and interference driven scheduler for industrial IoT in edge-cloud ecosystem. IEEE Internet Things J 7:4228–4237

    Article  Google Scholar 

  25. Nguyen ND, Phan LA, Park DH et al (2020) ElasticFog: elastic resource provisioning in container-based fog computing. IEEE Access 8:183879–183890

    Article  Google Scholar 

  26. Liu X, Zhang M, Zou C, Yang J, Yan X (2021) Edge intelligence for smart metro systems: architecture and enabling technologies. IEEE Network 36(1):136–143

    Article  Google Scholar 

  27. Filip I, Pop F, Serbanescu C et al (2018) Microservices scheduling model over heterogeneous cloud-edge environments as support for IoT applications. IEEE Internet Things J 5:2672–2681

    Article  Google Scholar 

  28. Cao K, Li L, Cui Y et al (2021) Exploring placement of heterogeneous edge servers for response time minimization in mobile edge-cloud computing. IEEE Trans Industr Inf 17:494–503

    Article  Google Scholar 

  29. Gai K, Qin X, Zhu L (2021) An energy-aware high performance task allocation strategy in heterogeneous fog computing environments. IEEE Trans Comput 70:626–639

    Article  Google Scholar 

  30. Sadok H, Campista MEM, Costa LHMK (2021) Stateful DRF: considering the past in a multi-resource allocation. IEEE Trans Comput 70:1094–1105

    Article  MathSciNet  Google Scholar 

  31. Gai K, Qiu M, Zhao H et al (2018) Resource management in sustainable cyber-physical systems using heterogeneous cloud computing. IEEE Trans Sustain Comput 3:60–72

    Article  Google Scholar 

Download references

Funding

This work is supported by the Science and Technology on Thermal Energy and Power Laboratory Open Foundation of China under Grant No.TPL2019C01.

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Shuyu Lyu or Xing Liu.

Ethics declarations

Competing Interests

The authors have no competing interests to declare that are relevant to the content of this article.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lyu, S., Dai, X., Ma, Z. et al. A Heterogeneous Cloud-Edge Collaborative Computing Architecture with Affinity-Based Workflow Scheduling and Resource Allocation for Internet-of-Things Applications. Mobile Netw Appl 28, 1443–1459 (2023). https://doi.org/10.1007/s11036-023-02113-x

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11036-023-02113-x

Keywords

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy