Skip to main content

Advertisement

Springer Nature Link
Log in

A decision-making model for self-driving vehicles based on GPT-4V, federated reinforcement learning, and blockchain

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Decision-making is crucial in fully autonomous vehicle operations and is expected to greatly influence future transportation systems. Observing the current driving status of autonomous vehicles is vital for its decision-making process. The autonomous connected vehicles on the road send significant data about their movements to the server to maintain continuous training. With the Proof of Authority (PoA) consensus process, blockchain technology provides a valid, decentralised and secure option to improve transactions throughput and minimise delay. The limited computational capacity of vehicles poses a challenge in achieving high accuracy and low latency while training self-driving algorithms. GPT-4V surpassed challenging autonomous systems in scene interpretation and causal thinking. GPT-4V has ability to navigate circumstances without access to database, interpret intentions, and make sound decisions in real-world driving scenarios. The reward function and different driving conditions are organised to allow an optimal search to find the most efficient driving style while ensuring safety. The consequences of the Blockchain-enabled decision-making model (DMM) for Self-Driving Vehicles (SDV) primarily based on GPT-4V and Federated Reinforcement Learning (FRL) would, likely, upgrades in decision-making accuracy, operational performance, statistics integrity, and potentially enhanced learning skills in SDV. Integrating blockchain technology, superior language modelling GPT-4V and FRL may lead to multiplied safety, reliability, and decision-making ability in SDV. This study utilised the Simulation of Urban MObility (SUMO) simulator to assess the ability of SDV to maintain its desired speed consistently and securely in a highway setting using proposed DMM. This study indicates that the suggested DMM, utilising the driving state evaluation approach for SDV, can help these vehicles operate safely and effectively. The performance of the proposed model, such as CPU utilisation, bandwidth and latency, are evaluated through multiple tests.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability statement

Data are not available for this manuscript.

References

  1. Wen L, Yang X, Fu D, Wang X, Cai P, Li X, Qiao Y (2014) On the Road with GPT-4V (vision): Explorations of Utilizing Visual-Language Model as Autonomous Driving Agent. In ICLR 2024 Workshop on Large Language Model (LLM) Agents.

  2. Ding W, Xu C, Arief M, Lin H, Li B, Zhao D (2023) A survey on safety-critical driving scenario generation-a methodological perspective. IEEE Trans Intell Transp Syst. https://doi.org/10.1109/TITS.2023.3259322

    Article  Google Scholar 

  3. Goudarzi P, Hassanzadeh B (2024) Collision risk in autonomous vehicles: classification, challenges, and open research areas. Vehicles 6(1):157–190. https://doi.org/10.3390/vehicles6010007

    Article  Google Scholar 

  4. Huang M, Li S, Guo M, Han L (2021) A DMM for self-driving vehicles based on overtaking frequency. J Adv Transp 2021:1–13. https://doi.org/10.1155/2021/5948971

    Article  Google Scholar 

  5. Statista report, Vehicles & Road Traffic, Number of autonomous vehicles globally 2022–2030, Published by Martin Placek, Oct 11, 2023. Accessed on 1st May 2024. https://www.statista.com/statistics/1230664/projected-number-autonomous-cars-worldwide/

  6. Kim J, Lee J (2023) How does ChatGPT introduce transport problems and solutions in north America? Findings. https://doi.org/10.32866/001c.72634

    Article  Google Scholar 

  7. Al-Nuaimi M, Wibowo S, Qu H, Aitken J, Veres S (2021) Hybrid verification technique for decision-making of self-driving vehicles. J Sens Actuator Netw 10(3):42. https://doi.org/10.3390/jsan10030042

    Article  Google Scholar 

  8. Azarafza M, Nayyeri M, Steinmetz C, Staab S, Rettberg A (2024) Hybrid reasoning based on large language models for autonomous vehicle driving. arXiv preprint arXiv:2402.13602.

  9. Xu M, Niyato D, Kang J, Xiong Z, Jamalipour A, Fang Y, Kim DI (2024) Integration of mixture of experts and multimodal generative ai in internet of vehicles: a survey. arXiv preprint arXiv:2404.16356.

  10. Alzubi J, Nayyar A, Kumar A (2018) Machine learning from theory to algorithms: an overview. In Journal of physics: conference series (Vol. 1142, p. 012012). IOP Publishing.

  11. Kim MS, Eoh G, Park TH (2022) Decision making for self-driving vehicles in unexpected environments using efficient reinforcement learning methods. Electronics 11(11):1685. https://doi.org/10.3390/electronics11111685

    Article  Google Scholar 

  12. Masello L, Sheehan B, Murphy F, Castignani G, McDonnell K, Ryan C (2022) From traditional to autonomous vehicles: a systematic review of data availability. Transp Res Rec 2676(4):161–193

    Article  Google Scholar 

  13. Zhou X, Knoll AC (2024) GPT-4V as traffic assistant: an in-depth look at vision language model on complex traffic events. arXiv preprint arXiv:2402.02205. https://doi.org/10.48550/arXiv.2402.02205

  14. Fu D, Li X, Wen L, Dou M, Cai P, Shi B, Qiao Y (2024) Drive like a human: rethinking autonomous driving with large language models. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (pp. 910–919). https://doi.org/10.48550/arXiv.2307.07162

  15. Pokhrel SR, Choi J (2020) Federated learning with blockchain for autonomous vehicles: analysis and design challenges. IEEE Trans Commun 68(8):4734–4746. https://doi.org/10.1109/TCOMM.2020.2990686

    Article  Google Scholar 

  16. Kumar P, Javeed D, Kumar R, Islam AN (2024) Blockchain and explainable AI for enhanced decision making in cyber threat detection. Softw Pract Exp. https://doi.org/10.1002/spe.3319

    Article  Google Scholar 

  17. Sami H et al (2024) LearnChain: transparent and cooperative reinforcement learning on Blockchain. Futur Gener Comput Syst 150:255–271. https://doi.org/10.1016/j.future.2023.09.012

    Article  Google Scholar 

  18. Pujol FA, Mora H, Ramírez T, Rocamora C, Bedón A (2024) Blockchain-based framework for traffic event verification in smart vehicles. IEEE Access. https://doi.org/10.1109/ACCESS.2024.3352738

    Article  Google Scholar 

  19. Saranti PG, Chondrogianni D, Karatzas S (2019) Autonomous vehicles and blockchain technology are shaping the future of transportation. In Data Analytics: Paving the Way to Sustainable Urban Mobility: Proceedings of 4th Conference on Sustainable Urban Mobility (CSUM2018), 24–25 May, Skiathos Island, Greece (pp. 797–803). Springer International Publishing. https://doi.org/10.1007/978-3-030-02305-8_96

  20. Kumari P, Surya L (2021) Blockchain-autonomous driving systems. Opportunities and challenges for blockchain technology in autonomous vehicles. IGI Global 2021:87–114. https://doi.org/10.4018/978-1-7998-3295-9.ch006

    Article  Google Scholar 

  21. Kamble N, Gala R, Vijayaraghavan R, Shukla E, Patel D (2021) Using blockchain in autonomous vehicles. In Artificial Intelligence and Blockchain for Future Cybersecurity Applications (pp. 285–305). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-030-74575-2_15

  22. Taghavifar H, Wei C, Taghavifar L (2024) Socially intelligent reinforcement learning for optimal automated vehicle control in traffic scenarios. IEEE Trans Autom Sci Eng. https://doi.org/10.1109/TASE.2023.3347264

    Article  Google Scholar 

  23. Wang Y, Han Z, Xing Y, Xu S, Wang J (2024) A survey on datasets for the decision making of autonomous vehicles. IEEE Intell Transp Syst Mag. https://doi.org/10.1109/MITS.2023.3341952

    Article  Google Scholar 

  24. Zhang L, Yang C, Yan Y, Cai Z, Hu Y (2024) Automated guided vehicle dispatching and routing integration via digital twin with deep reinforcement learning. J Manuf Syst 72:492–503. https://doi.org/10.1016/j.jmsy.2023.12.008

    Article  Google Scholar 

  25. Fu Y, Li C, Yu FR, Luan TH, Zhang Y (2022) A selective federated reinforcement learning strategy for autonomous driving. IEEE Trans Intell Transp Syst 24(2):1655–1668. https://doi.org/10.1109/TITS.2022.3219644

    Article  Google Scholar 

  26. Elbir AM, Soner B, Çöleri S, Gündüz D, Bennis M (2022) Federated learning in vehicular networks. In 2022 IEEE International Mediterranean Conference on Communications and Networking (MeditCom) (pp. 72–77). IEEE. https://doi.org/10.1109/MeditCom55741.2022.9928621

  27. Fu Y, Li C, Yu FR, Luan TH, Zhang Y (2020) A decision-making strategy for vehicle autonomous braking in emergency via deep reinforcement learning. IEEE Trans Veh Technol 69(6):5876–5888. https://doi.org/10.1109/TVT.2020.2986005

    Article  Google Scholar 

  28. Liao J, Liu T, Tang X, Mu X, Huang B, Cao D (2020) Decision-making strategy on highway for autonomous vehicles using deep reinforcement learning. IEEE Access 8:177804–177814. https://doi.org/10.1109/ACCESS.2020.3022755

    Article  Google Scholar 

  29. Gupta R, Alam T (2024) Vehicular communication using federated learning empowered chimp optimization (FLECO) algorithm. Multimed Tools Appl. https://doi.org/10.1007/s11042-024-18137-8

    Article  Google Scholar 

  30. Chellapandi VP, Yuan L, Żak SH, Wang Z (2023) A survey of federated learning for connected and automated vehicles. In 2023 IEEE 26th International Conference on Intelligent Transportation Systems (ITSC) (pp. 2485–2492). IEEE. https://doi.org/10.1109/ITSC57777.2023.10421974

  31. Liang X, Liu Y, Chen T, Liu M, Yang Q (2022) Federated transfer reinforcement learning for autonomous driving. In Federated and Transfer Learning (pp. 357–371). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-031-11748-0_15

  32. Chellapandi VP, Yuan L, Brinton CG, Żak SH, Wang Z (2023) Federated learning for connected and automated vehicles: a survey of existing approaches and challenges. IEEE Trans Intell Veh. https://doi.org/10.1109/ITSC57777.2023.10421974

    Article  Google Scholar 

  33. Qi Y, Hossain MS, Nie J, Li X (2021) Privacy-preserving blockchain-based federated learning for traffic flow prediction. Futur Gener Comput Syst 117:328–337. https://doi.org/10.1016/j.future.2020.12.003

    Article  Google Scholar 

  34. Yang Z, Shi Y, Zhou Y, Wang Z, Yang K (2022) Trustworthy federated learning via blockchain. IEEE Int Things J 10(1):92–109. https://doi.org/10.1109/JIOT.2022.3201117

    Article  Google Scholar 

  35. Lu Y, Huang X, Zhang K, Maharjan S, Zhang Y (2020) Blockchain empowered asynchronous federated learning for secure data sharing in internet of vehicles. IEEE Trans Veh Technol 69(4):4298–4311. https://doi.org/10.1109/TVT.2020.2973651

    Article  Google Scholar 

  36. He Y, Huang K, Zhang G, Yu FR, Chen J, Li J (2021) Bift: a blockchain-based federated learning system for connected and autonomous vehicles. IEEE Internet Things J 9(14):12311–12322. https://doi.org/10.1109/JIOT.2021.3135342

    Article  Google Scholar 

  37. Gao H, Li Y, Long K, Yang M, Shen Y (2024) A survey for foundation models in autonomous driving. arXiv preprint arXiv:2402.01105.

  38. Zheng B, Gou B, Kil J, Sun H, Su Y (2024) Gpt-4v (ision) is a generalist web agent, if grounded. arXiv preprint arXiv:2401.01614.

  39. Alam T, Gupta R, Ullah A, Qamar S (2024) Blockchain-Enabled Federated Reinforcement Learning (B-FRL) model for privacy preservation service in IoT systems. Wirel Pers Commun 136(4):2545–2571. https://doi.org/10.1007/s11277-024-11411-w

    Article  Google Scholar 

  40. Alam T (2024) Data Privacy and Security in Autonomous Connected Vehicles in Smart City Environment. Big Data and Cogn Comput 8(9):95. https://doi.org/10.3390/bdcc8090095

    Article  Google Scholar 

  41. Xu C, Wu H, Liu H, Gu W, Li Y, Cao D (2022) Blockchain-oriented privacy protection of sensitive data in the internet of vehicles. IEEE Trans Intell Veh 8(2):1057–1067

    Article  Google Scholar 

  42. Sultana S, Hossain J, Billah M, Shajeeb HH, Rahman S, Ansari K, Hasan KF (2023) Blockchain-enabled federated learning approach for vehicular networks. arXiv preprint arXiv:2311.06372.

  43. Sierra-Garcia JE, Santos M (2024) Federated discrete reinforcement learning for automatic guided vehicle control. Futur Gener Comput Syst 150:78–89. https://doi.org/10.1016/j.future.2023.08.021

    Article  Google Scholar 

  44. Kamble N, Gala R, Vijayaraghavan R, Shukla E, Patel D (2021) Using blockchain in autonomous vehicles. Artificial intelligence and blockchain for future cybersecurity applications. Springer International Publishing, Cham, pp 285–305

    Chapter  Google Scholar 

  45. Manolache MA, Manolache S, Tapus N (2022) Decision making using the blockchain proof of authority consensus. Proced Comput Sci 199:580–588. https://doi.org/10.1016/j.procs.2022.01.071

    Article  Google Scholar 

  46. Zheng O, Abdel-Aty M, Wang D, Wang Z, Ding S (2023) ChatGPT is on the horizon: could a large language model be all we need for intelligent transportation?. arXiv preprint arXiv:2303.05382.

  47. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770–778). https://doi.org/10.1109/CVPR.2016.90

  48. Kim J, Lee J (2023) Can ChatGPT be useful for understanding transportation issues? An exploratory study. Explor Study. https://doi.org/10.2139/ssrn.4349774

    Article  Google Scholar 

  49. Sudirjo F, Diawati P, Riady Y, Ausat AMA, Suherlan S (2023) The role of ChatGPT in enhancing the information search and decision-making process of travellers. Jurnal Minfo Polgan 12(2):500–507. https://doi.org/10.33395/jmp.v12i1.12443

    Article  Google Scholar 

  50. Cunneen M, Mullins M, Murphy F, Gaines S (2019) Artificial driving intelligence and moral agency: examining the decision ontology of unavoidable road traffic accidents through the prism of the trolley dilemma. Appl Artif Intell 33(3):267–293

    Article  Google Scholar 

Download references

Funding

This research received no external funding.

Author information

Authors and Affiliations

  1. Department of Computer Science, Faculty of Computer and Information Systems, Islamic University of Madinah, P.O.Box. 170, 42351, Madinah, Saudi Arabia

    Tanweer Alam

  2. Department of Information Technology, Ajay Kumar Garg Engineering College, Ghaziabad, Abdul Kalam Technical University, Lucknow, India

    Ruchi Gupta

  3. School of Computer Science and Engineering, Presidency University, Bengaluru, Karnataka, India

    N. Nasurudeen Ahamed

  4. Department of Computer Science, Faculty of Computing and Artificial Intelligence, Air University, Islamabad, Pakistan

    Arif Ullah

Authors
  1. Tanweer Alam
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ruchi Gupta
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. N. Nasurudeen Ahamed
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Arif Ullah
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Conceptualisation, T.A.; methodology, R.G.; formal analysis, R.G.; investigation, A.U.; resources, A.U.; writing-original draft, T.A. and A.U.; review and editing, R.G. and N.A.; visualisation, T.A.; implementations, N. A.; results, N.A.

Corresponding author

Correspondence to Tanweer Alam.

Ethics declarations

Conflicts of interest

The authors declare no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Alam, T., Gupta, R., Ahamed, N.N. et al. A decision-making model for self-driving vehicles based on GPT-4V, federated reinforcement learning, and blockchain. Neural Comput & Applic 36, 21545–21560 (2024). https://doi.org/10.1007/s00521-024-10161-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-024-10161-x

Keywords

Search

Navigation

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy