Abstract
With the rapid development in information and communication technologies, the relationship among the disciplines in various fields has become closer, resulting in many new technologies based on interdisciplinary research. This article considers robot soccer training as a research topic by involving related fields, i.e., interdisciplinary research. Compared with the physical robot, its simulation has the advantages of less cost, shorter experimental period, and is beneficial to the real-life studies in this context. This article discusses the practical application and optimization techniques used for robot soccer matches and training evaluation. The main tasks are as follows. First, we analyze and build a simulation platform for robot soccer matches. The basic principles of this platform are learning, and designing a novel optimized SARSA algorithm, built using the state-of-the-art state–action–reward–state–action (SARSA) algorithm. The optimized SARSA is a reinforcement learning algorithm that uses Q-value for making critical decisions about various parameters involved in the football training. Second, this paper simulates and analyzes the proposed optimized SARSA algorithm in a single-entity environment of robot football training. We compare the two algorithms before and after the improvement in a multi-entity environment. Among the simulation results, it is found that the optimized SARSA has a more powerful performance. The simulation results prove that the robot football training evaluation based on machine learning (optimized SARSA) can better formulate the robot football training strategy after applying the reinforcement learning strategy.








Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data Availability
The data used to support the finding are cited within the article.
References
Carvalho A, Oliveira R (2011) Reinforcement learning for the soccer dribbling task. In: Proc of 2011 IEEE Conf on Computational Intelligence and Games. Seoul, IEEE Society, pp 95–101
Dewey D, Russell S et al (2015) Research priorities for robust and beneficial artificial intelligence. Ai Mag Artif Intell 47(2):221–234
Dimeas AL, Hatziargyriou ND (2005) Operation of a multiagent system for microgrid control. IEEE Trans Power Syst 20(3):1447–1455
Elliott C (1992) The affective reasoner: a process model of emotions in a multi-agent system. Phd Thesis Northwestern University
Iima H, Kuroe Y (2008) Swarm reinforcement learning algorithms based on Sarsa method. In: Proc of the SICE Annual Conference. Tokyo, IEEE Society, pp 20–22
Jin YY, Jiang C, Zeng QS (2002) An application in RoboCup combining Q-learning with adversarial planning. In: Proc of the 4th World Congress on Intelligent Control and Automation. Berlin, IEEE Society. pp 496–500
Le QB, Park SJ, Vlek P et al (2008) Land-Use Dynamic Simulator (LUDAS): a multi-agent system model for simulating spatio-temporal dynamics of coupled human–landscape system I. Structure and theoretical specification. Ecol Inf 3(2):135–153
Lu Z, Li Y (1999) Interactive support vector machine learning algorithm and its application. J Tsinghua Univ 01995:334–355
Luo JT (2008) Research on decision-making system in MiroSot robot soccer. Central China Normal University, Wuhan, pp 1–6
Marjanovi M, KovaEvi M, Ba Jat B et al (2011) Landslide susceptibility assessment using SVM machine learning algorithm. Eng Geol 123(3):225–234
Stone P (1998) Layered learning in multi-agent systems. School of Computer Science Carnegie Mellon University, Pittsburgh, PA, pp 15213–23891
Stone P, Richard S, Sutton GK (2005) Reinforcement learning for Robocup Soccer keepaway. Int Soc Adapt Beh 13(3):165–188
Vidyasagar M (2015) Statistical learning theory and randomized algorithms for control. Control Syst IEEE 18(6):69–85
Wiley EO, Mcnyset K, Peterson T et al (2003) Niche modeling and geographic range predictions in the marine environment using a machine-learning algorithm. Oceanography 16(3):120–127
Xu XH (2004) Discussion on the military significance of robot football. Robot Technol Appl 10(2):8–9
Yun PC, Chen J, Yao JY et al (2002) Global planning from local eyeshot: an implementation of observation-based plan corrdination in Robocup simulation games. Robot soccer world cup V. Springer Verlag, Berlin, pp 230–255
Zhang J (2005) Design and research of soccer robot car controller based on embedded system. Central South University, Changsha, pp 10–17
Zhang JW, Hang GS, Zhang W (2005) Application of Q-learning algorithm in dribbling ball training of Robo cup. Syst Simul Technol 1(2):84–87
Zhao KQ (2007) The application of SPA-based identical-discrepancycontrary system theory in artificial intelligence research. ACM Transact Intell Syst 87(11):11–30
Zheng H, Zhou X, Duyan BI (2003) Introduction statistical learning theory and support vector machines. Mod Electr Tech 112(4):5895–5960
Funding
The paper did not receive any financial support.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declared that they have no conflicts of interest to this work.
Ethical approval
This paper does not deal with any ethical problems.
Informed consent
We declare that all authors have informed consent.
Additional information
Communicated by Tiancheng Yang.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Xu, Q., He, X. Football training evaluation using machine learning and decision support system. Soft Comput 26, 10939–10946 (2022). https://doi.org/10.1007/s00500-022-07210-9
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-022-07210-9