Skip to main content

Advertisement

Log in

Football training evaluation using machine learning and decision support system

  • Focus
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

With the rapid development in information and communication technologies, the relationship among the disciplines in various fields has become closer, resulting in many new technologies based on interdisciplinary research. This article considers robot soccer training as a research topic by involving related fields, i.e., interdisciplinary research. Compared with the physical robot, its simulation has the advantages of less cost, shorter experimental period, and is beneficial to the real-life studies in this context. This article discusses the practical application and optimization techniques used for robot soccer matches and training evaluation. The main tasks are as follows. First, we analyze and build a simulation platform for robot soccer matches. The basic principles of this platform are learning, and designing a novel optimized SARSA algorithm, built using the state-of-the-art state–action–reward–state–action (SARSA) algorithm. The optimized SARSA is a reinforcement learning algorithm that uses Q-value for making critical decisions about various parameters involved in the football training. Second, this paper simulates and analyzes the proposed optimized SARSA algorithm in a single-entity environment of robot football training. We compare the two algorithms before and after the improvement in a multi-entity environment. Among the simulation results, it is found that the optimized SARSA has a more powerful performance. The simulation results prove that the robot football training evaluation based on machine learning (optimized SARSA) can better formulate the robot football training strategy after applying the reinforcement learning strategy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data Availability

The data used to support the finding are cited within the article.

References

  • Carvalho A, Oliveira R (2011) Reinforcement learning for the soccer dribbling task. In: Proc of 2011 IEEE Conf on Computational Intelligence and Games. Seoul, IEEE Society, pp 95–101

  • Dewey D, Russell S et al (2015) Research priorities for robust and beneficial artificial intelligence. Ai Mag Artif Intell 47(2):221–234

    Google Scholar 

  • Dimeas AL, Hatziargyriou ND (2005) Operation of a multiagent system for microgrid control. IEEE Trans Power Syst 20(3):1447–1455

    Article  Google Scholar 

  • Elliott C (1992) The affective reasoner: a process model of emotions in a multi-agent system. Phd Thesis Northwestern University

  • Iima H, Kuroe Y (2008) Swarm reinforcement learning algorithms based on Sarsa method. In: Proc of the SICE Annual Conference. Tokyo, IEEE Society, pp 20–22

  • Jin YY, Jiang C, Zeng QS (2002) An application in RoboCup combining Q-learning with adversarial planning. In: Proc of the 4th World Congress on Intelligent Control and Automation. Berlin, IEEE Society. pp 496–500

  • Le QB, Park SJ, Vlek P et al (2008) Land-Use Dynamic Simulator (LUDAS): a multi-agent system model for simulating spatio-temporal dynamics of coupled human–landscape system I. Structure and theoretical specification. Ecol Inf 3(2):135–153

    Article  Google Scholar 

  • Lu Z, Li Y (1999) Interactive support vector machine learning algorithm and its application. J Tsinghua Univ 01995:334–355

    Google Scholar 

  • Luo JT (2008) Research on decision-making system in MiroSot robot soccer. Central China Normal University, Wuhan, pp 1–6

    Google Scholar 

  • Marjanovi M, KovaEvi M, Ba Jat B et al (2011) Landslide susceptibility assessment using SVM machine learning algorithm. Eng Geol 123(3):225–234

    Article  Google Scholar 

  • Stone P (1998) Layered learning in multi-agent systems. School of Computer Science Carnegie Mellon University, Pittsburgh, PA, pp 15213–23891

    Google Scholar 

  • Stone P, Richard S, Sutton GK (2005) Reinforcement learning for Robocup Soccer keepaway. Int Soc Adapt Beh 13(3):165–188

    Article  Google Scholar 

  • Vidyasagar M (2015) Statistical learning theory and randomized algorithms for control. Control Syst IEEE 18(6):69–85

    Google Scholar 

  • Wiley EO, Mcnyset K, Peterson T et al (2003) Niche modeling and geographic range predictions in the marine environment using a machine-learning algorithm. Oceanography 16(3):120–127

    Article  Google Scholar 

  • Xu XH (2004) Discussion on the military significance of robot football. Robot Technol Appl 10(2):8–9

    Google Scholar 

  • Yun PC, Chen J, Yao JY et al (2002) Global planning from local eyeshot: an implementation of observation-based plan corrdination in Robocup simulation games. Robot soccer world cup V. Springer Verlag, Berlin, pp 230–255

    Google Scholar 

  • Zhang J (2005) Design and research of soccer robot car controller based on embedded system. Central South University, Changsha, pp 10–17

    Google Scholar 

  • Zhang JW, Hang GS, Zhang W (2005) Application of Q-learning algorithm in dribbling ball training of Robo cup. Syst Simul Technol 1(2):84–87

    Google Scholar 

  • Zhao KQ (2007) The application of SPA-based identical-discrepancycontrary system theory in artificial intelligence research. ACM Transact Intell Syst 87(11):11–30

    Google Scholar 

  • Zheng H, Zhou X, Duyan BI (2003) Introduction statistical learning theory and support vector machines. Mod Electr Tech 112(4):5895–5960

    Google Scholar 

Download references

Funding

The paper did not receive any financial support.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xin He.

Ethics declarations

Conflict of interest

The authors declared that they have no conflicts of interest to this work.

Ethical approval

This paper does not deal with any ethical problems.

Informed consent

We declare that all authors have informed consent.

Additional information

Communicated by Tiancheng Yang.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xu, Q., He, X. Football training evaluation using machine learning and decision support system. Soft Comput 26, 10939–10946 (2022). https://doi.org/10.1007/s00500-022-07210-9

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-022-07210-9

Keywords

Navigation

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy