Abstract
In this paper, we solve the problem of candidate access point selection in 802.11 networks, when there is more than one access point available to a station. We use the QBSS (quality of service enabled basic service set) Load Element of the new WLAN standard 802.11e as prior information and deploy a decision making algorithm based on reinforcement learning. We show that using reinforcement learning, wireless devices can reach more efficient decisions compared to static methods of decision making which opens the way to a more autonomic communication environment. We also present how the reinforcement learning algorithm reacts to changing situations enabling self adaptation.
Chapter PDF
Similar content being viewed by others
References
ITU-T Rec. P.85. A Method for Subjective Performance Assessment of the Quality of Speech Voice Output Devices (1994)
ITU-T Rec. G.107. The E-Model, a Computational Model for Use in Transmission Planning (2002)
Ansel, P., Ni, Q., Turletti, T.: An Efficient Scheduling Scheme for IEEE 802.11e. In: Proceedings of IEEE Workshop on Modelling and Optimization in Mobile, Ad Hoc and Wireless Networks (WiOpt) (March 2004)
Ansel, P., Ni, Q., Turletti, T.: FHCF: An Efficient Scheduling Scheme for IEEE 802.11e. ACM/Kluwer Journal on Mobile Networks and Applications (MONET) (August 2005) (Special Issue on Modelling and Optimization in Wireless and Mobile Networks)
Asada, M., Uchibe, E., Noda, S., Tawaratsumida, S., Hosoda, K.: A Vision Based Reinforcement Learning for Coordination of Soccer Playing Behaviours. In: Proceedings of AAAI 1994 Workshop on AI and A-life and Entertainment (1994)
Baxter, J., Tridgell, A., Weaver, L.: KnightCap: A Chess Program that Learns by Combining TD(lambda) with Game-tree Search. In: Proceedings of the Fifteenth International Conference on Machine Learning (1998)
Fiberlink. General Market Statistics, http://www.fiberlink.com/release/en-US/Home/KnowledgeBase/Resources/Stats/
IEEE. 802.11E-2005 IEEE Standard for Information technology -Telecommunications and information exchange between systems - Local and metropolitan area networks - Specific requirements Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) specifications: Amendment 8: Medium Access Control (MAC) Quality of Service Enhancements (November 2005)
Koza, J.R.: The genetic programming paradigm: Genetically breeding populations of computer programs to solve problems. In: Soucek, B., IRIS Group,(eds.) Dynamic, Genetic, and Chaotic Programming, pp. 203–321. John Wiley, New York (1992)
Kozamernik, F.: Media Streaming Over the Internet an Overview of Delivery Technologies. Technical report, EBU (October 2002)
MacKay, D.: Cambridge University Press, Cambridge (2003)
Na, C.: IEEE 802.11 Wireless LAN Traffic Analysis: A Cross-layer Approach. PhD thesis, The University of Texas at Austin (May 2005)
Simsek, B., Albayrak, S., Korth, A.: Reinforcement Learning for Procurement Agents of the Factory of the Future. IEEE Congress on Evolutionary Computation Proceedings (2004)
Simsek, B., Wolter, K., Coskun, H.: Analysis of the QBSS Load Element Parameters of 802.11e for a priori Estimation of Service Quality. International Journal of Simulation: Systems, Science and Technology (Special Issue: Performance Engineering of Computer and Communication Systems) (2006)
Wiegand, R.: An Analysis of Cooperative Coevolutionary Algorithms. PhD thesis, University North Carolina Charlotte (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Simsek, B., Wolter, K., Coskun, H. (2006). Dynamic Decision Making for Candidate Access Point Selection. In: Gaïti, D., et al. Autonomic Networking. AN 2006. Lecture Notes in Computer Science, vol 4195. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11880905_5
Download citation
DOI: https://doi.org/10.1007/11880905_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-45891-3
Online ISBN: 978-3-540-45893-7
eBook Packages: Computer ScienceComputer Science (R0)