Skip to main content

Advertisement

Springer Nature Link
Log in

A biologically constrained architecture for developmental learning of eye–head gaze control on a humanoid robot

  • Published:
Autonomous Robots Aims and scope Submit manuscript

Abstract

In this paper we describe a biologically constrained architecture for developmental learning of eye–head gaze control on an iCub robot. In contrast to other computational implementations, the developmental approach aims to acquire sensorimotor competence through growth processes modelled on data and theory from infant psychology. Constraints help shape learning in infancy by limiting the complexity of interactions between the body and environment, and we use this idea to produce efficient, effective learning in autonomous robots. Our architecture is based on current thinking surrounding the gaze mechanism, and experimentally derived models of stereotypical eye–head gaze contributions. It is built using our proven constraint-based field-mapping approach. We identify stages in the development of infant gaze control, and propose a framework of artificial constraints to shape learning on the robot in a similar manner. We demonstrate the impact these constraints have on learning, and the resulting ability of the robot to make controlled gaze shifts.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Notes

  1. The search radius for a neighbouring link is 1.5 times the radius of the activated field.

References

  • Aslin, R. N. (1987). Visual and auditory development in infancy. In J. D. Osofsky (Ed.), Handbook of infancy (2nd ed.). New York: Wiley.

  • Barnes, G. R. (1979). Vestibulo-ocular function during co-ordinated head and eye movements to acquire visual targets. The Journal of Physiology, 287(1), 127–147.

    Google Scholar 

  • Berthouze, L., & Kuniyoshi, Y. (1998). Emergence and categorization of coordinated visual behavior through embodied interaction. Machine Learning, 31, 187–200.

    Article  Google Scholar 

  • Birnholz, J. (1981). The development of human fetal eye movement patterns. Science, 213(4508), 679–681.

    Article  Google Scholar 

  • Bizzi, E., Kalil, R. E., & Tagliasco, V. (1971). Eye–head coordination in monkeys: Evidence for centrally patterned organization. Science, 173(3995), 452–454.

    Article  Google Scholar 

  • Butterworth, G., & Harris, M. (1994). Principles of developmental psychology. Hove: Lawrence Erlbaum Associates.

    Google Scholar 

  • Caligiore, D., Ferrauto, T., Parsi, D., Accornero, N., Capozza, M., & Baldassare, G. (2008). Using motor babbling and hebb rules for modeling the development of reaching with obstacles and grasping. In Proceedings of the International Conference on Cognitive Systems.

  • Chao, F., Lee, M., & Lee, J. (2010). A developmental algorithm for ocular–motor coordination. Robotics and Autonomous Systems, 58, 239–248.

    Article  Google Scholar 

  • Der, R., & Martius, G. (2006). From motor babbling to purposive actions: emerging self-exploration in a dynamical systems approach to early robot development. In Proceedings of the 9th international conference on Simulation of Adaptive Behavior, SAB’06 (pp. 406–421). Berlin, Heidelberg: Springer-Verlag.

  • De Vries, J. I. P., Visser, G. H. A., & Prechtl, H. F. R. (1984). Fetal motility in the first half of pregnancy. In H. F. R. Prechtl (Ed.), Continuity of neural function from prenatal to postnatal life (pp. 46–64). London: Spastics International Medical Publications.

    Google Scholar 

  • Fiorentino, M. R. (1981). A basis for sensorimotor development, normal and abnormal: The influence of primitive postural reflexes on the development and distribution of tone. Springfield, IL: Charles C Thomas.

    Google Scholar 

  • Freedman, E. (2008). Coordination of the eyes and head during visual orienting. Experimental Brain Research, 190(4), 369–387.

    Article  Google Scholar 

  • Freedman, E. G. (2001). Interactions between eye and head control signals can account for movement kinematics. Biological Cybernetics, 84, 453–462.

    Article  Google Scholar 

  • Freedman, E. G., & Sparks, D. L. (2000). Coordination of the eyes and head: Movement kinematics. Experimental Brain Research, 131, 22–32.

    Article  Google Scholar 

  • Freedman, E. G., Stanford, T. R., & Sparks, D. L. (1996). Combined eye–head gaze shifts produced by electrical stimulation of the superior colliculus in rhesus monkeys. Journal of Neurophysiology, 76(2), 927–952.

    Google Scholar 

  • Gandhi, N. J., & Katnani, H. A. (2011). Motor functions of the superior colliculus. Annual Review of Neuroscience, 34(1), 205–231.

    Article  Google Scholar 

  • Girard, B., & Berthoz, A. (2005). From brainstem to cortex: Computational models of saccade generation circuitry. Progress in Neurobiology, 77(4), 215–251.

    Article  Google Scholar 

  • Goodkin, F. (1980). The development of mature patterns of head–eye coordination in the human infant. Early Human Development, 4, 373–386.

    Article  Google Scholar 

  • Goossens, H. H. L. M., & van Opstal, A. J. (1997). Human eye–head coordination in two dimensions under different sensorimotor conditions. Experimental Brain Research, 114, 542–560.

    Article  Google Scholar 

  • Griffiths, R. (1954). The abilities of babies. London: University of London Press.

    Google Scholar 

  • Guitton, D., & Volle, M. (1987). Gaze control in humans: Eye–head coordination during orienting movements to targets within and beyond the oculomotor range. Journal of Neurophysiology, 58(3), 427–459.

    Google Scholar 

  • Harris, C. M., Jacobs, M., Shawkat, F., & Taylor, D. (1993). The development of saccadic accuracy in the first seven months. Clinical Vision Sciences, 8(1), 85–96.

    Google Scholar 

  • Hollands, M., Ziavra, N., & Bronstein, A. (2004). A new paradigm to investigate the roles of head and eye movements in the coordination of whole-body movements. Experimental Brain Research, 154, 261–266.

    Article  Google Scholar 

  • Hotz, P. E., Gómez, G., & Pfeifer, R. (2003). Evolving the morphology of a neural network for controlling a foveating retina–and its test on a real robot. In Proceedings of the Eighth International Conference on Artificial Life, ICAL 2003 (pp. 243–251). Cambridge, MA: MIT Press.

  • Klier, E., Wang, H., & Crawford, J. (2001). The superior colliculus encodes gaze commands in retinal coordinates. Nature Neuroscience, 4(6), 627–632.

    Article  Google Scholar 

  • Laurutis, V. P., & Robinson, D. A. (1986). The vestibulo-ocular reflex during human saccadic eye movements. The Journal of Physiology, 373(1), 209–233.

    Google Scholar 

  • Law, J., Lee, M., & Huelse, M. (2010). Infant development sequences for shaping sensorimotor learning in humanoid robots. In Proceedings of 10th International Conference on Epigenetic, Robotics (pp. 65–72).

  • Law, J., Lee, M., Hülse, M., & Tomassetti, A. (2011). The infant development timeline and its application to robot shaping. Adaptive Behaviour, 19, 335–358.

    Article  Google Scholar 

  • Lee, M. (2011). Intrinsic activity: From motor babbling to play. In Proceedings of Joint International Conference on Development and Learning (ICDL), and Epigenetic Robotics (EpiRob). Frankfurt am Main: IEEE.

  • Lee, M., Meng, Q., & Chao, F. (2007). Staged competence learning in developmental robotics. Adaptive Behaviour, 15(3), 241–255.

    Article  Google Scholar 

  • Lefevre, P., Bottemanne, I., & Roucoux, A. (1992). Experimental-study and modeling of vestibulo-ocular reflex modulation during large shifts of gaze in humans. Experimental Brain Research, 91(3), 496–508.

    Google Scholar 

  • Lopes, M., Bernardino, A., Santos-Victor, J., Rosander, K., & von Hofsten, C. (2009). Biomimetic eye–neck coordination. In IEEE 8th International Conference on Development and Learning (pp. 1–8). Shanghai: IEEE.

  • MacNeilage, P. F., Davis, B. L., & Matyear, C. L. (1997). Babbling and first words: Phonetic similarities and differences. Speech Communication, 22(23), 269–277.

    Article  Google Scholar 

  • Maini, E. S., Manfredi, L., Laschi, C., & Dario, P. (2008). Bioinspired velocity control of fast gaze shifts on a robotic anthropomorphic head. Autonomous Robots, 25, 37–58.

    Article  Google Scholar 

  • Marino, R. A., Rodgers, C. K., Levy, R., & Munoz, D. P. (2008). Spatial relationships of visuomotor transformations in the superior colliculus map. Journal of Neurophysiology, 100(5), 2564–2576.

    Article  Google Scholar 

  • McCluskey, M. K., & Cullen, K. E. (2007). Eye, head, and body coordination during large gaze shifts in rhesus monkeys: Movement kinematics and the influence of posture. Journal of Neurophysiology, 97(4), 2976–2991.

    Article  Google Scholar 

  • Metta, G., Sandini, G., Vernon, D., Natale, L., & Nori, F. (2008). The icub humanoid robot: An open platform for research in embodied cognition. In Proceedings of the 8th Workshop on Performance Metrics for Intelligent Systems (pp. 50–56). Washington DC: ACM.

  • Milighetti, G., Vallone, L., & De Luca, A. (2011). Adaptive predictive gaze control of a redundant humanoid robot head. In 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (pp. 3192–3198). San Francisco: IEEE.

  • Mohammad, Y., Okada, S., & Nishida, T. (2010). Autonomous development of gaze control for natural human-robot interaction. In Proceedings of the 2010 workshop on eye gaze in intelligent human machine interaction, EGIHMI ’10 (pp. 63–70). New York: ACM.

  • Muir, D., & Field, J. (1979). Newborn infants orient to sounds. Child Development, 50, 431–436.

    Article  Google Scholar 

  • Needham, A., Barrett, T., & Peterman, K. (2002). A pick-me-up for infants’ exploratory skills: Early simulated experiences reaching for objects using ‘sticky mittens’ enhances young infants’ object exploration skills. Infant Behavior and Development, 25(3), 279–295.

    Article  Google Scholar 

  • Proudlock, F. A., & Gottlob, I. (2007). Physiology and pathology of eye–head coordination. Progress in Retinal and Eye Research, 26(5), 486–515.

    Article  Google Scholar 

  • Rajruangrabin, J., & Popa, D. (2011). Robot head motion control with an emphasis on realism of neck–eye coordination during object tracking. Journal of Intelligent & Robotic Systems, 63, 163–190.

    Article  Google Scholar 

  • Rosenblith, J. F. (1992). In the beginning: Development from conception to age two (2nd ed.). Newbury Park, CA: Sage Publications.

  • Saegusa, R., Metta, G., Sandini, G., & Sakka, S. (2009). Active motor babbling for sensorimotor learning. In IEEE International Conference on Robotics and Biomimetics, 2008 (pp. 794–799). Bangkok: IEEE.

  • Schenck, W., & Möller, R. (2004). Staged learning of saccadic eye movements with a robot camera head. In H. Bowman (Ed.), Connectionist models of cognition and perception II, volume 15 of progress in neural processing (pp. 82–91). World Scientific: River Edge, NJ; London.

  • Scudder, C., Kaneko, C., & Fuchs, A. (2002). The brainstem burst generator for saccadic eye movements: A modern synthesis. Experimental Brain Research, 142, 439–462.

    Article  Google Scholar 

  • Sheridan, M. D. (1973). From birth to five years. Windsor, CT: NFER Publishing.

    Book  Google Scholar 

  • Shibata, T., Vijayakumar, S., Conradt, J., & Schaal, S. (2001). Biomimetic oculomotor control. Adaptive Behavior, 9(3–4), 189–207.

    Article  Google Scholar 

  • Sparks, D. (2004). Commands for coordinated eye and head movements in the primate superior colliculus. In W. Hall & A. Moschovakis (Eds.), The oculomotor system: New approaches for studying sensorimotor integration (pp. 303–318). Boca Raton, FL: CRC Press.

  • Srinivasa, N., & Grossberg, S. (2008). A head–neck–eye system that learns fault-tolerant saccades to 3-D targets using a self-organizing neural model. Neural Networks, 21(9), 1380–1391.

    Article  Google Scholar 

  • Thelen, E. (1979). Rhythmical stereotypies in normal human infants. Animal Behaviour, 27(3), 699–715.

    Google Scholar 

  • van Opstal, A., & Goossens, H. (2008). Linear ensemble-coding in midbrain superior colliculus specifies the saccade kinematics. Biological Cybernetics, 98, 561–577.

    Article  MATH  Google Scholar 

  • Wang, X., & Jin, J. (2001). A quantitive analysis for decomposing visual signal of the gaze displacement. In D. D. Feng, J. Jin, P. Eades & H. Yan (Eds.), Proceedings of the Pan-Sydney area workshop on visual information processing (Vol. 11, pp. 153–159). Australian Computer Society, Inc.: Darlinghurst.

Download references

Acknowledgments

This research has received funds from the European Community 7th Framework Programme (FP7/2007-2013), “Challenge 2 - Cognitive Systems, Interaction, Robotics”, grant agreement No. ICT-IP-231722, project “IM-CLeVeR - Intrinsically Motivated Cumulative Learning Versatile Robots”.

Author information

Authors and Affiliations

  1. Department of Computer Science, Aberystwyth University, Aberystwyth, Wales, UK

    James Law, Patricia Shaw & Mark Lee

Authors
  1. James Law
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Patricia Shaw
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mark Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to James Law.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Law, J., Shaw, P. & Lee, M. A biologically constrained architecture for developmental learning of eye–head gaze control on a humanoid robot. Auton Robot 35, 77–92 (2013). https://doi.org/10.1007/s10514-013-9335-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10514-013-9335-2

Keywords

Search

Navigation

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy