MC4 Adaptive language grounding in robots: processing, learning and evolution

Description

Natural language interaction between humans and robots (or more broadly autonomous intelligent systems such as self-driving cars) remains one of the biggest challenges of AI, mainly because it requires integration of sophisticated components for vision and motor control, speech, parsing and production of language, interaction through dialog, and grounded semantics. All these components should ideally acquire content through machine learning and have to remain adaptive to changing contexts, goals and interlocutors. This course focuses on how to achieve adaptive grounded Natural language processing.

The course examines representational languages for interaction scripts, semantics and grammar of Natural language that enable robots to interact with humans and one another, but also learn and adapt language to their own needs. In particular, we examine Machine Learning algorithms for Natural language, grounded procedural semantics and grammar induction.

To illustrate the main points at a technical level, the course uses case studies in a number of different domains, in particular, reference to objects based on their properties, producing and understanding action commands, and spatial and temporal description of situations.

The main part of this course will be lectures. However, interested participants will receive ample pointers to software (source code) and exercises accompanying the lectures. We will also bring a robot head to experiment with.

Objectives

To understand the state of the art of language processing and language learning on robots – i.e, physical systems interacting with the real world.

Methodological : to be able to model Natural language processing and learning; implement systems capable of interacting with humans and other robots using Natural language in the real world.

Literature


Spranger, M. and Beuls, K. (2016). Referential uncertainty and word learning in high-dimensional, continuous meaning spaces. In Development and Learning and Epigenetic Robotics (ICDL-Epirob), 2016 Joint IEEE International Conferences on, 2016. IEEE. https://arxiv.org/abs/1609.09580
Spranger, M. (2015). Procedural semantics for autonomous robots - a case study in locative spatial language. In Intelligent Robots and Systems (IROS), 2015 IEEE/RSJ International Conference on. IEEE. http://ieeexplore.ieee.org/document/7353972/?reload=true
Spranger, M. (2013). Evolving grounded spatial language strategies. KI - Künstliche Intelligenz, 27(2):97–106. http://link.springer.com/article/10.1007/s13218-013-0245-4
Spranger, M., Pauw, S., Loetzsch, M., and Steels, L. (2012). Open-ended Procedural Semantics. In Steels, L. and Hild, M., editors, Language Grounding in Robots, pages 153–172. Springer. https://www.csl.sony.fr/downloads/papers/2012/spranger-12g.pdf

Course location

Lecture Room 3

Course requirements

none

Instructor information.

Instructor

Michael Spranger

Website

http://www.michael-spranger.com