PhD students

Part 2: In his follow-up lecture, Michael Beetz gives a short recap of his first talk before further exploring knowledge representation and reasoning for robotic agents. He focuses on one of the main problems of human-scale manipulation tasks for robotic systems, action description, when it comes to the performance of abstract tasks like "pour the water out". From "grasp the pot by the handles" to "tilt the pot around the axis between the handles" to "hold the lid while pouring", every action includes multiple intermediate tasks that have to be described in detail for the robot.

Part 3: In his third and final lecture, David Vernon discusses recent developments in cognition research. He addresses the common model of cognition that emcompasses approaches in Artificial Intelligence, Cognitive Science, Neuroscience, and Robotics. It is mainly based on the book "Unified theories of cognition" by Allen Newell, a leading investigator in computer science and cognitive psychology. Newell states that cognition takes place over multiple timescales (from millisecond-level to year-level and everything in between).

Probabilistic robotics is a relatively new area of robotics and concerned with robot perception and robot manipulation in the face of uncertainty and incomplete knowledge about the world. In his thorough and concise talk, Daniel Nyga introduces the basics of probability theory. He further shows probabilistic graphical models, including Bayesian networks and Markov Random Fields, explores statistical relational learning using Markov logic networks, and concludes with probabilistic natural language understanding.

In their lecture, Jürgen Sturm and Christoph Schütte from Google Germany talk about the Google’s Cloud Robotics project before diving deeper into specific robot perception problems. Christoph Schütte introduces Cartographer, a system that provides real-time simultaneous localization and mapping, also called SLAM, in 2D and 3D across multiple platforms. Jürgen Sturm closes the lecture with semantic mapping and spatial intelligence in artificial intelligence.

Part 2: In his follow-up lecture, David Vernon dives deeper into the role of memory, especially in a system. Memory, as he states, is a process rather than a state. He presents different types of memory, explores the role of memory, explains the concept of self-projection, prospection, and internal simulation, and clarifies technical terminology from cognitive science and psychology as well as from robotic literature. He concludes with internal simulation combined with action, and with the concept of forgetting which is important but still not fully understood in neuroscience.

Part 1: In his first of three talks, David Vernon gives a concise and coherent overview of cognitive architecture. He begins by explaining the concept of cognition as an umbrella term that encompasses perception, learning, anticipation, action, and adaptation. Cognition allows robots to work independently in challenging environments, to adapt to changes, and to anticipate events in preparing their actions. If cognition was the top of a mountain and the goal to be achieved, architecture would be the base camp that needs to be set up first.

Part 1: In the opening talk of the first EASE Fall School, Michael Beetz discusses the wide range of topics around cognition-enabled robotics. He explains the challenges and complexity of building and programming a robot that reaches the same level of efficiency in performing everyday tasks than humans do. Listen to his thorough introduction on knowledge representation and reasoning, and logic-based knowledge representation and reasoning in particular, on manipulation intellligence, and on the research approach of the Collaborative Research Center EASE.

This course is published by David Vernon in 2020. The course "covers both the essentials of classical robotics (mobile robots, robot arms for manipulation, and robot vision) and the principles of cognition (cognitive architectures, learning and development, prospection, memory, knowledge representation, internal simulation, and meta-cognition).