The third neural network was relatively simple and processed language with the help of vectorized representations of those “Red Red Right” sentences. Finally, the fourth Neural worked just like an associative layer and predicted the output of the previous three at each time step. “If we take an action, we don't always have to articulate it, but we have this performance in our mind at some point,” says Vijayaraghavan. The AI that he and his team built was intended to do exactly: seamless language, proprioception, action planning and vision.
When the robot -like brain was active, they started to learn some of the possible combinations of commands and sequences of movements. But they didn't all learn it.
The birth of composition
In 2016, Brenden Lake, a professor in psychology and data science, published a paper in which his team has to control a series of competencies machines to really learn and think as people. One of them was composition: the ability to put together a whole or to dissect in parts that can be reused. This reuse allows them to generalize the acquired knowledge to new tasks and situations. “The composition phase is when children learn to combine words to explain things. She [initially] Learn the names of objects, the names of actions, but those are just a few words. When they learn this composition concept, their ability explodes to explode a kind of exploding, “explains Vijayaraghavan.
The AI that built his team was made for this exact goal: see if the composition would develop. And it did.
As soon as the robot learned how certain assignments and actions were connected, it also learned to generalize that knowledge to carry out commands that it has never heard before. Recognizing the names of actions that it had not carried out and then performing on combinations of blocks that it had never seen before. Vijayaraghavan's AI came up with the concept to move something to the right or left or to place an item on something. It can also combine words to mention unseen actions, such as a blue block in a red places.
