Abstract: What is perception? The most intuitive and influential answer has long been the one given by David Marr: to see the world is “to know what is where by looking” — to transform light into representations of objects and their features, located somewhere in space. But is this all that perception delivers? Consider the figure below: Certainly, you see some colored shapes, as well as where they are. Yet, beyond this, you can also see how they relate to one another: the green piece can fit into the others, and even create a new object with a shape of its own.
In this talk, I present evidence that perception extracts relations between objects in much the same way as it processes the objects themselves, and that these relations are abstract, structured, and surprisingly sophisticated. We’ll explore — and experience — the perception of several sophisticated relations between objects, including combining, holding, covering, fastening, and collapsing — as well as relational “illusions” in which objects seem to interact with mysteriously invisible entities. In other words, this work suggests that we see not only “what” and “where”, but also “how”.