Dergi makalesi Açık Erişim

The learning of adjectives and nouns from affordance and appearance features

   Yuerueten, Onur; Sahin, Erol; Kalkan, Sinan

We study how a robot can link concepts represented by adjectives and nouns in language with its own sensorimotor interactions. Specifically, an iCub humanoid robot interacts with a group of objects using a repertoire of manipulation behaviors. The objects are labeled using a set of adjectives and nouns. The effects induced on the objects are labeled as affordances, and classifiers are learned to predict the affordances from the appearance of an object. We evaluate three different models for learning adjectives and nouns using features obtained from the appearance and affordances of an object, through cross-validated training as well as through testing on novel objects. The results indicate that shape-related adjectives are best learned using features related to affordances, whereas nouns are best learned using appearance features. Analysis of the feature relevancy shows that affordance features are more relevant for adjectives, and appearance features are more relevant for nouns. We show that adjective predictions can be used to solve the odd-one-out task on a number of examples. Finally, we link our results with studies from psychology, neuroscience and linguistics that point to the differences between the development and representation of adjectives and nouns in humans.

Dosyalar (158 Bytes)
Dosya adı Boyutu
bib-b240eebf-6e00-4477-88d9-a35a8de693ed.txt
md5:baf96aa34296ed9b63583aace04f5a95
158 Bytes İndir
12
5
görüntülenme
indirilme
Görüntülenme 12
İndirme 5
Veri hacmi 790 Bytes
Tekil görüntülenme 12
Tekil indirme 5

Alıntı yap