Sárkány András and Olasz Mike and Csákvári Máté: Combining common sense rules and machine learning to understand object manipulation. In: Acta cybernetica, (24) 1. pp. 157-172. (2019)
Preview |
Cikk, tanulmány, mű
actacyb_24_1_2019_157_172.pdf Download (746kB) | Preview |
Abstract
Automatic situation understanding in videos has improved remarkably in recent years. However, state-of-the-art image processing methods still have considerable shortcomings: they usually require training data for each object class present and may have high false positive or false negative rates, making them impractical for general applications. We study a case that has a limited goal in a narrow context and argue about the complexity of the general problem. We suggest to solve this problem by including common sense rules and by exploiting various state-of-the art deep neural networks (DNNs) as the detectors of the conditions of those rules. We want to deal with the manipulation of unknown objects at a remote table. We have two action types to be detected: ‘picking up an object from the table’ and ‘putting an object onto the table’ and due to remote monitoring, we consider monocular observation. We quantitatively evaluate the performance of the system on manually annotated video segments, present precision and recall scores. We also discuss issues on machine reasoning. We conclude that the proposed neural-symbolic approach a) diminishes the required size of training data and b) enables new applications where labeled data are difficult or expensive to get.
| Item Type: | Article |
|---|---|
| Journal or Publication Title: | Acta cybernetica |
| Date: | 2019 |
| Volume: | 24 |
| Number: | 1 |
| ISSN: | 0324-721X |
| Page Range: | pp. 157-172 |
| Language: | English |
| Publisher: | University of Szeged, Institute of Informatics |
| Place of Publication: | Szeged |
| Event Title: | Conference of PhD students in computer science (11.) (2018) (Szeged) |
| Related URLs: | http://acta.bibl.u-szeged.hu/62212/ |
| DOI: | 10.14232/actacyb.24.1.2019.11 |
| Uncontrolled Keywords: | Számítástechnika |
| Additional Information: | Bibliogr.: p. 170-172. ; ill. ; összefoglalás angol nyelven |
| Subjects: | 01. Natural sciences 01. Natural sciences > 01.02. Computer and information sciences |
| Date Deposited: | 2019. Jul. 17. 13:50 |
| Last Modified: | 2022. Jun. 21. 09:16 |
| URI: | http://acta.bibl.u-szeged.hu/id/eprint/59233 |
Actions (login required)
 |
View Item |
