Published January 1, 2019 | Version v1
Journal article Open

Action Recognition Using Single-Pixel Time-of-Flight Detection

  • 1. Univ Tartu, Inst Technol, iCv Lab, EE-50411 Tartu, Estonia
  • 2. Univ Barcelona, E-08007 Barcelona, Spain
  • 3. Univ Tartu, Inst Phys, EE-50411 Tartu, Estonia
  • 4. Trinity Coll Dublin, Dublin 2, Ireland

Description

Action recognition is a challenging task that plays an important role in many robotic systems, which highly depend on visual input feeds. However, due to privacy concerns, it is important to find a method which can recognise actions without using visual feed. In this paper, we propose a concept for detecting actions while preserving the test subject's privacy. Our proposed method relies only on recording the temporal evolution of light pulses scattered back from the scene. Such data trace to record one action contains a sequence of one-dimensional arrays of voltage values acquired by a single-pixel detector at 1 GHz repetition rate. Information about both the distance to the object and its shape are embedded in the traces. We apply machine learning in the form of recurrent neural networks for data analysis and demonstrate successful action recognition. The experimental results show that our proposed method could achieve on average 96.47% accuracy on the actions walking forward, walking backwards, sitting down, standing up and waving hand, using recurrent neural network.

Files

bib-28424267-07a3-4080-aa8e-41a64c42790a.txt

Files (249 Bytes)

Name Size Download all
md5:b8a831e417cbe28143747b74fc4925cd
249 Bytes Preview Download