A human action classifier from 4-D data (3-D+TIME): Based on an invariant body shape descriptor and hidden markov models

Massimiliano Pierobon, Marco Marcon, Augusto Sarti, Stefano Tubaro

Research output: Contribution to conferencePaper

1 Scopus citations

Abstract

Many human action definitions have been provided in the field of human computer interaction studies. These distinctions could be considered merely semantical as human actions are all carried out performing sequences of body postures. In this paper we propose a human action classifier based on volumetric reconstructed sequences (4-D data) acquired from a multi-viewpoint camera system. In order to design the most general action classifier possible, we concentrate our attention in extracting only posture-dependent information from volumetric frames and in performing action distinction only on the basis of the sequence of body postures carried out in the scene. An Invariant Shape Descriptor (ISD) is used in order to properly describe the body shape and its dynamic changes during an action execution. The ISD data is then analyzed in order to extract suitable features able to meaningfully represent a human action independently from body position, orientation, size and proportions. The action classification is performed using a supervised recognizer based on the Hidden Markov Models (HMM) theory. Experimental results, evaluated using an extensive action sequence dataset and applying different training conditions to the HMM-based classifier, confirm the reliability of the proposed approach.

Original languageEnglish (US)
Pages406-413
Number of pages8
StatePublished - 2007
EventSIGMAP 2007 - International Conference on Signal Processing and Multimedia Applications - Barcelona, Spain
Duration: Jul 28 2007Jul 31 2007

Other

OtherSIGMAP 2007 - International Conference on Signal Processing and Multimedia Applications
CountrySpain
CityBarcelona
Period7/28/077/31/07

Keywords

  • Action classification
  • Action recognition
  • Computer vision
  • Gesture classification
  • Gesture recognition
  • Human machine interaction
  • Human motion analysis
  • Multiple view volumetric reconstruction
  • Video surveillance
  • Voxel based representation of human body

ASJC Scopus subject areas

  • Computer Science Applications
  • Signal Processing
  • Electrical and Electronic Engineering
  • Media Technology

Fingerprint Dive into the research topics of 'A human action classifier from 4-D data (3-D+TIME): Based on an invariant body shape descriptor and hidden markov models'. Together they form a unique fingerprint.

  • Cite this

    Pierobon, M., Marcon, M., Sarti, A., & Tubaro, S. (2007). A human action classifier from 4-D data (3-D+TIME): Based on an invariant body shape descriptor and hidden markov models. 406-413. Paper presented at SIGMAP 2007 - International Conference on Signal Processing and Multimedia Applications, Barcelona, Spain.