Abstract
This paper introduces a basic frame for rehabilitation motion practice system which detects 3D motion trajectory with the Microsoft Kinect (MSK) sensor system and proposes a cost-effective 3D motion matching algorithm. The rehabilitation motion practice system displays a reference 3D motion in the database system that the player (patient) tries to follow. The player’s motion is traced by the MSK sensor system and then compared with the reference motion to evaluate how well the player follows the reference motion. In this system, 3D motion matching algorithm is a key feature for accurate evaluation for player’s performance. Even though similarity measurement of 3D trajectories is one of the most important tasks in 3D motion analysis, existing methods are still limited. Recent researches focus on the full length 3D trajectory data set. However, it is not true that every point on the trajectory plays the same role and has the same meaning. In this situation, we developed a new cost-effective method that only uses the less number of features called ‘signature’ which is a flexible descriptor computed from the region of ‘elbow points’. Therefore, our proposed method runs faster than other methods which use the full length trajectory information. The similarity of trajectories is measured based on the signature using an alignment method such as dynamic time warping (DTW), continuous dynamic time warping (CDTW) or longest common sub-sequence (LCSS) method. In the experimental studies, we applied the MSK sensor system to detect, trace and match the 3D motion of human body. This application was assumed as a system for guiding a rehabilitation practice which can evaluate how well the motion practice was performed based on comparison of the patient’s practice motion traced by the MSK system with the pre-defined reference motion in a database. In order to evaluate the accuracy of our 3D motion matching algorithm, we compared our method with two other methods using Australian sign word dataset. As a result, our matching algorithm outperforms in matching 3D motion, and it can be exploited for a base framework for various 3D motion-based applications at low cost with high accuracy.
Similar content being viewed by others
References
Aach J, Church G (2001) Aligning gene expression time series with time warping algorithms. Bioinformatics 17:495–508
Australian Sign Language Dataset (April 1999), http://kdd.ics.uci.edu/databases/auslan/ auslan.html
Balteanu M. S (2010) Professional risk management using computerized monitoring. In: Proceedings of the International Conference on Risk Management, Assessment and Mitigation(RIMA), pp 51–55
Bashir F., Khokhar A., Schonfeld D (2005) Automatic object trajectory-based motion recognition using Gaussian mixture models. In: IEEE International Conference on Multimedia and Expo, pp 1532-1535
Croitoru A., Agouris P., Stefanidis A (2005) 3D trajectory matching by pose normalization. In: Proceedings of the 13th annual ACM international workshop on Geographic information systems, pp 153-162
Fitzgerald D. et al (2007) Development of a wearable motion capture suit and virtual reality biofeedback system for the instruction and analysis of sports rehabilitation exercises, In: Proceedings of 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp 4870-4874
Humm J. R. et al (1994). A biomechanical analysis of ballet dancers on pointe. In: Proceedings of 16th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp 374-375
Kehtarnavaz N, deFigueiredo JP (1988) A 3D contour segmentation scheme based on curvature and torsion. IEEE Transactions on Pattern Analysis & Machine Intelligent 10:707–713
Khoshelham K, Elberink SO (2012) Accuracy and resolution of Kinect depth data for indoor mapping applications. Sensors 12:1437–1454
Pallejà T, Guillamet A, Tresanchez M, Teixidó M, Viso AF, Rebate C, Palacín J (2013) Implementation of a robust absolute virtual head mouse combining face detection, template matching and optical flow algorithms. Telecommunication Systems 52:1479–1489
Singh R, Vatsa M, Singh SK, Upadhyay S (2009) Integrating SVM classification with SVD watermarking for intelligent video authentication. Telecommunication Systems 40:5–15
Vlachos M., Hadjieleftheriou M., Gunopulos D., Keogh E (2003) Indexing multi-dimensional time-series with support for multiple distance measures. In: Proceedings of the ninth ACM SIGKDD international conference on knowledge discovery and data mining, pp 216-225
Vlachos M., Kollios G., Gunopulos D (2002) Discovering similar multidimensional trajectories. In: Proceedings 18th International Conference on Data Engineering, pp 673-684
Vranic D., Saupe D (2001) 3D shape descriptor based on 3D Fourier transform. In: Proceedings of the EURASIP Conference on Digital Signal Processing for Multimedia Communications and Services (ECMCS 2001), pp 271-274
Wang R., Leow, W. K. Leong, H. W (2008) 3D-2D Spartiotemporal registration for sport motion analysis. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp 1-8
Wu S, Li YF (2009) Flexible signature descriptions for adaptive motion trajectory representation, perception and recognition. Pattern Recognition 42:194–214
Yang J.Y., Li Y.F (2010) A new descriptor for 3D trajectory recognition. In: Proceedings of 2010 I.E. International Conference on Automation and Logistics (ICAL 2010), pp 37-42
Zetu D, Banerjee P, Thompson D (2000) Extended-range hybrid tracker and applications to motion and camera tracking in manufacturing systems. Robotics and Automation 16:281–293
Acknowledgment
This study was financially supported by Chonnam National University 2011, and was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Educations, Science and Technology (NRF-2013R1A2A2A04016782).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Pham, HT., Kim, JJ., Nguyen, T.L. et al. 3D motion matching algorithm using signature feature descriptor. Multimed Tools Appl 74, 1125–1136 (2015). https://doi.org/10.1007/s11042-014-2103-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-014-2103-2