An improved deep hybrid HAR model(VGG-LSTM)is proposed to solve the problem that the performances of traditional machine learning methods for human activity recognition(HAR)using motion sensor data are heavily dependent on artificial features
and their accuracies are limited. The model combines a convolutional neural network and a long-short-term-memory network to automatically extract features and to effectively recognize different activities. The proposed method combines multiple modified 1D-convolutional neural networks and two layers of long-short-term-memory networks by comparing the stratified and time-series structure of sensor data with RGB matrix of image. Experiments show that the model achieves average accuracies of 97.17% on the benchmark dataset HAR and 96.53% on the dataset WISDM
and that it effectively avoids complex feature engineering and has a good accuracy in the human activity recognition.
关键词
Keywords
references
AGGARWAL J K. Human activity recognition: a grand challenge [C]∥Proceedings of the International Symposium on Signals, Circuits and Systems. Piscataway, NJ, USA: IEEE, 2007: 1.
VEPAKOMMA P, DE D, DAS S K, et al. A-Wristocracy: deep learning on wrist-worn sensing for recognition of user complex activities [C]∥Proceedings of the International Conference on Wearable and Implantable Body Sensor Networks. Piscataway, NJ, USA: IEEE, 2016: 1-6.
WENG Hanliang, ZHAN Mengwei. Vision-based hand gesture recognition with multiple cues [J]. Computer Engineering and Science, 2012, 34(2): 123-127.
WANG A, CHEN G, YANG J, et al. A comparative study on human activity recognition using inertial sensors in a smartphone [J]. IEEE Sensors Journal, 2016, 16(11): 4566-4578.
LU Xianling, WANG Hongbin, WANG Yingying, et al. Human falling detection based on accelerometer [J]. Application Research of Computers, 2013, 30(4): 1109-1111.
BULLING A, BLANKE U, SCHIELE B. A tutorial on human activity recognition using body-worn inertial sensors [J]. ACM Computing Surveys, 2014, 46(3): 1-33.
ANGUITA D, GHIO A, ONETO L, et al. Training computationally efficient smartphone—based human activity recognition models [C]∥ Proceedings of the 2013 Artificial Neural Networks and Machine Learning. Berlin, Germany: Springer, 2013: 426-433.
BANOS O, TOTH M A, DAMAS M, et al. Dealing with the effects of sensor displacement in wearable activity recognition [J]. Sensors, 2014, 14(6): 9995-10023.
KRIZHEVSKY A, SUTSKEVER I, HINTON G E. ImageNet classification with deep convolutional neural networks [C] ∥Proceedings of the 2012 International Conference on Neural Information Processing Systems. New York, USA: ACM, 2012: 1097-1105.
RONAO C A, CHO S B. Human activity recognition with smartphone sensors using deep learning neural networks [J]. Expert Systems with Applications, 2016, 59(C): 235-244.
ORDONEZ F J, ROGGEN D. Deep convolutional and LSTM recurrent neural networks for multimodal wearable activity recognition [J]. Sensors, 2016, 16(1): 115.
SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition [EB/OL].(2015-04-10)[2017-11-12]. http:∥arxiv.org/pdf/1409.1556v6.pdf.
GOODFELLOW I, YOSHUA B, AARON C. Deep learning [M]. 1st ed. Cambridge, MA, USA: MIT Press, 2015: 294-295.
LECUN Y, BOTTOU L, BENGIO Y, et al. Gradient-based learning applied to document recognition [J]. Proceedings of the IEEE, 2001, 86(11): 2278-2324.
KINGMA D P, BA J. Adam: a method for stochastic optimization [EB/OL].(2015-07-23)[2017-11-12]. http:∥arxiv.org/pdf/1412.6980v8.pdf.
SRIVASTAVA N, HINTON G, KRIZHEVSKY A, et al. Dropout: a simple way to prevent neural networks from overfitting [J]. Journal of Machine Learning Research, 2014, 15(1): 1929-1958.
ANGUITA D, GHIO A, ONETO L, et al. Human activity recognition on smartphones using a multiclass hardware-friendly support vector machine [C]∥ Proceedings of the 4th International Conference on Ambient Assisted Living and Home Care. Berlin, Germany: Springer, 2012: 216-223.
ABADI M, AGARWAL A, BARHAM P, et al. TensorFlow: large-scale machine learning on heterogeneous distributed systems [EB/OL].(2016-03-14)[2017-11-21]. http: ∥arxiv.org/pdf/1603.04467v1. pdf.
KWAPISZ J R, WEISS G M, MOORE S A. Activity recognition using cell phone accelerometers [J]. ACM SIGKDD Explorations Newsletter, 2011, 12(2): 74-82.