Literature Review on Wireless Sensing—Wi-Fi Signal-Based Recognition of Human Activities

Chao Wang; Siwen Chen; Yanwei Yang; Feng Hu; Fugang Liu; Jie Wu

doi:10.26599/TST.2018.9010080

Tsinghua Science and Technology 2018, 23(2): 203-222 https://doi.org/10.26599/TST.2018.9010080

Open Access | Issue | Published: 02 April 2018

Literature Review on Wireless Sensing—Wi-Fi Signal-Based Recognition of Human Activities

Show Author's Information Hide Author's Information Chao Wang(

), Siwen Chen, Yanwei Yang, Feng Hu, Fugang Liu, Jie Wu

Key laboratory of Specialty Fiber Optics and Optical Access Networks, Joint International Research Laboratory of Specialty Fiber Optics and Advanced Communication, Shanghai Institute for Advanced Communication and Data Science, Shanghai University, Shanghai 200444, China.

Science and Technology, Heilongjiang University, Harbin 150022, China.

Department of Computer and Information Sciences, Temple University, PA 19122-6096, USA.

Keywords:

channel state information, frequency modulated carrier wave, human activities recognition, wireless sensing applications, Wi-Fi

Cite this article:

Wang C, Chen S, Yang Y, et al. Literature Review on Wireless Sensing—Wi-Fi Signal-Based Recognition of Human Activities. Tsinghua Science and Technology, 2018, 23(2): 203-222. https://doi.org/10.26599/TST.2018.9010080

Download citation

EndNote(RIS)

BibTeX

531

Views

Downloads

Citations

Crossref

N/A

WoS

Scopus

CSCD

Abstract Full text About this article

Abstract

With the rapid development and wide deployment of wireless technology, Wi-Fi signals have no longer been confined to the Internet as a communication medium. Wi-Fi signals will be modulated again by human actions when propagating indoors, carrying rich human body state information. Therefore, a novel wireless sensing technology is gradually emerging that can realize gesture recognition, human daily activity detection, identification, indoor localization and human body tracking, vital signs detection, imaging, and emotional recognition by extracting effective feature information about human actions from Wi-Fi signals. Researchers mainly use channel state information or frequency modulated carrier wave in their current implementation schemes of wireless sensing technology, called “Walls have eyes”, and these schemes cover radio-frequency technology, signal processing technology, and machine learning. These available wireless sensing systems can be used in many applications such as smart home, medical health care, search-and-rescue, security, and with the high precision and passively device-free through-wall detection function. This paper elaborates the research actuality and summarizes each system structure and the basic principles of various wireless sensing applications in detail. Meanwhile, two popular implementation schemes are analyzed. In addition, the future diversely application prospects of wireless sensing systems are presented.

Full text

Abstract

Full text

Outline

About this article

Literature Review on Wireless Sensing—Wi-Fi Signal-Based Recognition of Human Activities

Show Author's information Hide Author's Information Chao Wang(

), Siwen Chen, Yanwei Yang, Feng Hu, Fugang Liu, Jie Wu

Science and Technology, Heilongjiang University, Harbin 150022, China.

Department of Computer and Information Sciences, Temple University, PA 19122-6096, USA.

Abstract

Keywords: channel state information, frequency modulated carrier wave, human activities recognition, wireless sensing applications, Wi-Fi

References(40)

[1]

Wang W., Liu A. X., Shahzad M., Ling K., and Lu S., Understanding and modeling of wi-fi signal based human activity recognition, in Proc. ACM Mobi Com, Paris, France, 2015, pp. 65–76.

[2]

Wang Y., Liu J., Chen Y., Gruteser M., Yang J., and Liu H., E-eyes: Device-free location-oriented activity identification using fine-grained wi-fi signatures, in Proc. ACM Mobi Com, Maui, HI, USA, 2014, pp. 617–628.

[3]

Enhancements for Higher Throughput, IEEE Standard 802.11n, 2009.

DOI

[4]

Adib F., Kabelac Z., Katabi D., and Miller R. C., 3D tracking via body radio reflections, in Proc. Usenix NSDI, Seattle, WA, USA, 2014, pp. 317–329.

DOI

[5]

Wu C. S., Yang Z., Zhou Z., Liu X. F., Liu Y. H., and Cao J. N., Non-invasive detection of moving and stationary human with wi-fi, IEEE J. Sel. Area. Comm., vol. 33, no. 11, pp. 2329–2342, 2015.

DOI Google Scholar

[6]

Han C. M., Wu K. S., Wang Y. X., and Ni L. M., WiFall: Device-free fall detection by wireless networks, in Proc. IEEE INFOCOM, Toronto, Canada, 2014, pp. 271–279.

DOI

[7]

Adib F., Hsu C. Y., Mao H. Z., Katabi D., and Durand F., Capturing the human figure through a wall, in Proc. ACM MobiCom, Paris, France, 2015, pp. 1–13.

DOI

[8]

Pu Q. F., Gupta S., Gollakota S., and Patel S., Whole-home gesture recognition using wireless signals, in Proc. ACM SIGCOMM, Hong Kong, China, 2013, pp. 485–486.

DOI

[9]

Adib F. and Katabi D., See through walls with wi-fi, in Proc. ACM SIGCOMM, Hong Kong, China, 2013, pp. 75–86.

DOI

[10]

Halperin D., Hu W. J., Sheth A., and Wetherall D., 802.11 with multiple antennas for dummies, in Proc. ACM SIGCOMM, New Delhi, India, 2010, pp. 19–25.

[11]

Halperin D., Hu W., Sheth A., and Wetherall D., Predictable 802.11 packet delivery from wireless channel measurements, in Proc. ACM SIGCOMM, New Delhi, India, 2010, pp. 159–170.

DOI

[12]

Li H., Yang W., Wang J. X., Xu Y., and Huang L. S., Wi-Finger: Talk to your smart devices with finger-grained gesture, in Proc. ACM UbiComp, Heidelberg, Germany, Sep. 2016, pp. 250–261.

[13]

Liu J., Wang Y., Chen Y. Y., Yang J., Chen X., and Cheng J., Tracking vital signs during sleep leveraging off-the-shelf wi-fi, in Proc. ACM MobiHoc, Hangzhou, China, 2015, pp. 267–276.

[14]

Adib F., Kabelac Z., and Katabi D., Multi-person localization via RF body reflections, in Proc. Usenix NSDI, Oakland, CA, USA, 2015, pp. 279–292.

[15]

Zhao M. M., Adib F., and Katabi D., Emotion recognition using wireless signals, in Proc. ACM MobiCom, New York, NY, USA, 2016, pp. 95–108.

[16]

Yang Z. and Liu Y. H., Wi-Fi radar: From RSSI to CSI, CCF, vol. 10, no. 11, pp. 55–60, 2014.

Google Scholar

[17]

Adib F., Mao H. Z., Kabelac Z., Katabi D., and Miller R. C., Smart homes that monitor breathing and heart rate, in Proc. ACM CHI, Seoul, Korea, 2015, pp. 837–846.

[18]

Ali K., Liu A. X., Wang W., and Shahzad M., Keystroke recognition using wi-fi signals, in Proc. ACM MobiCom, Paris, France, 2015, pp. 90–102.

[19]

Davies L. and Gather U., The identification of multiple outliers, J. Am. Stat. Assoc., vol. 88, no. 423, pp. 782–792, 1993.

DOI Google Scholar

[20]

Gardner E. S., Exponential smoothing: The state of the art, J. Forecasting, vol. 4, no. 1, pp. 1–28, 1985.

DOI Google Scholar

[21]

Rubner Y., Perceptual metrics for image database navigation, Ph.D. dissertation, Dept. S. U. C. S., Stanford Univ., Stanford, CA, USA, 1999.

[22]

Holt G. T., Reinders M., and Hendriks E., Multi-dimensional dynamic time warping for gesture recognition, in Proc. ASCI, Heijen, Holland, Jun. 2007, pp. 1–8.

[23]

Welch L. R., Hidden Markov models and the Baum-welch algorithm, IEEE Information Theory Society Newsletter, vol. 53, no. 4, pp. 10–13, 2003.

Google Scholar

[24]

Zeng Y. Z., Pathak P. H., and Mohapatra P., WiWho: wi-fi-based person identification in smart spaces, in Proc. ACM IPSN, Vienna, Austria, 2016.

[25]

Unar J., Seng W. C., and Abbasi A., A review of biometric technology along with trends and prospects, Pattern Recogn., vol. 47, no. 8, pp. 2673–2688, 2014.

DOI Google Scholar

[26]

Ngo T. T., Makihara Y., Nagahara H., Mukaigawa Y., and Yagi Y., The largest inertial sensor-based gait database and performance evaluation of gait-based personal authentication, Pattern Recogn., vol. 47, no. 1, pp. 228–237, 2014.

DOI Google Scholar

[27]

Jin Y., Soh W. S., and Wong W. C., Indoor localization with channel impulse response based fingerprint and nonparametric regression, IEEE Trans. Wirel. Commun., vol. 9, no. 3, pp. 1120–1127, 2010.

DOI Google Scholar

[28]

Wang W., Liu A. X., and Shahzad M., Gait recognition using wi-fi signals, in Proc. ACM UbiComp, Heidelberg, Germany, Sep. 2016, pp. 363–373.

[29]

Whittle M. W., Gait analysis: An introduction, Physiotherapy, vol. 77, no. 11, p. 786, 2003.

DOI Google Scholar

[30]

Dorp P. V. and Groen F., Feature-based human motion parameter estimation with radar, IET Radar Sonar Nav., vol. 2, no. 2, pp. 135–145, 2008.

DOI Google Scholar

[31]

Lucy L. B., An iterative technique for the rectification of observed distributions, Astron. J., vol. 79, no. 6, p. 745, 1974.

DOI Google Scholar

[32]

Quintana D. S., Guastella A. J., Outhred T., Hickie I. B., and Kemp A. H., Heart rate variability is associated with emotion recognition: Direct evidence for a relationship between the autonomic nervous system and social cognition, Int. J. Psychophysiol., vol. 86, no. 2, pp. 168–172, 2012.

DOI Google Scholar

[33]

Lane R. D., McRae K., Reiman E. M., Chen K., Ahern G. L., and Thayer J. F., Neural correlates of heart rate variability during emotion, Neuroimage, vol. 44, no. 1, pp. 213–222, 2009.

DOI Google Scholar

[34]

Calvo R. A. and Mello S. D., Affect detection: An interdisciplinary review of models, methods, and their applications, IEEE Trans. Affect. Comput., vol. 1, no. 1, pp. 18–37, 2010.

DOI Google Scholar

[35]

Kim J. and Andre E., Emotion recognition based on physiological changes in music listening, IEEE Trans. Pattern Anal., vol. 30, no. 12, pp. 2067–2083, 2008.

DOI Google Scholar

[36]

Acharya U. R., Joseph K. P., Kannathal N., Lim C. M., and Suri J. S., Heart rate variability: A review, Med. Biol. Eng. Comput., vol. 44, no. 12, pp. 1031–1051, 2006.

DOI Google Scholar

[37]

Guyon I. and Elisseeff A., An introduction to variable and feature selection, J. Mach. Learn. Res., vol. 3, no. 6, pp. 1157–1182, 2002.

Google Scholar

[38]

Holl P. M. and Reinhard F., Holography of wi-fi radiation, Phys. Rev. Lett., vol. 118, no. 18, p. 183901, 2017.

DOI Google Scholar

[39]

Abdelnasser H., Youssef M., and Harras K. A., Wigest: A ubiquitous wi-fi-based gesture recognition system, in Proc. IEEE INFOCOM, Kowloon, Hong Kong, China, 2015, pp. 1472–1480.

[40]

Shang J. C. and Wu J., A robust sign language recognition system with sparsely labeled instances using Wi-Fi signals, in Proceedings of IEEE 14th International Conference on Mobile Ad Hoc and Sensor Systems, Orlando, FL, USA, 2017, pp. 99–107.

About this article

Publication history

Acknowledgements

Rights and permissions

Publication history

Received: 28 December 2017

Accepted: 22 January 2018

Published: 02 April 2018

Issue date: April 2018

Copyright

Acknowledgements

This work was supported in part by the National Natural Science Foundation of China under Key Program of NSFC (No. 61332019), NSFC (Nos. 61572304 and 61272056); Shanghai Key Laboratory of Specialty Fiber Optics and Optical Access Networks (No. SKLSFO2014-06).