Loading…

CSI-IANet: An Inception Attention Network for Human-Human Interaction Recognition Based on CSI Signal

In recent years, Wi-Fi infrastructures have become ubiquitous, providing device-free passive-sensing features. Wi-Fi signals can be affected by their reflection, refraction, and absorption by moving objects in their path. The channel state information (CSI), a signal property indicator, of the Wi-Fi...

Full description

Saved in:
Bibliographic Details
Published in:IEEE access 2021, Vol.9, p.166624-166638
Main Authors: Kabir, M. Humayun, Rahman, M. Hafizur, Shin, Wonjae
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c408t-a165106a1de4deea919e29bfb4757c6cc10e0f7f09785cba3f8c0b99317c82fc3
cites cdi_FETCH-LOGICAL-c408t-a165106a1de4deea919e29bfb4757c6cc10e0f7f09785cba3f8c0b99317c82fc3
container_end_page 166638
container_issue
container_start_page 166624
container_title IEEE access
container_volume 9
creator Kabir, M. Humayun
Rahman, M. Hafizur
Shin, Wonjae
description In recent years, Wi-Fi infrastructures have become ubiquitous, providing device-free passive-sensing features. Wi-Fi signals can be affected by their reflection, refraction, and absorption by moving objects in their path. The channel state information (CSI), a signal property indicator, of the Wi-Fi signal can be analyzed for human activity recognition (HAR). Deep learning-based HAR models can enhance performance and accuracy without sacrificing computational efficiency. However, to save computational power, an inception network, which uses a variety of techniques to boost speed and accuracy, can be adopted. In contrast, the concept of spatial attention can be applied to obtain refined features. In this paper, we propose a human-human interaction (HHI) classifier, CSI-IANet, which uses a modified inception CNN with a spatial-attention mechanism. The CSI-IANet consists of three steps: i) data processing, ii) feature extraction, and iii) recognition. The data processing layer first uses the second-order Butterworth low-pass filter to denoise the CSI signal and then segment it before feeding it to the model. The feature extraction layer uses a multilayer modified inception CNN with an attention mechanism that uses spatial attention in an intense structure to extract features from captured CSI signals. Finally, the refined features are exploited by the recognition section to determine HHIs correctly. To validate the performance of the proposed CSI-IANet, a publicly available HHIs CSI dataset with a total of 4800 trials of 12 interactions was used. The performance of the proposed model was compared to those of existing state-of-the-art methods. The experimental results show that CSI-IANet achieved an average accuracy of 91.30%, which is better than that of the existing best method by 5%.
doi_str_mv 10.1109/ACCESS.2021.3134794
format article
fullrecord <record><control><sourceid>proquest_ieee_</sourceid><recordid>TN_cdi_ieee_primary_9646919</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9646919</ieee_id><doaj_id>oai_doaj_org_article_796af8565c86461daaef407e32297cbc</doaj_id><sourcerecordid>2613364949</sourcerecordid><originalsourceid>FETCH-LOGICAL-c408t-a165106a1de4deea919e29bfb4757c6cc10e0f7f09785cba3f8c0b99317c82fc3</originalsourceid><addsrcrecordid>eNpNUdFKwzAULaLgmPuCvRR87kyaNGl8q2W6wlCw-hzS9GZ0bs1MO8S_N2vHMA83h3vPOcnlBMEcowXGSDxkeb4sy0WMYrwgmFAu6FUwiTETEUkIu_6Hb4NZ122RP6lvJXwSQF4WUZG9Qv8YZm1YtBoOfWPbMOt7aAfkZz_WfYXGunB13Ks2Gqrn9uCUHjjvoO2mbQb8pDqoQw-8dVg2m1bt7oIbo3YdzM73NPh8Xn7kq2j99lLk2TrSFKV9pDBLMGIK10BrACWwgFhUpqI84ZppjREgww0SPE10pYhJNaqEIJjrNDaaTINi9K2t2sqDa_bK_UqrGjk0rNtI5fpG70BywZRJE5bolFGGa6XAUMSBxLHgujp53Y9eB2e_j9D1cmuPzi_TyZhhQhgVVHgWGVna2a5zYC6vYiRP8cgxHnmKR57j8ar5qGoA4KIQ_iN-ZfIHet2Kkw</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2613364949</pqid></control><display><type>article</type><title>CSI-IANet: An Inception Attention Network for Human-Human Interaction Recognition Based on CSI Signal</title><source>IEEE Open Access Journals</source><creator>Kabir, M. Humayun ; Rahman, M. Hafizur ; Shin, Wonjae</creator><creatorcontrib>Kabir, M. Humayun ; Rahman, M. Hafizur ; Shin, Wonjae</creatorcontrib><description>In recent years, Wi-Fi infrastructures have become ubiquitous, providing device-free passive-sensing features. Wi-Fi signals can be affected by their reflection, refraction, and absorption by moving objects in their path. The channel state information (CSI), a signal property indicator, of the Wi-Fi signal can be analyzed for human activity recognition (HAR). Deep learning-based HAR models can enhance performance and accuracy without sacrificing computational efficiency. However, to save computational power, an inception network, which uses a variety of techniques to boost speed and accuracy, can be adopted. In contrast, the concept of spatial attention can be applied to obtain refined features. In this paper, we propose a human-human interaction (HHI) classifier, CSI-IANet, which uses a modified inception CNN with a spatial-attention mechanism. The CSI-IANet consists of three steps: i) data processing, ii) feature extraction, and iii) recognition. The data processing layer first uses the second-order Butterworth low-pass filter to denoise the CSI signal and then segment it before feeding it to the model. The feature extraction layer uses a multilayer modified inception CNN with an attention mechanism that uses spatial attention in an intense structure to extract features from captured CSI signals. Finally, the refined features are exploited by the recognition section to determine HHIs correctly. To validate the performance of the proposed CSI-IANet, a publicly available HHIs CSI dataset with a total of 4800 trials of 12 interactions was used. The performance of the proposed model was compared to those of existing state-of-the-art methods. The experimental results show that CSI-IANet achieved an average accuracy of 91.30%, which is better than that of the existing best method by 5%.</description><identifier>ISSN: 2169-3536</identifier><identifier>EISSN: 2169-3536</identifier><identifier>DOI: 10.1109/ACCESS.2021.3134794</identifier><identifier>CODEN: IAECCG</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Accuracy ; Channel state information (CSI) ; convolution neural network (CNN) ; Data processing ; deep learning ; Feature extraction ; Feature recognition ; Hidden Markov models ; Human activity recognition ; inception module ; Low pass filters ; Machine learning ; Moving object recognition ; Multilayers ; Robot sensing systems ; Sensors ; spatial attention ; Wireless communication ; Wireless fidelity ; Wireless sensor networks</subject><ispartof>IEEE access, 2021, Vol.9, p.166624-166638</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c408t-a165106a1de4deea919e29bfb4757c6cc10e0f7f09785cba3f8c0b99317c82fc3</citedby><cites>FETCH-LOGICAL-c408t-a165106a1de4deea919e29bfb4757c6cc10e0f7f09785cba3f8c0b99317c82fc3</cites><orcidid>0000-0001-6513-1237 ; 0000-0002-1981-6582 ; 0000-0002-6849-2051</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9646919$$EHTML$$P50$$Gieee$$Hfree_for_read</linktohtml><link.rule.ids>314,780,784,4024,27633,27923,27924,27925,54933</link.rule.ids></links><search><creatorcontrib>Kabir, M. Humayun</creatorcontrib><creatorcontrib>Rahman, M. Hafizur</creatorcontrib><creatorcontrib>Shin, Wonjae</creatorcontrib><title>CSI-IANet: An Inception Attention Network for Human-Human Interaction Recognition Based on CSI Signal</title><title>IEEE access</title><addtitle>Access</addtitle><description>In recent years, Wi-Fi infrastructures have become ubiquitous, providing device-free passive-sensing features. Wi-Fi signals can be affected by their reflection, refraction, and absorption by moving objects in their path. The channel state information (CSI), a signal property indicator, of the Wi-Fi signal can be analyzed for human activity recognition (HAR). Deep learning-based HAR models can enhance performance and accuracy without sacrificing computational efficiency. However, to save computational power, an inception network, which uses a variety of techniques to boost speed and accuracy, can be adopted. In contrast, the concept of spatial attention can be applied to obtain refined features. In this paper, we propose a human-human interaction (HHI) classifier, CSI-IANet, which uses a modified inception CNN with a spatial-attention mechanism. The CSI-IANet consists of three steps: i) data processing, ii) feature extraction, and iii) recognition. The data processing layer first uses the second-order Butterworth low-pass filter to denoise the CSI signal and then segment it before feeding it to the model. The feature extraction layer uses a multilayer modified inception CNN with an attention mechanism that uses spatial attention in an intense structure to extract features from captured CSI signals. Finally, the refined features are exploited by the recognition section to determine HHIs correctly. To validate the performance of the proposed CSI-IANet, a publicly available HHIs CSI dataset with a total of 4800 trials of 12 interactions was used. The performance of the proposed model was compared to those of existing state-of-the-art methods. The experimental results show that CSI-IANet achieved an average accuracy of 91.30%, which is better than that of the existing best method by 5%.</description><subject>Accuracy</subject><subject>Channel state information (CSI)</subject><subject>convolution neural network (CNN)</subject><subject>Data processing</subject><subject>deep learning</subject><subject>Feature extraction</subject><subject>Feature recognition</subject><subject>Hidden Markov models</subject><subject>Human activity recognition</subject><subject>inception module</subject><subject>Low pass filters</subject><subject>Machine learning</subject><subject>Moving object recognition</subject><subject>Multilayers</subject><subject>Robot sensing systems</subject><subject>Sensors</subject><subject>spatial attention</subject><subject>Wireless communication</subject><subject>Wireless fidelity</subject><subject>Wireless sensor networks</subject><issn>2169-3536</issn><issn>2169-3536</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>DOA</sourceid><recordid>eNpNUdFKwzAULaLgmPuCvRR87kyaNGl8q2W6wlCw-hzS9GZ0bs1MO8S_N2vHMA83h3vPOcnlBMEcowXGSDxkeb4sy0WMYrwgmFAu6FUwiTETEUkIu_6Hb4NZ122RP6lvJXwSQF4WUZG9Qv8YZm1YtBoOfWPbMOt7aAfkZz_WfYXGunB13Ks2Gqrn9uCUHjjvoO2mbQb8pDqoQw-8dVg2m1bt7oIbo3YdzM73NPh8Xn7kq2j99lLk2TrSFKV9pDBLMGIK10BrACWwgFhUpqI84ZppjREgww0SPE10pYhJNaqEIJjrNDaaTINi9K2t2sqDa_bK_UqrGjk0rNtI5fpG70BywZRJE5bolFGGa6XAUMSBxLHgujp53Y9eB2e_j9D1cmuPzi_TyZhhQhgVVHgWGVna2a5zYC6vYiRP8cgxHnmKR57j8ar5qGoA4KIQ_iN-ZfIHet2Kkw</recordid><startdate>2021</startdate><enddate>2021</enddate><creator>Kabir, M. Humayun</creator><creator>Rahman, M. Hafizur</creator><creator>Shin, Wonjae</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7SR</scope><scope>8BQ</scope><scope>8FD</scope><scope>JG9</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0001-6513-1237</orcidid><orcidid>https://orcid.org/0000-0002-1981-6582</orcidid><orcidid>https://orcid.org/0000-0002-6849-2051</orcidid></search><sort><creationdate>2021</creationdate><title>CSI-IANet: An Inception Attention Network for Human-Human Interaction Recognition Based on CSI Signal</title><author>Kabir, M. Humayun ; Rahman, M. Hafizur ; Shin, Wonjae</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c408t-a165106a1de4deea919e29bfb4757c6cc10e0f7f09785cba3f8c0b99317c82fc3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Accuracy</topic><topic>Channel state information (CSI)</topic><topic>convolution neural network (CNN)</topic><topic>Data processing</topic><topic>deep learning</topic><topic>Feature extraction</topic><topic>Feature recognition</topic><topic>Hidden Markov models</topic><topic>Human activity recognition</topic><topic>inception module</topic><topic>Low pass filters</topic><topic>Machine learning</topic><topic>Moving object recognition</topic><topic>Multilayers</topic><topic>Robot sensing systems</topic><topic>Sensors</topic><topic>spatial attention</topic><topic>Wireless communication</topic><topic>Wireless fidelity</topic><topic>Wireless sensor networks</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Kabir, M. Humayun</creatorcontrib><creatorcontrib>Rahman, M. Hafizur</creatorcontrib><creatorcontrib>Shin, Wonjae</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE/IET Electronic Library</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>IEEE access</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Kabir, M. Humayun</au><au>Rahman, M. Hafizur</au><au>Shin, Wonjae</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>CSI-IANet: An Inception Attention Network for Human-Human Interaction Recognition Based on CSI Signal</atitle><jtitle>IEEE access</jtitle><stitle>Access</stitle><date>2021</date><risdate>2021</risdate><volume>9</volume><spage>166624</spage><epage>166638</epage><pages>166624-166638</pages><issn>2169-3536</issn><eissn>2169-3536</eissn><coden>IAECCG</coden><abstract>In recent years, Wi-Fi infrastructures have become ubiquitous, providing device-free passive-sensing features. Wi-Fi signals can be affected by their reflection, refraction, and absorption by moving objects in their path. The channel state information (CSI), a signal property indicator, of the Wi-Fi signal can be analyzed for human activity recognition (HAR). Deep learning-based HAR models can enhance performance and accuracy without sacrificing computational efficiency. However, to save computational power, an inception network, which uses a variety of techniques to boost speed and accuracy, can be adopted. In contrast, the concept of spatial attention can be applied to obtain refined features. In this paper, we propose a human-human interaction (HHI) classifier, CSI-IANet, which uses a modified inception CNN with a spatial-attention mechanism. The CSI-IANet consists of three steps: i) data processing, ii) feature extraction, and iii) recognition. The data processing layer first uses the second-order Butterworth low-pass filter to denoise the CSI signal and then segment it before feeding it to the model. The feature extraction layer uses a multilayer modified inception CNN with an attention mechanism that uses spatial attention in an intense structure to extract features from captured CSI signals. Finally, the refined features are exploited by the recognition section to determine HHIs correctly. To validate the performance of the proposed CSI-IANet, a publicly available HHIs CSI dataset with a total of 4800 trials of 12 interactions was used. The performance of the proposed model was compared to those of existing state-of-the-art methods. The experimental results show that CSI-IANet achieved an average accuracy of 91.30%, which is better than that of the existing best method by 5%.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/ACCESS.2021.3134794</doi><tpages>15</tpages><orcidid>https://orcid.org/0000-0001-6513-1237</orcidid><orcidid>https://orcid.org/0000-0002-1981-6582</orcidid><orcidid>https://orcid.org/0000-0002-6849-2051</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2169-3536
ispartof IEEE access, 2021, Vol.9, p.166624-166638
issn 2169-3536
2169-3536
language eng
recordid cdi_ieee_primary_9646919
source IEEE Open Access Journals
subjects Accuracy
Channel state information (CSI)
convolution neural network (CNN)
Data processing
deep learning
Feature extraction
Feature recognition
Hidden Markov models
Human activity recognition
inception module
Low pass filters
Machine learning
Moving object recognition
Multilayers
Robot sensing systems
Sensors
spatial attention
Wireless communication
Wireless fidelity
Wireless sensor networks
title CSI-IANet: An Inception Attention Network for Human-Human Interaction Recognition Based on CSI Signal
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-04T21%3A29%3A00IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_ieee_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=CSI-IANet:%20An%20Inception%20Attention%20Network%20for%20Human-Human%20Interaction%20Recognition%20Based%20on%20CSI%20Signal&rft.jtitle=IEEE%20access&rft.au=Kabir,%20M.%20Humayun&rft.date=2021&rft.volume=9&rft.spage=166624&rft.epage=166638&rft.pages=166624-166638&rft.issn=2169-3536&rft.eissn=2169-3536&rft.coden=IAECCG&rft_id=info:doi/10.1109/ACCESS.2021.3134794&rft_dat=%3Cproquest_ieee_%3E2613364949%3C/proquest_ieee_%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c408t-a165106a1de4deea919e29bfb4757c6cc10e0f7f09785cba3f8c0b99317c82fc3%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2613364949&rft_id=info:pmid/&rft_ieee_id=9646919&rfr_iscdi=true