Loading…
CSI-IANet: An Inception Attention Network for Human-Human Interaction Recognition Based on CSI Signal
In recent years, Wi-Fi infrastructures have become ubiquitous, providing device-free passive-sensing features. Wi-Fi signals can be affected by their reflection, refraction, and absorption by moving objects in their path. The channel state information (CSI), a signal property indicator, of the Wi-Fi...
Saved in:
Published in: | IEEE access 2021, Vol.9, p.166624-166638 |
---|---|
Main Authors: | , , |
Format: | Article |
Language: | English |
Subjects: | |
Citations: | Items that this one cites Items that cite this one |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | cdi_FETCH-LOGICAL-c408t-a165106a1de4deea919e29bfb4757c6cc10e0f7f09785cba3f8c0b99317c82fc3 |
---|---|
cites | cdi_FETCH-LOGICAL-c408t-a165106a1de4deea919e29bfb4757c6cc10e0f7f09785cba3f8c0b99317c82fc3 |
container_end_page | 166638 |
container_issue | |
container_start_page | 166624 |
container_title | IEEE access |
container_volume | 9 |
creator | Kabir, M. Humayun Rahman, M. Hafizur Shin, Wonjae |
description | In recent years, Wi-Fi infrastructures have become ubiquitous, providing device-free passive-sensing features. Wi-Fi signals can be affected by their reflection, refraction, and absorption by moving objects in their path. The channel state information (CSI), a signal property indicator, of the Wi-Fi signal can be analyzed for human activity recognition (HAR). Deep learning-based HAR models can enhance performance and accuracy without sacrificing computational efficiency. However, to save computational power, an inception network, which uses a variety of techniques to boost speed and accuracy, can be adopted. In contrast, the concept of spatial attention can be applied to obtain refined features. In this paper, we propose a human-human interaction (HHI) classifier, CSI-IANet, which uses a modified inception CNN with a spatial-attention mechanism. The CSI-IANet consists of three steps: i) data processing, ii) feature extraction, and iii) recognition. The data processing layer first uses the second-order Butterworth low-pass filter to denoise the CSI signal and then segment it before feeding it to the model. The feature extraction layer uses a multilayer modified inception CNN with an attention mechanism that uses spatial attention in an intense structure to extract features from captured CSI signals. Finally, the refined features are exploited by the recognition section to determine HHIs correctly. To validate the performance of the proposed CSI-IANet, a publicly available HHIs CSI dataset with a total of 4800 trials of 12 interactions was used. The performance of the proposed model was compared to those of existing state-of-the-art methods. The experimental results show that CSI-IANet achieved an average accuracy of 91.30%, which is better than that of the existing best method by 5%. |
doi_str_mv | 10.1109/ACCESS.2021.3134794 |
format | article |
fullrecord | <record><control><sourceid>proquest_ieee_</sourceid><recordid>TN_cdi_ieee_primary_9646919</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9646919</ieee_id><doaj_id>oai_doaj_org_article_796af8565c86461daaef407e32297cbc</doaj_id><sourcerecordid>2613364949</sourcerecordid><originalsourceid>FETCH-LOGICAL-c408t-a165106a1de4deea919e29bfb4757c6cc10e0f7f09785cba3f8c0b99317c82fc3</originalsourceid><addsrcrecordid>eNpNUdFKwzAULaLgmPuCvRR87kyaNGl8q2W6wlCw-hzS9GZ0bs1MO8S_N2vHMA83h3vPOcnlBMEcowXGSDxkeb4sy0WMYrwgmFAu6FUwiTETEUkIu_6Hb4NZ122RP6lvJXwSQF4WUZG9Qv8YZm1YtBoOfWPbMOt7aAfkZz_WfYXGunB13Ks2Gqrn9uCUHjjvoO2mbQb8pDqoQw-8dVg2m1bt7oIbo3YdzM73NPh8Xn7kq2j99lLk2TrSFKV9pDBLMGIK10BrACWwgFhUpqI84ZppjREgww0SPE10pYhJNaqEIJjrNDaaTINi9K2t2sqDa_bK_UqrGjk0rNtI5fpG70BywZRJE5bolFGGa6XAUMSBxLHgujp53Y9eB2e_j9D1cmuPzi_TyZhhQhgVVHgWGVna2a5zYC6vYiRP8cgxHnmKR57j8ar5qGoA4KIQ_iN-ZfIHet2Kkw</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2613364949</pqid></control><display><type>article</type><title>CSI-IANet: An Inception Attention Network for Human-Human Interaction Recognition Based on CSI Signal</title><source>IEEE Open Access Journals</source><creator>Kabir, M. Humayun ; Rahman, M. Hafizur ; Shin, Wonjae</creator><creatorcontrib>Kabir, M. Humayun ; Rahman, M. Hafizur ; Shin, Wonjae</creatorcontrib><description>In recent years, Wi-Fi infrastructures have become ubiquitous, providing device-free passive-sensing features. Wi-Fi signals can be affected by their reflection, refraction, and absorption by moving objects in their path. The channel state information (CSI), a signal property indicator, of the Wi-Fi signal can be analyzed for human activity recognition (HAR). Deep learning-based HAR models can enhance performance and accuracy without sacrificing computational efficiency. However, to save computational power, an inception network, which uses a variety of techniques to boost speed and accuracy, can be adopted. In contrast, the concept of spatial attention can be applied to obtain refined features. In this paper, we propose a human-human interaction (HHI) classifier, CSI-IANet, which uses a modified inception CNN with a spatial-attention mechanism. The CSI-IANet consists of three steps: i) data processing, ii) feature extraction, and iii) recognition. The data processing layer first uses the second-order Butterworth low-pass filter to denoise the CSI signal and then segment it before feeding it to the model. The feature extraction layer uses a multilayer modified inception CNN with an attention mechanism that uses spatial attention in an intense structure to extract features from captured CSI signals. Finally, the refined features are exploited by the recognition section to determine HHIs correctly. To validate the performance of the proposed CSI-IANet, a publicly available HHIs CSI dataset with a total of 4800 trials of 12 interactions was used. The performance of the proposed model was compared to those of existing state-of-the-art methods. The experimental results show that CSI-IANet achieved an average accuracy of 91.30%, which is better than that of the existing best method by 5%.</description><identifier>ISSN: 2169-3536</identifier><identifier>EISSN: 2169-3536</identifier><identifier>DOI: 10.1109/ACCESS.2021.3134794</identifier><identifier>CODEN: IAECCG</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Accuracy ; Channel state information (CSI) ; convolution neural network (CNN) ; Data processing ; deep learning ; Feature extraction ; Feature recognition ; Hidden Markov models ; Human activity recognition ; inception module ; Low pass filters ; Machine learning ; Moving object recognition ; Multilayers ; Robot sensing systems ; Sensors ; spatial attention ; Wireless communication ; Wireless fidelity ; Wireless sensor networks</subject><ispartof>IEEE access, 2021, Vol.9, p.166624-166638</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c408t-a165106a1de4deea919e29bfb4757c6cc10e0f7f09785cba3f8c0b99317c82fc3</citedby><cites>FETCH-LOGICAL-c408t-a165106a1de4deea919e29bfb4757c6cc10e0f7f09785cba3f8c0b99317c82fc3</cites><orcidid>0000-0001-6513-1237 ; 0000-0002-1981-6582 ; 0000-0002-6849-2051</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9646919$$EHTML$$P50$$Gieee$$Hfree_for_read</linktohtml><link.rule.ids>314,780,784,4024,27633,27923,27924,27925,54933</link.rule.ids></links><search><creatorcontrib>Kabir, M. Humayun</creatorcontrib><creatorcontrib>Rahman, M. Hafizur</creatorcontrib><creatorcontrib>Shin, Wonjae</creatorcontrib><title>CSI-IANet: An Inception Attention Network for Human-Human Interaction Recognition Based on CSI Signal</title><title>IEEE access</title><addtitle>Access</addtitle><description>In recent years, Wi-Fi infrastructures have become ubiquitous, providing device-free passive-sensing features. Wi-Fi signals can be affected by their reflection, refraction, and absorption by moving objects in their path. The channel state information (CSI), a signal property indicator, of the Wi-Fi signal can be analyzed for human activity recognition (HAR). Deep learning-based HAR models can enhance performance and accuracy without sacrificing computational efficiency. However, to save computational power, an inception network, which uses a variety of techniques to boost speed and accuracy, can be adopted. In contrast, the concept of spatial attention can be applied to obtain refined features. In this paper, we propose a human-human interaction (HHI) classifier, CSI-IANet, which uses a modified inception CNN with a spatial-attention mechanism. The CSI-IANet consists of three steps: i) data processing, ii) feature extraction, and iii) recognition. The data processing layer first uses the second-order Butterworth low-pass filter to denoise the CSI signal and then segment it before feeding it to the model. The feature extraction layer uses a multilayer modified inception CNN with an attention mechanism that uses spatial attention in an intense structure to extract features from captured CSI signals. Finally, the refined features are exploited by the recognition section to determine HHIs correctly. To validate the performance of the proposed CSI-IANet, a publicly available HHIs CSI dataset with a total of 4800 trials of 12 interactions was used. The performance of the proposed model was compared to those of existing state-of-the-art methods. The experimental results show that CSI-IANet achieved an average accuracy of 91.30%, which is better than that of the existing best method by 5%.</description><subject>Accuracy</subject><subject>Channel state information (CSI)</subject><subject>convolution neural network (CNN)</subject><subject>Data processing</subject><subject>deep learning</subject><subject>Feature extraction</subject><subject>Feature recognition</subject><subject>Hidden Markov models</subject><subject>Human activity recognition</subject><subject>inception module</subject><subject>Low pass filters</subject><subject>Machine learning</subject><subject>Moving object recognition</subject><subject>Multilayers</subject><subject>Robot sensing systems</subject><subject>Sensors</subject><subject>spatial attention</subject><subject>Wireless communication</subject><subject>Wireless fidelity</subject><subject>Wireless sensor networks</subject><issn>2169-3536</issn><issn>2169-3536</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>DOA</sourceid><recordid>eNpNUdFKwzAULaLgmPuCvRR87kyaNGl8q2W6wlCw-hzS9GZ0bs1MO8S_N2vHMA83h3vPOcnlBMEcowXGSDxkeb4sy0WMYrwgmFAu6FUwiTETEUkIu_6Hb4NZ122RP6lvJXwSQF4WUZG9Qv8YZm1YtBoOfWPbMOt7aAfkZz_WfYXGunB13Ks2Gqrn9uCUHjjvoO2mbQb8pDqoQw-8dVg2m1bt7oIbo3YdzM73NPh8Xn7kq2j99lLk2TrSFKV9pDBLMGIK10BrACWwgFhUpqI84ZppjREgww0SPE10pYhJNaqEIJjrNDaaTINi9K2t2sqDa_bK_UqrGjk0rNtI5fpG70BywZRJE5bolFGGa6XAUMSBxLHgujp53Y9eB2e_j9D1cmuPzi_TyZhhQhgVVHgWGVna2a5zYC6vYiRP8cgxHnmKR57j8ar5qGoA4KIQ_iN-ZfIHet2Kkw</recordid><startdate>2021</startdate><enddate>2021</enddate><creator>Kabir, M. Humayun</creator><creator>Rahman, M. Hafizur</creator><creator>Shin, Wonjae</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7SR</scope><scope>8BQ</scope><scope>8FD</scope><scope>JG9</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0001-6513-1237</orcidid><orcidid>https://orcid.org/0000-0002-1981-6582</orcidid><orcidid>https://orcid.org/0000-0002-6849-2051</orcidid></search><sort><creationdate>2021</creationdate><title>CSI-IANet: An Inception Attention Network for Human-Human Interaction Recognition Based on CSI Signal</title><author>Kabir, M. Humayun ; Rahman, M. Hafizur ; Shin, Wonjae</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c408t-a165106a1de4deea919e29bfb4757c6cc10e0f7f09785cba3f8c0b99317c82fc3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Accuracy</topic><topic>Channel state information (CSI)</topic><topic>convolution neural network (CNN)</topic><topic>Data processing</topic><topic>deep learning</topic><topic>Feature extraction</topic><topic>Feature recognition</topic><topic>Hidden Markov models</topic><topic>Human activity recognition</topic><topic>inception module</topic><topic>Low pass filters</topic><topic>Machine learning</topic><topic>Moving object recognition</topic><topic>Multilayers</topic><topic>Robot sensing systems</topic><topic>Sensors</topic><topic>spatial attention</topic><topic>Wireless communication</topic><topic>Wireless fidelity</topic><topic>Wireless sensor networks</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Kabir, M. Humayun</creatorcontrib><creatorcontrib>Rahman, M. Hafizur</creatorcontrib><creatorcontrib>Shin, Wonjae</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE/IET Electronic Library</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>IEEE access</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Kabir, M. Humayun</au><au>Rahman, M. Hafizur</au><au>Shin, Wonjae</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>CSI-IANet: An Inception Attention Network for Human-Human Interaction Recognition Based on CSI Signal</atitle><jtitle>IEEE access</jtitle><stitle>Access</stitle><date>2021</date><risdate>2021</risdate><volume>9</volume><spage>166624</spage><epage>166638</epage><pages>166624-166638</pages><issn>2169-3536</issn><eissn>2169-3536</eissn><coden>IAECCG</coden><abstract>In recent years, Wi-Fi infrastructures have become ubiquitous, providing device-free passive-sensing features. Wi-Fi signals can be affected by their reflection, refraction, and absorption by moving objects in their path. The channel state information (CSI), a signal property indicator, of the Wi-Fi signal can be analyzed for human activity recognition (HAR). Deep learning-based HAR models can enhance performance and accuracy without sacrificing computational efficiency. However, to save computational power, an inception network, which uses a variety of techniques to boost speed and accuracy, can be adopted. In contrast, the concept of spatial attention can be applied to obtain refined features. In this paper, we propose a human-human interaction (HHI) classifier, CSI-IANet, which uses a modified inception CNN with a spatial-attention mechanism. The CSI-IANet consists of three steps: i) data processing, ii) feature extraction, and iii) recognition. The data processing layer first uses the second-order Butterworth low-pass filter to denoise the CSI signal and then segment it before feeding it to the model. The feature extraction layer uses a multilayer modified inception CNN with an attention mechanism that uses spatial attention in an intense structure to extract features from captured CSI signals. Finally, the refined features are exploited by the recognition section to determine HHIs correctly. To validate the performance of the proposed CSI-IANet, a publicly available HHIs CSI dataset with a total of 4800 trials of 12 interactions was used. The performance of the proposed model was compared to those of existing state-of-the-art methods. The experimental results show that CSI-IANet achieved an average accuracy of 91.30%, which is better than that of the existing best method by 5%.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/ACCESS.2021.3134794</doi><tpages>15</tpages><orcidid>https://orcid.org/0000-0001-6513-1237</orcidid><orcidid>https://orcid.org/0000-0002-1981-6582</orcidid><orcidid>https://orcid.org/0000-0002-6849-2051</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 2169-3536 |
ispartof | IEEE access, 2021, Vol.9, p.166624-166638 |
issn | 2169-3536 2169-3536 |
language | eng |
recordid | cdi_ieee_primary_9646919 |
source | IEEE Open Access Journals |
subjects | Accuracy Channel state information (CSI) convolution neural network (CNN) Data processing deep learning Feature extraction Feature recognition Hidden Markov models Human activity recognition inception module Low pass filters Machine learning Moving object recognition Multilayers Robot sensing systems Sensors spatial attention Wireless communication Wireless fidelity Wireless sensor networks |
title | CSI-IANet: An Inception Attention Network for Human-Human Interaction Recognition Based on CSI Signal |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-04T21%3A29%3A00IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_ieee_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=CSI-IANet:%20An%20Inception%20Attention%20Network%20for%20Human-Human%20Interaction%20Recognition%20Based%20on%20CSI%20Signal&rft.jtitle=IEEE%20access&rft.au=Kabir,%20M.%20Humayun&rft.date=2021&rft.volume=9&rft.spage=166624&rft.epage=166638&rft.pages=166624-166638&rft.issn=2169-3536&rft.eissn=2169-3536&rft.coden=IAECCG&rft_id=info:doi/10.1109/ACCESS.2021.3134794&rft_dat=%3Cproquest_ieee_%3E2613364949%3C/proquest_ieee_%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c408t-a165106a1de4deea919e29bfb4757c6cc10e0f7f09785cba3f8c0b99317c82fc3%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2613364949&rft_id=info:pmid/&rft_ieee_id=9646919&rfr_iscdi=true |