Integrated Circuits and Systems >
A Multi-Modal System Featuring Wireless Flexible Sensor Patches and a Depth-Sensing Imager for Home-Based Monitoring of Rehabilitation Exercises
![]() |
Runtian Yang https://orcid.org/0009-0008-5889-4234 The Edward S. Rogers Sr. Department of Electrical and Computer Engineering (ECE), University of Toronto, Toronto, ON, Canada Runtian Yang (Student Member,, IEEE) is currently working toward the undergraduate degree in computer engineering with the Edward S. Rogers Sr. Department of Electrical and Computer Engineering (ECE), University of Toronto (UofT), Toronto, ON, Canada. He was at XLab, UofT, under the supervision of Prof. Xilin Liu from May 2023 to August 2024 and started working with LinLab, UofT, under the supervision of Prof. Qian Lin in September 2024. His research interests include software and hardware design for brain computer interfaces and in-vivo neural imaging and stimulation. |
![]() |
Yuhan Hou https://orcid.org/0009-0006-6138-8573 The Edward S. Rogers Sr. Department of Electrical and Computer Engineering (ECE), University of Toronto, Toronto, ON, Canada Yuhan Hou (Graduate Student Member,, IEEE) received the Bachelor of Science degree in electrical engineering from the University of Toronto, Toronto, ON, Canada, in 2023. She is currently working toward the Ph.D. degree with the Edward S. Rogers Sr. Department of Electrical and Computer Engineering, University of Toronto. She completed a 16-month internship with Alphawave Semi, Toronto, from May 2021 to August 2022, as a Hardware Validation Engineer. She has authored papers published at the International Solid-State Circuits Conference (ISSCC), in IEEE Transactions on Biomedical Circuits and Systems (TBioCAS), and others. Her research interests include analog and mixed-signal integrated circuits design and miniature system integration for neural interfaces, wearable devices, and other biomedical applications. |
![]() |
Savanna Blade https://orcid.org/0009-0004-9772-3543 The Edward S. Rogers Sr. Department of Electrical and Computer Engineering (ECE), University of Toronto, Toronto, ON, Canada Savanna Blade (Student Member,, IEEE) received the B.A.Sc. (Hons.) degree in engineering science with specializations in robotics and artificial intelligence from the University of Toronto, Toronto, ON, Canada, in 2023, where she is currently working toward the M.A.Sc. degree in electrical and computer engineering. Her research interests include embedded systems design and edge-AI development for closed-loop brain-computer interfaces. |
![]() |
Yinfei Li The Edward S. Rogers Sr. Department of Electrical and Computer Engineering (ECE), University of Toronto, Toronto, ON, Canada Yinfei Li received the Bachelor of Science degree in physics and mechanical engineering from the University of North Carolina at Charlotte, Charlotte, NC, USA, in 2022, and the Master of Engineering degree in computer engineering from the University of Toronto, Toronto, ON, Canada, in 2024. He was at X-lab, University of Toronto, from 2023 to 2024. His expertise is embedded software development, Linux kernel configuration and management, and bioelectronics for brain-machine interfaces. |
![]() |
Vansh Tyagi https://orcid.org/0009-0004-5991-7005 The Edward S. Rogers Sr. Department of Electrical and Computer Engineering (ECE), University of Toronto, Toronto, ON, Canada Vansh Tyagi received the Bachelor of Science degree in electrical and computer engineering from the University of Wisconsin—Madison, Madison, WI, USA, in 2022. He is currently working toward the Master of Engineering degree in electrical and computer engineering with the University of Toronto, Toronto, ON, Canada. His area of expertise is in real-time embedded system development. |
![]() |
Gloria-Edith Boudreault-Morales https://orcid.org/0009-0001-0421-1409 Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada Gloria-Edith Boudreault-Morales was born in Montreal, Canada, in 1999. She received the B.A.Sc degree in mechanical engineering and the M.A.Sc degree in biomedical engineering from the University of Toronto, Toronto, ON, Canada, in 2022 and 2024, respectively. She was a graduate student at KITE, Toronto Rehabilitation Institute -University Health Network, Toronto, under the supervision of Dr José Zariffa. The focus of her research was on lightweight monocular RGB human pose estimation models, where she investigated the effect of depth data and physical impairments on model performances. |
![]() |
José Zariffa https://orcid.org/0000-0002-8842-745X The Edward S. Rogers Sr. Department of Electrical and Computer Engineering (ECE), University of Toronto, Toronto, ON, Canada Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada KITE Research Institute, Toronto Rehabilitation Institute -University Health Network (UHN), Toronto, ON, Canada José Zariffa (Senior Member,, IEEE) received the Ph.D. degree from the Department of Electrical and Computer Engineering and the Institute of Biomaterials and Biomedical Engineering, University of Toronto, Toronto, ON, Canada, in 2009. He completed Postdoctoral fellowships at International Collaboration On Repair Discoveries (ICORD), Vancouver, BC, Canada, and the Toronto Rehabilitation Institute, University Health Network, Toronto. He is currently a Senior Scientist with KITE, Toronto Rehabilitation Institute, University Health Network, Toronto, and an Associate Professor with the Institute of Biomedical Engineering, University of Toronto. His research focuses on neuroprosthetics and technology for upper limb neurorehabilitation, encompassing work in wearable sensors, neural interfaces, electrophysiology, and machine learning. Dr. Zariffa holds the KITE Chair in Spinal Cord Injury Research. In 2021, his team was awarded the Grand Prize in the Spinal Cord Rehab Innovation Challenge. He is an Associate Editor for the Journal of Neuroengineering and Rehabilitation. |
![]() |
Xilin Liu https://orcid.org/0000-0002-9547-3905 The Edward S. Rogers Sr. Department of Electrical and Computer Engineering (ECE), University of Toronto, Toronto, ON, Canada KITE Research Institute, Toronto Rehabilitation Institute - University Health Network (UHN), Toronto, ON, Canada Xilin Liu (Senior Member,, IEEE) received the Ph.D. degree from the University of Pennsylvania, Philadelphia, PA, USA, in 2017. He held industrial positions at Qualcomm Inc., San Diego, CA, USA. He is currently an Assistant Professor with the Edward S. Rogers Sr. Department of Electrical and Computer Engineering (ECE), University of Toronto, Toronto, ON, Canada. He is also an affiliated Scientist with the University Health Network (UHN), Toronto. His research interests include analog and mixed-signal IC design for biomedical circuits and systems, especially for neural interfacing and neuromodulation. He is an Associate Editor for IEEE Transactions of Biomedical Circuits and Systems (TBioCAS) and IEEE Transactions on Circuits and Systems II: Express Briefs (TCAS-II). He was on the committees of several CASS and SSCS conferences. |
Received date: 2024-11-11
Revised date: 2024-11-29
Accepted date: 2024-12-02
Online published: 2025-01-09
Monitoring rehabilitation progress at home over the long term following a spinal cord injury (SCI) is crucial for maximizing therapeutic outcomes and enhancing the quality of life of affected individuals. Comprehensive monitoring requires collecting a range of physiological data, including surface electromyography (sEMG) and exercise motion data. Currently, assessments typically take place in clinical settings, which can be both costly and inconvenient for patients. There is a lack of accessible, user-friendly systems that allow individuals with SCI to independently gather this data at home. Additionally, video recordings may be necessary to verify that patients are positioning the sensors correctly and performing the exercises accurately. To bridge this gap, we have developed a self-contained, multi-modal sensor system that captures sEMG and motion data, along with depth-sensing video to track patient exercises while ensuring privacy by minimizing identifiable details. The system includes a configurable number of wireless, multisensor wearable patches that are easy to attach and comfortable for extended use, along with a time-of-flight depth-sensing camera. The multi-modal data is streamed and synchronized in real-time on a Raspberry Pi, establishing an innovative platform to support SCI rehabilitation and adaptable for various clinical monitoring applications.
RUNTIAN YANG , YUHAN HOU , SAVANNA BLADE , YINFEI LI , VANSH TYAGI , GLORIA-EDITH BOUDREAULT-MORALES , JOSÉ ZARIFFA , XILIN LIU . A Multi-Modal System Featuring Wireless Flexible Sensor Patches and a Depth-Sensing Imager for Home-Based Monitoring of Rehabilitation Exercises[J]. Integrated Circuits and Systems, 2024 , 1(4) : 227 -238 . DOI: 10.23919/ICS.2024.3512503
[1] |
|
[2] |
AANS,“Spinal cord injury,” 2024. Accessed: Dec. 15, 2024. [Online].
|
[3] |
World Health Organization,“Spinal cord injury,” 2024. Accessed: Dec. 15, 2024. [Online].
|
[4] |
|
[5] |
|
[6] |
|
[7] |
|
[8] |
|
[9] |
|
[10] |
|
[11] |
|
[12] |
|
[13] |
|
[14] |
|
[15] |
|
[16] |
|
[17] |
OpenBCI,“Cyton + daisy biosensing boards (16-channels),” Accessed: Dec. 15, 2024. [Online].
|
[18] |
|
[19] |
MyoVision,“Myovision scanvision EMG system,” 2024, Accessed: Nov. 9, 2024. [Online].
|
[20] |
|
[21] |
|
[22] |
|
[23] |
|
[24] |
|
[25] |
|
[26] |
Arducam,“Time of flight (ToF) camera for raspberry pi,” Accessed: Dec. 15, 2024. [Online].
|
[27] |
|
[28] |
|
[29] |
|
/
〈 |
|
〉 |