The opinions, hypotheses, conclusions, and recommendations of this study are those of the authors and do not necessarily represent the opinions of the funding agency. JRS is grateful to Sao Paulo Research Foundation (FAPESP, grant numbers 2021/05332-8, 2018/04654-9,&#160;2018/21934-5 and 2023/02538-0) and Jackson Cionek for technological support. AMM and Vivax Ltda are grateful to FAPESP (S&#227;o Paulo Research Foundation) and FINEP (Brazilian Innovation Agency). This project was funded with grants from FAPESP (grant number 2018/09559-4) and FINEP (grant number 2019/09933-6).

This study was approved by the local Ethics Review Board of the UNICEP (Centro Universitario Paulista). All participants provided informed consent following all institutional guidelines and federal norms regarding scientific research involving humans. They received no financial compensation, as required by Brazilian federal regulations.
1. fNIRS system
<ol>
	<li>Prepare the cap using 16 optodes: 8 light sources (760 nm and 850 nm) and 8 light detectors (see Figure 2; location of sources: FC1, FC2, C3, Cz, C4, CP1, CP2 and Pz; location of detectors (FCz, C1, C2, CPz, P1 and P3). Attach the eighth detector to the short-distance adaptor, which is connected to each of the source optodes.</li>
	<li>Open the fNIRS acquisition software and load the montage with the placement of each optode.</li>
	<li>Set fNIRS signal temporal sampling rate at 10.17 Hz.</li>
</ol>
2. Participants
<ol>
	<li>Briefly explain the research relevance and the experimental protocol to the participant.</li>
	<li>If the participant agrees to volunteer, ensure that the volunteer provides informed consent following all institutional guidelines and federal norms regarding scientific research involving humans.</li>
	<li>Instruct the volunteer to sit on an armchair in front of the robot, positioned approximately 150 cm away from the computer monitor.</li>
	<li>After removing the shoes, comfortably attach the participant&#39;s foot to the robot arm with Velcro (hook-and-loop fastener) straps (see Figure 1, top left panel).</li>
	<li>Place the fNIRS cap with the optodes in the participant&#39;s head and securely fasten it with the hook-and-loop fastener below the chin.</li>
	<li>Place the overcap onto the optode cap to reduce the interference of ambient light.</li>
</ol>
3. Data acquisition
<ol>
	<li>Instruct each participant not to make sudden head movements to minimize the risk of movement artifacts.</li>
	<li>Calibrate the fNIRS system for optimal signal quality.</li>
	<li>Certify that all channels are of good quality, as shown by the interface. If not, try to remove the hair between the scalp and the optode tip.</li>
	<li>Explain to the participant how to play the game by moving the foot attached to the robot to reach the targets indicated on the screen.</li>
	<li>Explain to the participants that there will be two conditions: without and with robotic assistance.</li>
</ol>
4. Robotic system
<ol>
	<li>Power up the system by connecting the monitor and the robot to the electric network source. After the operational system is initialized, the first game interface appears.</li>
	<li>Position the robotic arm in the standard location and wait to receive the robotic arm positioned correctly feedback message.</li>
	<li>Enter descriptive data about the participant and experimenter into the system to log in to the robot gaming interface.</li>
	<li>In the game selection interface, configure the session time to 6 min with 30 s rest intervals.</li>
	<li>Select the appropriate leg (right or left) to be used by the participant.</li>
	<li>Select the Picnic Game and click on Go to play the game.</li>
</ol>
5. Data analysis
<ol>
	<li>Convert the raw signals to hemodynamic states (oxyhemoglobin (HbO) and deoxyhemoglobin (HbR)) using the modified Beer-Lambert equation49.</li>
	<li>Create individual activation maps using the General Linear Model (GLM) with robust estimation and autocorrelation estimation, which is less affected by motion artifacts50. Use the experimental design (rest = 0; game/play = 1) convoluted by the canonical Hemodynamic Response Function (HRF) as the independent variable and the observed HbO or HbR signal as the dependent variable.</li>
	<li>For each channel, extract the beta coefficient (which reflects the strength of activation of the channel) during the game/play compared to the rest.</li>
	<li>Merge channels in three Regions of Interest (ROI) and average the activation coefficients (GLM betas) across the ROI channels. Define the ROIs as follows (see Figure 2): (1) premotor area for the left hemisphere (channels [FC1-FCz, C1-FC1, C1-Cz, C3-C1]); (2) somatomotor area for the left hemisphere (channels [C3-CP1, CP1-P1, CP1-CPz, P1-Pz]); and (3) supplementary motor area (SMA) (channels [Cz-FCz, CPz-Cz]). 
	NOTE: Based on previous literature on motor tasks similar to the one investigated herein51,52,53&#160;and given that all participants executed the motor task with their right leg, it was hypothesized that the left (contralateral) premotor and somatomotor, as well as SMA regions, would display activation during game/play performance in both conditions, with stronger activation in the unassisted condition.</li>
	<li>Apply the non-parametric Wilcoxon test to these betas. Set the Type I Error at 5% (one-tailed analysis).</li>
</ol>

Evaluating Brain Activation by fNIRS During a Lower Limb Robotic Therapy Session

AMM is the owner of Vivax Ltda company, which developed the Vivax Assistive Rehabilitation Machine (ARM). LD is an officer at Highland Instruments, a medical device company. She has patents pending or issued, personally or as an officer in the company, related to imaging, brain stimulation, diagnostics, modeling, and simulation. The other authors declare no conflict of interest.

In this proof-of-concept study, the feasibility of making inferences on brain activation mapping using fNIRS data from healthy subjects while they exercised with different types of movements using a robot for lower limb rehabilitation was investigated. Typical fNIRS recording sessions in adults are longer than 6 min54. However, to make recordings feasible in the context of a rehabilitation setting, the overall duration of the experiment must be minimized to avoid unnecessary fatigue and effort for...

Epidemiological data indicates that worldwide there are ~17 million new cases of stroke each year, with an increase in incidence in low- and middle-income countries1. The number of new cases is estimated to increase to 77 million by 20302. Motor impairment due to stroke often affects patient&#39;s mobility and participation in daily life activities, contributing to a low quality of life. Traditional motor rehabilitation includes manual therapy, but over the past few decades, robotic systems for rehabilitation have been developed. These systems can deliver therapy at high intensity, dose, quantifiability, reliability, repeatability, and flexibility3 and have shown potential as effective rehabilitation treatments for both acute and chronic stroke patients4,5,6. In addition to delivering therapy, robotic systems for rehabilitation can be used as evaluation tools as they can be equipped with sensors that can measure patient movement kinematic/kinetic data7,8. For upper extremity motor rehabilitation, such data has not only been proven to be useful for assessing the level of patient&#39;s motor recovery elicited by robotic therapy and served as a supplementary tool to traditional clinical assessments9,10, but it has also contributed to advancing the understanding of the process of motor recovery from stroke11,12 as well as neural control of movement and motor learning in healthy subjects3,13,14. As a result, these findings have provided a foundation for enhancing rehabilitation treatments15.
Over the last two decades, many robotic devices for lower limb neurorehabilitation have been proposed, spanning from exoskeletons that support the patient body weight during walking (e.g., over a treadmill, such as Lokomat16) to stationary robotic systems that allow the patient to exercise the ankle, knee or foot without walking (such as the Rutgers Ankle17, the High-Performance Ankle Rehabilitation Robot18, and the Gwangju Institute of Science and Technology (GIST) ankle/foot rehabilitation robot19) or active foot orthoses that are actuated exoskeletons worn by the patient to walk overground or over a treadmill (such as the Powered Gait Orthosis20&#160;and the MIT Anklebot21).&#160;See22,23,4 for a review on robots for lower limb rehabilitation.
Results of clinical studies of robotic devices for lower limb rehabilitation on stroke patients have been encouraging and have shown that these systems may improve joints&#39; Range of Motion (ROM), muscle strength, or gait, depending on the specific device and clinical protocol (see&#160;24,25&#160;for a review on the efficacy of lower limb robots for rehabilitation). While it has been postulated that robot-assisted therapy promotes neuroplastic changes, which ultimately result in improved motor abilities26, how the process of motor recovery from stroke exactly occurs and which robotic training protocols optimize the process of recovery of lower limb motor abilities, remain mostly unclear. In fact, there is a significant, growing disparity between the increasing development of rehabilitation robots (either by academic researchers or commercial entities) and the limited understanding of the neurophysiological mechanisms that underlie motor recovery4. Measurements of movement kinematics or joint torques taken with embedded sensors have contributed to quantitatively describing motor behavioral changes that occur as patients recover lower limb motor abilities27,28,29, partially filling this gap. However, the neural correlates underlying such changes have been less investigated. This is due to several reasons.
Brain functional imaging is time-consuming and sometimes difficult to complete in the context of clinical trials, which often require keeping patient burden minimal to maximize the likelihood of patient adherence to the study. This holds particularly true for individuals who have suffered a stroke, given the fact that post-stroke fatigue and muscle weakness are frequently observed30. Also, imaging modalities that are based on magnetic fields, such as functional Magnetic Resonance Imaging (fMRI), require both patient and robotic hardware to be magnet-safe.
Among non-invasive imaging modalities, functional Near-Infrared Spectroscopy (fNIRS) is an imaging technique particularly suitable for assessing areas of brain activation in subjects undergoing robotic therapy. Similarly to fMRI, fNIRS measures blood oxygenation/deoxygenation in the brain. However, unlike fMRI, fNIRS is fully compatible with robotic hardware, and it is often portable, even being usable at the bedside. Also, fNIRS has low cost and less sensitivity to motion artifacts31,32,33.
Despite its clear advantages and widespread use in many clinical settings since its first introduction in the late 70s34, only a few studies have used fNIRS to quantify brain activation associated with lower limb movements and stroke motor recovery. FNIRS studies aimed at elucidating mechanisms of neural control of movement and/or mechanisms or evaluation of motor recovery from stroke have mostly investigated single-joint movements (e.g., dorsiflexion, plantar flexion or knee extension movements35,36,37), walking38,39,40,41,42,43, or cycling44. See45&#160;for a review. Similarly, fNIRS studies on robot-assisted therapy for the lower limb have mostly focused on robot-assisted gait rehabilitation; see46&#160;for a review. A few studies have focused on using fNIRS as part of a Brain-Computer Interface (BCI) system to derive control signals for robotic devices47,48; while this research area also relies on the processing of fNIRS signals, its goal is different and mainly&#160;focused on decoding patient intentions (e.g., patients with severe motor disabilities).
The pilot study presented herein is part of an initial effort to investigate the effects of a robotic system for lower limb rehabilitation. The robot can deliver target-oriented lower limb rehabilitation that involves training in everyday multi-joint movements as well as deliver therapy to single joints (e.g., knee or ankle) of the lower limb (i.e., implement a bottom-up rehabilitation program).
The study aimed to investigate the feasibility of an experimental protocol that required the acquisition of fNIRS data during the performance of lower limb, multi-joint pointing movements. The duration of the data acquisition period in this study, which was limited to 6 min, is shorter than typical fNIRS protocols. This was a deliberate choice made with the aim of enhancing the practicality and clinical applicability of this research, particularly in patients with limited mobility or strength. Identifying fNIRS correlates of such complex multi-joint movements and gaining insights into how brain activation was modulated by robot assistance were also points of interest. For this purpose, two sessions of experiments were conducted with the same participants: one with no robot assistance and one with robot assistance. Finally, it is important to remark that this study focused on healthy subjects in order to establish a foundation for future research in terms of recording protocol feasibility and evaluation of brain activation during movements targeted by robotic therapy.
Apparatus 
A portable robot designed to deliver lower limb rehabilitation (see Figure 1) was used to conduct our experiments. The robot has a 3D reachable workspace and is compact and light, weighing about 35 lb., which makes it easy to transport and install.
<img alt="Figure 1" class="xfigimg" src="/files/ftp_upload/66004/66004fig01.jpg" /> 
Figure 1: Experimental setup. (A) The robotic system (installed on the floor) designed for the lower limb. A volunteer is shown utilizing the interface with their right foot. (B) Support structure for the subject&#39;s foot that enables attachment to the robotic system. (C) A screenshot of the Picnic game. The objective of the game is to move the foot (green and white shoe) to the target (yellow circle). <a href="https://www.jove.com/files/ftp_upload/66004/66004fig01large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
The robotic system is designed to assist a patient in performing lower limb movements similar to those performed in everyday tasks, such as pointing or kicking. It uses interactive virtual reality games, which are displayed on a computer monitor or a television screen placed in front of the robotic device (see Figure 1). The robot-end effector is attached to the patient&#39;s lower limb (e.g., ankle), and its position is mapped to the position of a cursor on the screen. A typical game shows the patient movement targets (e.g., the object to point to or where to kick the ball).
To complete the movement task, the robot may assist the patient with a level of assistance that can range from full assistance to none. The level of robotic assistance is chosen at the beginning of each rehabilitation session based on the patient&#39;s level of motor impairment. The movements performed by the subject are used by the game to score the patient&#39;s performance and provide them feedback on their performance (e.g., ROM, number of movements, and level of robotic assistance). The games are designed to be interactive and entertaining to sustain patient interest and attention. In this study, participants played the &#34;Picnic game&#34;, in which the player had to stop the insects from reaching the towel and stealing the food (see Figure 1, bottom panel, for a screenshot).
Data acquisition was performed with a portable fNIRS acquisition system with two different continuous-wave optodes (760 nm and 850 nm), 8 dual-tip LED sources, and 8 dual-tip active detectors. The signals were acquired using a sampling rate of 10.17 Hz. A laptop was used for the calibration optimization and signal recording using a Wi-Fi network created by the fNIRS system.
A cap was used to hold the optodes in the predetermined locations. The sources and detectors were placed according to the 10-10 international EEG system in a grid spatial distribution. Each fNIRS channel was defined by a source-detector pair with inter-optode distances of approximately 30 mm. The optodes were placed over the supplementary motor, premotor, and motor areas at the locations shown in Figure 2. The total number of channels was 28, where 8 were short-distance channels that were coupled to each source using a fiber optics adapter to a single detector. Given the multiplexing setup of the hardware, it is possible to acquire short-distance information from all sources using only one detector.
<img alt="Figure 2" class="xfigimg" src="/files/ftp_upload/66004/66004fig02.jpg" /> 
Figure 2: Montage layout using the 10-10 EEG system. The letters and numbers indicate the source/detector locations. The red and blue dots represent the source and detector optodes, respectively. The green lines represent the fNIRS channels which consist of source and detector pairs. <a href="https://www.jove.com/files/ftp_upload/66004/66004fig02large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
Experimental design 
The experiment was conducted under two distinct experimental conditions, differing in the level of assistance provided by the robot for the subject&#39;s movements. In the first condition, the robot was programmed not to provide any assistance to the subject&#39;s movements, while in the second condition, the robot controlled the subject&#39;s foot and leg movements (robot-assisted movement).
Each experiment followed a block design paradigm involving alternating cycles of a motor task (playing the game - 30 s) and resting (30 s), as illustrated in Figure 3. The starting and conclusion of each phase (play/game or rest) were visually signaled to the subject through the computer screen. During the rest phase, a message indicating a pause was displayed. Each cycle (play/game + rest) had a duration of 60 s and was repeated six times, resulting in a total runtime of 360 s (6 min).
The participants played the &#34;Picnic game&#34;, wherein the objective was to prevent insects from reaching the towel and stealing food. This game involved a sequence of lower limb movements, starting from a designated home target (initial position) and extending towards one of three outer targets before returning to the home target. On the screen, the outer targets were visually represented as animated moving insects, which the participants had to reach and step onto. There were three outer-reaching targets, each randomly presented an equal number of times, alongside a common home target for every movement. The distance that the foot needed to travel from the home target to the position of the outer targets formed an arc, approximately measuring 26 cm. The motor task required the execution of multi-joint movements, demanding coordination between knee flexion/extension, plantar flexion, and dorsiflexion movements.
The fNIRS data recordings were synchronized with the visual stimuli presented by the game to the subject through a transistor-transistor-logic (TTL) pulse generated by the robot. Pulses were generated at the outset of each phase (play/game and rest). Thus, all timing control was performed by the game, which provided visual cues (targets) to the participant to start each movement, sent TTL signals to the fNIRS system to mark the brain activity recordings, and, if required by the experiment, sent signals to the robot control system to initiate movement assistance.

<table border="1" fo:keep-together.within-page="1" fo:keep-with-next.within-page="always">
	<tbody>
		<tr>
			<td>32 inch Smart TV</td>
			<td>Samsung</td>
			<td>N/A</td>
			<td>TV connected to robot via HDMI cable</td>
		</tr>
		<tr>
			<td>8-detector silicon photodiode (SiPD) optodes for optical detection with dual tip</td>
			<td>NIRx Medical Technologies (Glen Head, NY, USA)</td>
			<td>https://nirx.net/nirsport</td>
			<td></td>
		</tr>
		<tr>
			<td>8-source optodes bundle for optical illumination with dual tip</td>
			<td>NIRx Medical Technologies (Glen Head, NY, USA)</td>
			<td>https://nirx.net/nirsport</td>
			<td></td>
		</tr>
		<tr>
			<td>Aurora acquisition software</td>
			<td>NIRx Medical Technologies (Glen Head, NY, USA)</td>
			<td>https://nirx.net/nirsport</td>
			<td></td>
		</tr>
		<tr>
			<td>Laptop Precision XPS 13</td>
			<td>Dell Technologies (Round Rock, TX, USA)</td>
			<td></td>
			<td></td>
		</tr>
		<tr>
			<td>nirsLAB fNIRS Analysis software</td>
			<td>NIRx Medical Technologies (Glen Head, NY, USA)</td>
			<td>https://nirx.net/nirsport</td>
			<td></td>
		</tr>
		<tr>
			<td>NIRSports2 fNIRS acquisition system</td>
			<td>NIRx Medical Technologies (Glen Head, NY, USA)</td>
			<td>https://nirx.net/nirsport</td>
			<td>It has two different continuous wave optics (760 and 850 nm), 8 dual-ended LED sources and 8 dual-ended active detectors.</td>
		</tr>
		<tr>
			<td>R</td>
			<td>R-project.org (open source software)</td>
			<td>https://www.r-project.org/</td>
			<td></td>
		</tr>
		<tr>
			<td>Standard cut cap, black color for up to 128 holders.</td>
			<td>Easycap GmbH (W&#246;rthsee, Germany)</td>
			<td>https://www.easycap.de/</td>
			<td></td>
		</tr>
		<tr>
			<td>Vivax Assistive Rehabilitation Machine (ARM)&#160;</td>
			<td>Vivax Ltda (S&#227;o Paulo, Brazil)</td>
			<td>https://vivaxbr.com/home/</td>
			<td>It is a portable robot designed to deliver lower limb rehabilitation. It has a 3D reachable workspace and is compact and light, weighing about 35 lb., which makes it easy to transport and to install.&#160;</td>
		</tr>
	</tbody>
</table>

an experiment using functional near-infrared spectroscopy and robot-assisted multi-joint pointing movements of the lower limb

Stroke affects approximately 17 million individuals worldwide each year and is a leading cause of long-term disability. Robotic therapy has shown promise in helping stroke patients regain lost motor functions. One potential avenue for increasing the understanding of how motor recovery occurs is to study brain activation during the movements that are targeted by therapy in healthy individuals. Functional Near-Infrared Spectroscopy (fNIRS) has emerged as a promising neuroimaging technique for examining neural underpinnings of motor function. This study aimed to investigate fNIRS neural correlates of complex lower limb movements in healthy subjects. Participants were asked to perform cycles of rest and movement for 6 min using a robotic device for motor rehabilitation. The task required coordinated knee and ankle joint movements to point to targets displayed on a computer screen. Two experimental conditions with different levels of movement assistance provided by the robot were explored. The results showed that the fNIRS protocol effectively detected brain regions associated with motor control during the task. Notably, all subjects exhibited greater activation in the contralateral premotor area during the no-assistance condition compared to the assisted condition. In conclusion, fNIRS appears to be a valuable approach for detecting changes in oxyhemoglobin concentration associated with multi-joint pointing movements of the lower limb. This research might contribute to the understanding of stroke motor recovery mechanisms and might pave the way for improved rehabilitation treatments for stroke patients. However, further research is needed to fully elucidate the potential of fNIRS in studying motor function and its applications in clinical settings.

Author Spotlight: Assessing Brain Activity in Robotic-Assisted Lower Limb Rehabilitation Using fNIRS

An Experiment Using Functional Near-Infrared Spectroscopy and Robot-Assisted Multi-Joint Pointing Movements of the Lower Limb

In this study, we aim to investigate the feasibility of an experimental protocol involving movements of the lower limb attached to a robotic device and simultaneous acquisition of functional near-infrared spectroscopy, fNIRS, data. Few studies have employed fNIRS to study brain activation in stroke, motor recovery, and lower limb movements, focusing mainly on single joint actions, walking, or cycling. Our study pioneers in exploring multi-joints lower limb training for target rehabilitation.Functional near-infrared spectroscopy, fNIRS, effectively measures temporal changes in brain blood oxygenation, serving as an indirect brain activity indicator, to functional MRI signals. Unlike fMRI, fNIRS is compatible with robotic hardware, portable, and more robust to motion artifacts. There are two main challenge.The first is to synchronize the robotic device movements with fNIRS data. The second is to obtain enough data to achieve the statistical power, to detect hemodynamic changes in only six minutes. Our study confirmed the feasibility of the protocol and yielded anticipated results.In the assisted condition, only two subject exhibited significant brain activation. The unassisted exercise, requiring more effort, showed a greater HbO concentration change than assisted ones, with notable difference in the contralateral PMC.

All six subjects completed both experiments. In the no-assistance condition, an average of 76.67 trials (std. 10.73) was completed by each subject (note, for each subject, the number of trials depended on the number of successful reaches since a new target was only shown if the previous one was reached). In the assistance condition, where the subject&#39;s movement was fully aided by the robot, all subjects completed 70 trials. fNIRS data was successfully recorded from all subjects.
<strong cl...

It is estimated that 1 in 6 individuals worldwide will have a stroke in their lifetime, causing long-term disability, whose rehabilitation mechanisms are still poorly understood. This study proposes a protocol to evaluate brain activation by functional near-infrared spectroscopy (fNIRS) during a lower limb robotic therapy session.

Stroke affects approximately 17 million individuals worldwide each year and is a leading cause of long-term disability. Robotic therapy has shown promise ...

an-experiment-using-functional-near-infrared-spectroscopy-robot

Research

JoVE Journal

Neuroscience

1.1K ビュー.  Universidade Federal do ABC. 本研究では、ロボット装置に装着した下肢の運動と機能的近赤外分光法(fNIRS)データの同時取得を含む実験プロトコルの実現可能性を検討する。脳卒中、運動回復、下肢運動における脳の活性化を研究するためにfNIRSを採用した研究はほとんどなく、主に単一関節動作、歩行、またはサイクリングに焦点を当てています。私たちの研究は、ターゲットリハビリテーション?...