A subscription to JoVE is required to view this content. Sign in or start your free trial.

In This Article

  • Summary
  • Abstract
  • Introduction
  • Protocol
  • Results
  • Discussion
  • Disclosures
  • Acknowledgements
  • Materials
  • References
  • Reprints and Permissions

Summary

This protocol describes how synchronized electroencephalography, electrocardiography, and behavioral recordings were captured from infant-caregiver dyads in a home setting.

Abstract

Prior hyperscanning studies that record the brain activities of caregivers and children concurrently have primarily been conducted within the confines of the laboratory, thus limiting the generalizability of results to real-life settings. Here, a comprehensive protocol for capturing synchronized electroencephalography (EEG), electrocardiography (ECG), and behavioral recordings from infant-caregiver dyads during various interactive tasks at home is proposed. This protocol demonstrates how to synchronize the different data streams and report EEG data retention rates and quality checks. Additionally, critical issues and possible solutions with respect to the experimental setup, tasks, and data collection in home settings are discussed. The protocol is not limited to infant-caregiver dyads but can be applied to various dyadic constellations. Overall, we demonstrate the flexibility of EEG hyperscanning setups, which allow experiments to be conducted outside of the laboratory to capture participants' brain activities in more ecologically valid environmental settings. Yet, movement and other types of artifacts still constrain the experimental tasks that can be performed in the home setting.

Introduction

With the simultaneous recording of brain activities from two or more interacting subjects, also known as hyperscanning, it has become possible to elucidate the neural basis of social interactions in their complex, bidirectional, and fast-paced dynamics1. This technique has shifted the focus from studying individuals in isolated, tightly controlled settings to examining more naturalistic interactions, such as parent-child interactions during free play2,3, puzzle-solving4, and cooperative computer games5,6. These studies demonstrate that brain activities synchronize during social interactions, i.e., show temporal similarities, a phenomenon termed interpersonal neural synchrony (INS). However, the great majority of hyperscanning studies have been confined to laboratory settings. While this allows for better experimental control, it may come at the expense of losing some ecological validity. Behaviors observed in the laboratory may not be representative of the participants' typical everyday interactive behaviors due to the unfamiliar and artificial setting and the nature of the tasks imposed7.

Recent advances in mobile neuroimaging devices, such as electroencephalography (EEG) or functional near-infrared spectroscopy (fNIRS), alleviate these issues by removing the requirement for participants to remain physically connected to the recording computer. Thus, they allow us to measure participants' brain activities while they interact freely in the classroom or in their homes8,9. The advantage of EEG compared to other neuroimaging techniques, such as fNIRS, is that it has an excellent temporal resolution, which makes it particularly suitable for investigating fast-paced social dynamics10. Yet, it comes with the caveat that the EEG signal is highly vulnerable to motion and other physiological and non-physiological artifacts11.

Despite this, the first studies have successfully implemented EEG hyperscanning set-ups in realistic environments and conditions. For instance, Dikker et al.12 measured the EEG signal of a group of students while they engaged in various classroom activities, including attending lectures, watching videos, and participating in group discussions. This study, along with other studies8,9, has predominantly utilized dry EEG electrodes to ease the process of conducting measurements in non-laboratory settings. Compared to wet electrodes, which require the application of conductive gel or paste, dry electrodes offer notable advantages in terms of usability. They have been shown to exhibit comparable performance to wet electrodes in adult populations and stationary conditions; however, their performance may decrease in motion-related scenarios due to increased impedance levels13.

Here, we present a working protocol to capture synchronized recordings from a low-density seven-channel liquid gel EEG system with a single lead electrocardiography (ECG) connected to the same wireless amplifier (sampling rate: 500 Hz)Β of infant-caregiver dyads in a home setting. While active electrodes were used for adults, passive electrodes were used instead for infants since the latter typically comes in the form of ring electrodes, thereby easing the process of gel application. Additionally, EEG-ECG recordings were synchronized to three cameras and microphones to capture the participants' behaviors from different angles. In the study, 8-12-month-old infants and their caregivers engaged in a reading and play task while their EEG, ECG, and behaviors were recorded. To minimize the impact of excessive movement on EEG signal quality, the tasks were conducted in a table-top setting (e.g., utilizing the kitchen table and an infant highchair), requiring participants to remain seated throughout the interaction task. Caregivers were provided with three age-appropriate books and table-top toys (equipped with suction cups to prevent them from falling). They were instructed to read to their child for approximately 5 min, followed by a 10 min play session with the toys.

This protocol details the methods for collecting synchronized EEG-ECG, video, and audio data during the reading and play tasks. The overall procedure, however, is not specific to this research design but is appropriate for different populations (e.g., parent-child dyads, friend dyads) and experimental tasks. The method of synchronization of different data streams will be presented. Further, a basic EEG preprocessing pipeline based on Dikker et al.12 will be outlined, and EEG data retention rates and quality control metrics will be reported. Since the specific analytical choices depend on a variety of factors (such as task design, research questions, EEG montage), hyperscanning-EEG analysis will not be detailed further, but instead, the reader will be referred to existing guidelines and toolboxes (e.g.,14 for guidelines;15,16 for hyperscanning analysis toolboxes). Finally, the protocol discusses challenges and potential solutions for EEG-ECG hyperscanning in the home and other real-world settings.

Protocol

The protocol described has been approved by the Institutional Review Board (IRB) of the Nanyang Technological University, Singapore. Informed consent was obtained from all adult participants and from parents on behalf of their infants.

1. Considerations of equipment and space at home sessions

  1. Prepare for differing humidity and temperature conditions depending on country and season. For environments with high temperature and humidity levels, ensure that there is adequate airflow and switch on the air conditioning unit at home if possible.
  2. Maintain distance from WiFi transmitters, Bluetooth equipment (e.g., mobile phones, keyboard, mouse, etc.), and microwave ovens, as nearby machinery operating in the same frequency band can cause interference. Additionally, try to keep the experimental setup away from charging devices in the house, as this could cause significant power-line noise in the data. Note that nearby standing fans or ceiling fans at high speeds could cause the EEG cables to sway and contribute to mechanical artifacts.
  3. Prepare a conducive space for the experiment to be held within the participant's home. Ensure that the testing area has sufficient clear space to accommodate one caregiver and one infant in a highchair seated around a table, as well as three cameras on tripods. Clear all items from the table, if possible, to reduce any potential distractions.
  4. Ensure that there is adequate brightness in the testing area for the camcorders to capture the participant's expressions. If the tables are close to windows, do not position the camcorders facing the window to prevent lens glare.

2. Preparations before the session

  1. Inform the participants that for the EEG measurement, adults are required to wash their hair the day before the session without applying hair products. Ask if they could refrain from wearing makeup on the day of the EEG session.
  2. Ensure that all recording equipment (microphones and camcorders), laptops, amplifiers, and the power bank used by the trigger box are charged the day before the session. Check that all equipment is fully charged a few hours before the session. Carry chargers or preferably portable power banks for unexpected cases of low battery levels in the equipment.
  3. Pack all the necessary forms and recording equipment for the session.

3. Experiment preparation at the participant's home

  1. EEG gelling preparation
    1. Put on a pair of gloves when handling the gel. Fill four syringes with gel, two syringes with the blunt tip for the passive electrodes, and two syringes with the finer tip for the active electrodes.
    2. Prepare two square pieces of masking tape for the infant and adult ECG electrodes.
  2. Recording equipment preparation
    1. Remove gloves when handling electronic equipment.
    2. Turn on all the laptops and attach the EEG dongles to the respective laptops. Ensure that the EEG recording software is running.
    3. Connect the adult and infant amplifiers to the EEG recording software on the respective laptops via a wireless connection.
    4. Check and ensure that both the amplifiers (adult and infant) have the same trigger port settings, i.e., whether the trigger marker is produced at the rising (high-active) or falling edge (low-active) of the input pulse.
    5. Mount the three camcorders on each tripod. Ensure that each camcorder captures the caregiver, infant, and both caregiver and infant (combined view), respectively (see Figure 1). Before starting the session, ensure that the camcorder's angles can consistently capture the participants' faces, considering that the caregiver often moves down to the infant's eye during interactions.
  3. Place the infant's highchair and the caregiver's chair at the edge of their table so that they face each other at an angle at which the camcorders can catch their facial expressions (see Figure 1). If there isn't enough space on the table, place the infant's highchair and the caregiver's chair beside one another at a right angle.

figure-protocol-4501
Figure 1: Top-down view of set up. (1) Infant-facing camcorder. (2) Combined view camcorder. (3) Caregiver-facing camcorder. Please click here to view a larger version of this figure.

4. EEG and ECG sensor application for the caregiver

  1. Securely attaching the amplifier to the EEG cap
    1. For the caregiver, use the back pocket of the EEG cap to store the amplifier in order to reduce cable movement and EEG noise. Before applying the cap to the participant, ensure that the amplifier has been securely stored and attached to the connector.
    2. Ensure that there is no contact with water while handling the amplifier (i.e., remove gloves if soaked in gel).
  2. Request the caregiver to remove their glasses, mask, or earrings. If their hair is tied up, ask them to remove the hairband to have their hair down.
  3. While wearing gloves and with the caregiver's permission, clean the forehead using alcohol swabs (70 % isopropyl alcohol (IPA)).
  4. On both sides of the caregiver's head, part the hair at the topmost point of the ear to ensure that the ear is fully visible, following natural hair separation lines.
  5. Measure the caregiver's head circumference by placing the measuring tape around four reference points on the head: the nasion (eyebrow level), over the crest of the inion (the highest point at the back of the head), and between the left and right tragus (the tips of the ears).
  6. Stretch the EEG cap from the inside with a crown-like hand gesture and begin placing the cap from the caregiver's forehead towards the back of their head. Without letting go of the cap, slide hands down to hold the straps, pull them down towards their chin, and fasten the hook and loop ends. Adjust the straps according to the participant's comfort.
    1. Ensure that any bangs or strands of hair on the participant's face are removed away from the face to prevent discomfort or obstruction of vision.
    2. Gently smooth down the cap to ensure that the electrodes lie in close contact with the scalp. Ensure that there are no wrinkles on the cap.
  7. Place the measuring tape over the electrodes at the midline and measure the distance between the nasion and the inion. Ensure that the Cz electrode of the international 10-20 system is at the midpoint of the measurement. Use the scrunch and release method to shift the positions of the cap back and forth if needed.
  8. Measure the distance between the left and right tragus to ensure that the Cz electrode corresponds to the midpoint of the measurement and adjust if needed.
  9. EEG and ECG gel application
    1. Begin by applying gel to the reference and ground electrodes. Proceed to gel the remaining electrodes. Start with the electrodes at the back because it may take longer for the impedance to reduce to an acceptable range (typically < 25 kΞ©) since adults typically have more hair at the back.
    2. When applying gel on the caregiver, use a syringe with a longer and finer tip. Insert the syringe tip into the electrode opening and part the hair using the bottom curve of the syringe. Squirt small amounts of gel as the syringe is drawn out. If there is a large gap between the scalp and the electrode, firmly press down on the electrode to ensure contact.
    3. Use light as an impedance reference guide if the given active electrode setup allows for that. Alternatively, refer to the impedance readings on the EEG recording software to identify which electrodes require contact improvement.
      NOTE: Electrodes with low impedance and good signal quality (ensured by checking for artifacts before starting the session) will be colored green on the cap and/or on the EEG montage. If the impedance for an electrode is high, repeat the effort to separate the hair and move the gel in the electrode well to the point of clear contact with the scalp.
    4. Note that the cap usually does not perfectly fit each head, and concave areas of the head may cause a natural gap between the electrode and scalp. If impedance remains high, apply a small mound of gel to ensure a gel bridge between the electrode and the scalp. Be careful not to move the gel sideways after this to avoid bridging with neighboring electrodes underneath the cap.
    5. Be mindful not to overfill the wells with gel to prevent bridging across adjacent electrodes over the cap as well.
    6. Once all the EEG electrodes have low impedance, clean the soft area under the participant's left collarbone using alcohol wipes and begin to attach the ECG electrode.
      1. Attach a circular tape to the bottom of the ECG electrode and apply enough gel to cover the well of the electrode.
      2. Attach the electrode to the soft area under the left clavicle. Apply white masking tape on the top of the sensor.

5. EEG and ECG sensor application for the infant

  1. Ask the caregiver to help the infant wear a vest, which is provided by the experimenters, with a back pocket, which will later store the amplifier.
  2. With the caregiver's permission, clean the forehead using alcohol wipes. Measure the infant's head circumference by placing the measuring tape around the four reference points.
  3. If the infant is in an apparent good mood and happily playing by themselves or with a caregiver, proceed with putting the EEG cap on. Consult the caregiver as to the infant's mood and predisposition to headwear. Prepare dry food or toys to occupy the infant's hands before capping, if agreeable with the parent. Additionally, place the infant on the caregiver's lap so that they feel comforted during the gelling process.
  4. Place the cap on the infant's head with the same crown-like stretching motion, and fasten the hook and loop ends under the chin. Have the second experimenter or caregiver prompt the infant to look up, using a rattle, so that it is easier to fasten the hook and loop ends.
    1. Ensure that any bangs or stray hairs on the infant's face are neatly tucked underneath the cap to prevent discomfort or obstruction of vision.
    2. Gently smooth down the cap to ensure that the electrodes lie in close contact with the scalp. Ensure that there are no wrinkles on the cap.
  5. Use the measuring tape to ensure that the cap is positioned correctly, with the Cz electrode at the midpoint or top of the head and use the scrunch and release method to adjust if needed (see step 4.7).
  6. Securely attach the amplifier to the cap. Once connected, display the impedance readings.
  7. Place the connected amplifier in the pocket at the back of the infant's vest.
  8. EEG and ECG gel application
    1. Begin by applying gel to the reference and ground electrodes. Proceed with gelling the remaining electrodes starting from the back.
      NOTE: Infants might be a little fussy with the experimenters touching their heads or from the cooling sensation of the gel. If this is the case, allow some time for the caregiver to soothe the infant before continuing. The second experimenter can distract the infant (e.g., by blowing bubbles, using toys, or giving some food).
    2. Fill all electrode openings with gel and then proceed to use the cotton tips to part the hair in a gentle left-to-right motion if using passive electrodes (as here); refer to the montage on the EEG recording software to check for impedance while gelling.
    3. Ensure that all the electrodes demonstrate low impedance on the EEG recording software, typically < 50 kΞ©, since infants are less tolerant to the gelling process compared to adults.
    4. Clean the soft area under the infant's left collarbone with baby wipes and attach the ECG below the infant's left clavicle following the same procedure as the adult ECG.

6. Creating a trigger box for multi-modal data synchronization

NOTE: Since different sensor data streams (i.e., EEG, ECG, video, and audio) will start recording at different time points during the session, they need to be manually synchronized to create a single timeline of events. Thus, a common event is needed that can be captured by both the camcorder (i.e., LED light) and the amplifier (i.e., digital or analog signal). To achieve this, an in-house synchronization trigger box is used, which can be built using a simple microcontroller unit program, as detailed below.

  1. To build the trigger box, use a microcontroller development board, LED, BNC connector, power bank, a digital input device (i.e., a push-button), and electrical pulse/signal output (i.e., trigger wires) that connect to the amplifier's trigger port (see Figure 2B).
    1. Connect the female BNC connector to the push-button, which serves as the input (e.g., input pin: 8), and the LED light and the electric pulse signal act as the output (e.g., output pin: 12; see Figure 2A).
    2. Connect the BNC connector to the two amplifiers via the 2.5 mm electric wire cables, producing one-bit triggers marking the samples in the EEG-ECG recording when it reads the digital TTL signal from the push button (see Figure 2C).
  2. Configure the trigger port settings of the adult and the infant amplifiers in an identical manner to ensure tight and accurate EEG-EEG synchronization.
    1. Design the trigger system such that trigger markers are produced in both amplifier recordings when the trigger push button is released (after being pushed) as opposed to when it is being pushed.
    2. Identify the current state of the trigger port in the amplifiers. If this is initially at 0 or LOW, set the port to low-active to produce a marker when the push button is released. Alternatively, if the initial state of the port is 1 or HIGH, set the port to be high-active to produce a marker when the push button is released (see Figure 3).

figure-protocol-15189
Figure 2: Building of Trigger Box. (A) Microcontroller circuit diagram for trigger box; (B) Interiors of the built trigger box; (C) Trigger box connected to the adult and infant EEG-ECG amplifiers, the trigger push button, and the power bank. Please click here to view a larger version of this figure.

figure-protocol-15848
Figure 3: High active and low active trigger port settings. Depending on the initial state of the trigger pin (0 or 1), the trigger port setting (High Active, HA or Low Active, LA) is chosen so that the marker is produced at the end of the pulse (when the trigger push button is released). Please click here to view a larger version of this figure.

7. Sensor streams synchronization

  1. To facilitate ease of synchronization, attach the microphone receiver to its respective camcorder, thereby automatically synchronizing video (camcorder) with audio (microphone).
    NOTE: Since the microphones are attached to the camcorders and the EEG and ECG electrodes come from the EEG electrode branch set connected to the same amplifier, these data streams are automatically pre-synchronized.
  2. Attach the respective microphone transmitter to the collar of the caregiver's top and to the infant's vest.
  3. Start the camcorder recordings for all three camcorders after ensuring that their positioning can capture the LED light signal from the Trigger Box in the room.
  4. Start the EEG recording on the laptop and the amplifier (SD card version) for both the infant and caregiver. To ease post-session synchronization, start the cameras first, followed by the EEG sensors in order adult-infant since the infant EEG is the Master sensor to which every other sensor is synchronized (to avoid negative video-EEG offsets).
  5. Attach both amplifiers to the trigger box setup using the 2.5 mm jack tightly to avoid spurious markers (Figure 2C).
    NOTE: A trigger marker should be seen on the EEG continuous stream as the jack is attached to the amplifier.
  6. Synchronize the data streams using the Trigger Box.
    1. Perform long push-button presses as the difference in marker appearance between the two configurations (start vs end of button press) is only noticeable when the presses are considerably long (at least 1 - 2 s long).
    2. Perform multiple long presses to produce multiple triggers to increase the accuracy and reliability of the estimated offsets between sensors and aid post-hoc synchronization in situations where some triggers are not registered by some of the sensors.
    3. Check all cameras to verify whether the LED signal from the Trigger Box is visible in the recordings and check whether there are simultaneous markers displayed in the ongoing EEG recordings on the laptop.
  7. Remove the amplifiers from the trigger box setup and ensure that the amplifiers are securely attached to respective EEG caps.
  8. Perform this synchronization procedure at the start and at the end of the experimental session, particularly if web cameras are used to monitor dropped video frames, which causes the synchronization to drift.

8. Parent-infant interaction experiment

  1. Before starting the parent-infant interaction task, remove all equipment from the table to remove potential distractions for the caregiver-infant interaction experiments.
  2. Conduct the experimental tasks.
    NOTE: The tasks were chosen to emphasize naturalistic interactions between the dyad with minimal instructions or involvement from the experimenter (e.g., read with your baby for 5 min as you would typically do at home). The length of the task is contingent on participants' comfort and the limitations of the equipment, e.g., the battery life of the amplifier.
  3. If possible, ensure that all experimenters are hidden from the infant's view throughout the experiment to avoid distractions. One experimenter is to remain nearby with the recording laptops to be able to intervene in case any sensor streaming issues arise. Make sure that the recording laptops are in close proximity to the amplifiers (< 10 m) to avoid lost samples due to wireless (Wi-Fi, Bluetooth) degradation.

9. Clearing up at the end of the experiment

  1. Stop the recordings on camcorders and the EEG recording software on the laptop and the amplifier. Turn off the amplifier and detach it from the cap.
  2. Removing EEG caps
    1. Gently remove the ECG tapes and electrodes starting from the caregiver or ask the caregiver to remove the infant's ECG if needed. As the infant's skin is sensitive, use baby wipes or warm water to wet the tape for easier removal.
    2. Start by removing the hook and loop ends of the cap, then peel the cap off backward and turn it inside out. Use baby wipes to clean off the gel residue from the infant's head and proceed to remove the caregiver's cap.
    3. Advise the caregiver that excess gel washes out easily in the shower.
  3. Preparations for transportation
    1. Place the EEG cap along with the EEG and ECG electrodes into a plastic bag. Ensure that the gel on the cap does not come in contact with the cap's splitter box. Keep the wires and the splitter box in a structured box during transport.
    2. To prevent mechanical damage during transport, pack the amplifier in a padded box to minimize vibration.
  4. Post-cap cleaning in the lab
    1. Begin cleaning the EEG caps as soon as possible.
    2. Put the EEG caps into a cleaning tub and sandwich the wires with dry cloths away from the water source. Ensure that the splitter box does not come in contact with water.
    3. Pour approximately 1 L of water into the tub and add 10 mL of aldehyde-based disinfectants. Allow the cap to sit within the solution for 10 min. Do not keep the cap in the solution for too long or put too much disinfectant, as it will speed up the deterioration of the caps over time.
    4. After 10 min, use a toothbrush to clean the gel residue from the electrodes under running water. Be particularly cautious while cleaning active electrodes since they have small electronic circuitry built into each electrode.
    5. Rinse the cap thoroughly with water to remove the disinfectant solution.
    6. Using a dry cloth, pat the cap dry and insert a dry cloth within the cap to absorb any remaining moisture. Close the Hook and Loop ends to keep the dry cloth within the cap.
    7. Hang the cap to dry and ensure that the wet ends of the cap do not meet the connectors. To achieve this, place the cap at a lower position than the splitter box and connectors while hanging.
  5. Data saving
    1. Ensure that the data from the SD cards of the camcorders, amplifiers, and recordings from the laptop are exported and backed up onto the data storing site.

10. Data quality assurance

  1. Video-audio data
    1. Check that the sound is on, that no view was obstructed during the tasks, and that the markers are captured.
  2. EEG-ECG data
    1. Ensure that SD card recording is present and not corrupted. Check if the markers are captured on both the EEG recordings.
    2. Check for technical faults, i.e., amplifier disconnecting and electrical or mechanical interference in the EEG / ECG signal.

11. Data processing

  1. Synchronization of multi-sensor recordings
    1. Import the caregiver, infant, and combined view camcorder videos into the video editing software.
    2. Go through the video to mark the specific frames in which each LED trigger light first appears. Continue to go through the video and add another marker at the specific frame in which the LED light completely disappears for each trigger.
    3. Complete these steps for all three videos. Once completed, write down the frame numbers of the markers from all videos in a spreadsheet.
    4. Open the EEG marker files from the amplifier's SD card for the infant and the adult. Write down the marker sample information in a spreadsheet.
    5. Since the video is recorded in frames per second (FPS, e.g., 25 FPS) and the EEG-ECG is recorded in samples per second (e.g., 500 Hz), convert the frame and sample numbers into a common measurement unit, such as milliseconds (ms), to be able to create a single timeline.
    6. For every sensor (videos and physiology recordings), calculate the times in between triggers, here referred to as inter-trigger intervals (ITI), by subtracting the ms timestamp for every pair of consecutive markers.
      NOTE: Although the starting times of the recording sensors are different, the ITIs in ms for the same set of triggers across the different sensors (videos and EEGs) should still match. Therefore, to validate this, calculate the difference in each ITI (ITI Lag) between every sensor and the master EEG.
    7. Check the quality of the video-EEG ITI Lags. Since the sampling rate/FPS is different between the two sensors, typically, the EEG has a much higher sampling rate than the videos, allowing an error with tolerance Β± 1 video frame (here, 40 ms) for the computed EEG-video ITI lags.
    8. Check the quality of the adult EEG - infant EEG ITI Lags. Since they have the same sampling rate, allow an error tolerance of Β± 1 EEG sample (here, 2 ms).
    9. Once these checks are complete, calculate the offsets between each sensor and the Master sensor's timeline (in this case, infant EEG).
    10. Subtract the ms timestamp of each trigger marker of the Master EEG from the respective markers of each sensor (videos, adult EEG). This produces N [sensor - master EEG] offsets (N = number of triggers) for each sensor.
    11. For each sensor, calculate the average of these offsets and round them up to produce the final offset number with respect to the master EEG. Use these offset numbers to cut the video and EEG data to start at the same time as the master EEG.
  2. Simple video coding
    1. To identify the different stages of the experiment within the videos (e.g., start and end of the experimental tasks or interruptions), note down the specific timestamps in frames using video editing software.
  3. EEG preprocessing
    1. Cut the EEG files of the adults and infants at the beginning and end of the task.
    2. Identify and remove bad channels
      1. Note down any channels that look continuously noisy or contain no signal throughout the entirety/majority of the task recording.
        NOTE: For low-density recordings, the aim is to keep as many channels as possible. Thus, for channels that are bad only for short periods of time, it is preferable to remove the corrupted data segment at a later stage of the analysis rather than the channel itself.
      2. Plot and visually inspect the Power Spectral Density (PSD) to identify outlying channels.
    3. To remove slow (over 2 s) linear trends, high-pass filter the data using a Basic FIR high-pass filter with a cut-off frequency of 0.5 Hz.
    4. To remove high-frequency noise from myogenic and external sources, low-pass filter the data using a Basic FIR low-pass filter with a cut-off frequency of 35 Hz.
    5. Segment the data into consecutive, non-overlapping 1 s epochs.
    6. Automatically reject all segments with the minimum value below -100 Β΅V (for adults) and -150 (for infants) and/or the maximum value above +100 Β΅V (for adults) and +150 (for infants).
    7. Visually inspect all segments that have not been excluded in 11.3.6. Manually reject all segments containing artifacts. If only a single 1s segment is acceptable located between rejected segments, remove the entire period so that no single 1s segments are retained.
    8. For INS / dyadic analysis, analyze only accepted segments that are in common for adults and infants. By removing all segments of the adult that are rejected in the infant and vice versa, ensure that the EEG time series of adult and infant remain perfectly aligned.

Results

Participants included in this study were 8- to 12-month-old, typically developing infants and their mother and/or grandmother who spoke English or English and a second language at home. The 7-electrode EEGs and a single-lead ECG of adults and infants, as well as video and audio recordings from three cameras and microphones, were acquired simultaneously during the tasks. Neural activities were measured over F3, F4, C3, Cz, C4, P3, and P4 according to the international 10-20 system. The different data streams were temporal...

Discussion

In this protocol, we conduct measurements in the participants' homes where infants and caregivers may feel more comfortable and their behaviors may be more representative of their real-life interactions as opposed to a laboratory setting, thus, increasing ecological validity7. Further, recordings in the home environment may ease the burden onΒ the participants, e.g., with respect to travel times, and may thus make certain participant groups more accessible. However, along with these advant...

Disclosures

No conflicts of interest are to be declared.

Acknowledgements

The work was funded by a Presidential Postdoctoral Fellowship Grant from Nanyang Technological University that was awarded to VR.

Materials

NameCompanyCatalog NumberComments
10 cc Luer Lock Tip syringe without NeedleTerumo Corporation
actiCAP slim 8-channel electrode set (LiveAMP8)Brain Products GmbH
Arduino Software (IDE)ArduinoArduino IDE 1.8.19The software used to write the code for the Arduino microcontroller. Alternate programming software may be used to accompany the chosen microcontroller unit.Β 
Arduino Uno boardArduinoUsed for building the circuit of the trigger box. Alternate microcontroller boards may be used.
BNC connectorsBNC connectors to connect the various parts of the trigger box setup.
BNC Push buttonΒ Brain Products GmbHBP-345-9000BNC trigger push button to send triggers.
BNC to 2.5 mm jack trigger cable (80 cm)Β Brain Products GmbHBP-245-1200BNC cables connecting the 2 LiveAmps to the trigger box.
BrainVision Analyzer Version 2.2.0.7383Brain Products GmbHEEG analysis software.
BrainVision Recorder License with dongleBrain Products GmbHS-BP-170-3000
BrainVision Recorder Version 1.23.0003Brain Products GmbHEEG recording software.
Custom 8Ch LiveAmp Cap passive (infant EEG caps)Brain Products GmbHLC-X6-SAHS-44, LC-X6-SAHS-46, LC-X6-SAHS-48Β For infant head sizes 44, 46, 48 . Alternate EEG caps may be used.
Dell Latitude 3520 LaptopsDellTwo laptops, one for adult EEG recording and one for infant EEG recording. Alternate computers may be used.
Dental Irrigation Syringes
LiveAmp 8-CH wireless amplifierBrainProducts GmbHBP-200-3020Two LiveAmps, one for adult EEG and one for infant EEG. Alternate amplifier may be used.
Manfrotto MT190X3 Tripod with 128RC Micro Fluid Video HeadManfrottoMT190X3Alternate tripods may be used.
Matlab SoftwareThe MathWorks, Inc.R2023aAlternate analysis and presentation software may be used.
Power bank (10000 mAh)PhilipsDLP6715NB/69Alternate power banks may be used.
Raw EEG capsEASYCAP GmbHFor Adult head sizes 52, 54, 56, 58. Alternate EEG caps may be used.
Rode Wireless Go II Single SetRΓΈde MicrophonesAlternate microphones may be used.
Sony FDR-AX700 CamcorderSonyFDR-AX700Alternate camcorders or webcams may be used.
SuperVisc High-Viscosity GelΒ EASYCAP GmbHNS-7907

References

  1. Hari, R., Henriksson, L., Malinen, S., Parkkonen, L. Centrality of social interaction in human brain function. Neuron. 88 (1), 181-193 (2015).
  2. Endevelt-Shapira, Y., Djalovski, A., Dumas, G., Feldman, R. Maternal chemosignals enhance infant-adult brain-to-brain synchrony. Sci Adv. 7 (50), (2021).
  3. Santamaria, L., et al. Emotional valence modulates the topology of the parent-infant inter-brain network. NeuroImage. 207, 116341 (2020).
  4. Nguyen, T., et al. The effects of interaction quality on neural synchrony during mother-child problem solving. Cortex. 124, 235-249 (2020).
  5. Reindl, V., Gerloff, C., Scharke, W., Konrad, K. Brain-to-brain synchrony in parent-child dyads and the relationship with emotion regulation revealed by fNIRS-based hyperscanning. NeuroImage. 178, 493-502 (2018).
  6. Reindl, V., et al. Conducting hyperscanning experiments with functional near-infrared spectroscopy. J Vis Exp. (143), e58807 (2019).
  7. Gardner, F. Methodological issues in the direct observation of parent-child interaction: Do observational findings reflect the natural behavior of participants. Clin Child Fam Psychol Rev. 3, 185-198 (2000).
  8. Xu, J., Zhong, B. Review on portable EEG technology in educational research. Comput Hum Behav. 81, 340-349 (2018).
  9. Troller-Renfree, S. V., et al. Feasibility of assessing brain activity using mobile, in-home collection of electroencephalography: methods and analysis. Dev Psychobiol. 63 (6), e22128 (2021).
  10. BΓΆgels, S., Levinson, S. C. The brain behind the response: Insights into turn-taking in conversation from neuroimaging. Res Lang Soc. 50 (1), 71-89 (2017).
  11. Georgieva, S., et al. Toward the understanding of topographical and spectral signatures of infant movement artifacts in naturalistic EEG. Front Neurosci. 14, 452947 (2020).
  12. Dikker, S., et al. Brain-to-brain synchrony tracks real-world dynamic group interactions in the classroom. Curr Biol. 27 (9), 1375-1380 (2017).
  13. Oliveira, A. S., Bryan, R. S., Hairston, W. D., Peter, K., Daniel, P. F. Proposing metrics for benchmarking novel EEG technologies towards real-world measurements. Front Hum Neurosci. 10, 188 (2016).
  14. Turk, E., Endevelt-Shapira, Y., Feldman, R., vanden Heuvel, M. I., Levy, J. Brains in sync: Practical guideline for parent-infant EEG during natural interaction. Front Psychol. 13, 833112 (2022).
  15. Kayhan, E., et al. A dual EEG pipeline for developmental hyperscanning studies. Dev Cogn Neurosci. 54, 101104 (2022).
  16. Ayrolles, A., et al. HyPyP: a Hyperscanning Python pipeline for inter-brain connectivity analysis. Soc Cogn Affect Neurosci. 16 (1-2), 72-83 (2021).
  17. Delorme, S., Makeig, S. EEGLAB: an open-source toolbox for analysis of single-trial EEG dynamics. J Neurosci Meth. 134, 9-21 (2004).
  18. Nathan, K., Contreras-Vidal, J. L. Negligible motion artifacts in scalp electroencephalography (EEG) during treadmill walking. Front Hum Neurosci. 9, 708 (2016).
  19. Stone, D. B., Tamburro, G., Fiedler, P., Haueisen, J., Comani, S. Automatic removal of physiological artifacts in EEG: The optimized fingerprint method for sports science applications. Front Hum Neurosci. 12, 96 (2018).
  20. Noreika, V., Georgieva, S., Wass, S., Leong, V. 14 challenges and their solutions for conducting social neuroscience and longitudinal EEG research with infants. Infant Behav Dev. 58, 101393 (2020).
  21. Ng, B., Reh, R. K., Mostafavi, S. A practical guide to applying machine learning to infant EEG data. Dev Cogn Neurosci. 54, 101096 (2022).
  22. vander Velde, B., Junge, C. Limiting data loss in infant EEG: putting hunches to the test. Dev Cogn Neurosci. 45, 100809 (2020).
  23. Bell, M. A., Cuevas, K. Using EEG to study cognitive development: Issues and practices. J Cogn Dev. 13 (3), 281-294 (2012).
  24. Lopez, K. L., et al. HAPPILEE: HAPPE in low electrode electroencephalography, a standardized pre-processing software for lower density recordings. NeuroImage. 260, 119390 (2022).

Reprints and Permissions

Request permission to reuse the text or figures of this JoVE article

Request Permission

Explore More Articles

Brain ActivityEEG HyperscanningInfant caregiver InteractionHome based RecordingSynchronized DataEcological ValidityData QualityMovement Artifacts

This article has been published

Video Coming Soon

JoVE Logo

Privacy

Terms of Use

Policies

Research

Education

ABOUT JoVE

Copyright Β© 2025 MyJoVE Corporation. All rights reserved