Now available: Protocol for reducing COVID-19 transmission risk in EEG research

Simmons, A. M., & Luck, S. J. (2020). Protocol for Reducing COVID-19 Transmission Risk in EEG Research. Protocol Exchange. https://doi.org/10.21203/rs.3.pex-974/v1

The COVID-19 pandemic triggered a pause in data collection for EEG research throughout much of the world. As conditions improve in some regions, many researchers would like to resume data collection. However, because the application of EEG electrodes typically involves close and prolonged exposure between the experimenter and the research participant, there will be some risk of viral infection in EEG experiments until there is an effective and widely used vaccine. It is therefore important to develop effective mitigation methods than can reduce the risks so that they are comparable to the risks that individuals will face in their daily lives (e.g., when visiting the grocery store or getting a haircut).

Toward that end, we created this protocol for reducing COVID-19 transmission risk in EEG research. We created this protocol with feedback from local EEG/ERP researchers, from neurologists who have experience with clinical EEG recordings, and from the worldwide EEG/ERP research community. The protocol is designed for use in relatively simple experimental paradigms with adult participants, but it could be easily adapted for other populations and paradigms. It could also be adapted for use with other recording methods. We assume that each researcher will carefully read the protocol and adapt it to local conditions.

If you use/adapt our protocol, please cite it!

Important: We are not implying that researchers in all locations should resume EEG recordings at this time. Resumption of research will depend on your local conditions and the rules imposed by your institution and your local, regional, and national governing bodies. However, once it is ethical and allowable for you to resume research, we hope that this protocol will help you conduct your research in a way that is safe for both laboratory personnel and research participants.

Announcing the Release of ERP CORE: An Open Resource for Human Event-Related Potential Research

We are excited to announce the official release of the ERP CORE, a freely available online resource we developed for the ERP community. The ERP CORE was designed to help everyone from novice to experienced ERP researchers advance their program of research in several distinct ways.

The ERP CORE includes: 1) experiment control scripts for 6 optimized ERP paradigms that collectively elicit 7 ERP components (N170, MMN, N2pc, N400, P3, LRP, and ERN) in just one hour of recording time, 2) raw and processed data from 40 neurotypical young adults in each paradigm, 3) EEG/ERP data processing pipelines and analysis scripts in EEGLAB and ERPLAB Matlab Toolboxes, and 4) a broad set of ERP results and EEG/ERP data quality measures for comparison across laboratories.

A paper describing the ERP CORE is available here, and the online resource files are accessible here. Below we detail just some of the ways in which ERP CORE may be useful to ERP researchers.

  • The ERP CORE provides a comprehensive introduction to the analysis of ERP data, including all processing steps, parameters, and the order of operations used in ERP data analysis. As a result, this resource can be used by novice ERP researchers to learn how to analyze ERP data, or by researchers of all levels who wish to learn ERP data analysis using the open source EEGLAB and ERPLAB Matlab Toolboxes. More advanced researchers can use the annotated Matlab scripts as a starting point for scripting their own analyses. Our analysis parameters, such as time windows and electrode sites for measurement, could also be used as a priori parameters in future studies, reducing researcher degrees of freedom.

  • With data for 7 ERP components in 40 neurotypical research participants, the provided ERP CORE data set could be reanalyzed by other researchers to test new hypotheses or analytic techniques, or to compare the effectiveness of different data processing procedures across multiple ERP components. This may be particularly useful to researchers right now, given the limitations many of us are facing in collecting new data sets.

  • The experiment control scripts for each of the ERP CORE paradigms we designed are provided in Presentation software for use by other researchers. Each paradigm was specifically designed to robustly elicit a specific ERP component in a brief (~10 min) recording. The experiment control scripts were programmed to make it incredibly easy for other researchers to directly use the tasks in their laboratories. For example, the stimuli can be automatically scaled to the same sizes as in our original recording by simply inputting the height, width, and viewing distance of the monitor you wish to use to collect data in your lab. The experiment control scripts are also easy to modify using the parameters feature in Presentation, which allows changes to be made to many features of the task (e.g., number of trials, stimulus duration) without modifying the code. Thus, the ERP CORE paradigms could be added on to an existing study, or be used as a starting point for the development of new paradigms.

  • We provide several metrics quantifying the noise levels of our EEG/ERP data that may be useful as a comparison for both novice and experienced ERP researchers to evaluate their laboratory set-up and data collection procedures. The quality of EEG/ERP data plays a big role in statistical power; however, it can be difficult to determine the overall quality of ERP data in published papers. This makes it difficult for a given researcher to know whether their data quality is comparable to that of other labs. The ERP CORE provides measures of data quality for our data, as well as analysis scripts and procedures that other researchers can use to calculate these same data quality metrics on their own data.

These are just some of the many ways we anticipate that the ERP CORE will be used by ERP researchers. We are excited to see what other uses you may find for this resource and to hear feedback on the ERP CORE from the ERP community.

Please Comment: Draft of protocol for reducing COVID-19 transmission risk in EEG research

We are no longer taking comments on this draft. Thanks to everyone who provided comments.

The published protocol is now available on Protocol Exchange. Here’s the citation: Simmons, A. M., & Luck, S. J. (2020). Protocol for Reducing COVID-19 Transmission Risk in EEG Research. Protocol Exchange. https://doi.org/10.21203/rs.3.pex-974/v1

The COVID-19 pandemic has caused a pause in data collection for EEG research throughout much of the world. As conditions improve in some regions, many researchers would like to resume data collection. However, because the application of EEG electrodes typically involves close and prolonged exposure between the experimenter and the research participant, there will be some risk of viral infection in EEG experiments until there is an effective and widely used vaccine. It is therefore important to develop effective mitigation methods than can reduce the risks so that they are comparable to the risks that individuals will face in their daily lives (e.g., when visiting the grocery store or getting a haircut).

Toward that end, we have created a draft of a protocol for reducing COVID-19 transmission risk in EEG research. We have already received feedback from both basic scientists and neurologists who have experience with clinical EEG recordings. To further improve and refine this protocol, we are seeking feedback from the worldwide EEG community. Once we have received that feedback, we will create an updated document and make it available freely on Protocol Exchange. Researchers may then adapt this protocol to reflect their local conditions and regulatory environment.

Important: We are not implying that researchers in all locations should resume EEG recordings at this time. Resumption of research will depend on your local conditions and the rules imposed by your institution and your local, regional, and national governing bodies. However, once it is ethical and allowable for you to resume research, we hope that this protocol will help you conduct your research in a way that is safe for both laboratory personnel and research participants.

You can view and download the current version of the protocol here.

You can provide comments by clicking on Comments at the bottom of the page. Please read the entire protocol before posting comments. If you have specialized knowledge or training that is relevant for this protocol (e.g., medical training in infectious disease), please indicate this in your comments. Comments will be most useful is posted by June 5, 2020.

Step-by-Step Protocols for Collecting Clean EEG Data

Standard Version: Farrens, J. L., Simmons, A. M., Luck, S. J., & Kappenman, E. S. (2019). Electroencephalogram (EEG) Recording Protocol for Cognitive and Affective Human Neuroscience Research. Protocol Exchange. https://doi.org/10.21203/rs.2.18328/v2 [PDF]

COVID-19 Version: Simmons, A. M., & Luck, S. J. (2020). Protocol for Reducing COVID-19 Transmission Risk in EEG Research. Protocol Exchange. https://doi.org/10.21203/rs.3.pex-974/v2

We have published an in-depth description of our EEG recording procedures, which provides an extremely detailed, step-by-step account of how we currently record EEG data in our laboratories (along with a modified version to minimize risk of COVID-19 transmission). Although this level of detail important for collecting clean data, it would be unrealistic to include 20+ pages of recording details in the Method section of a journal article. By publishing this protocol and then citing it in our papers, other researchers will know exactly how we recorded our data, which will enhance reproducibility. In addition, this protocol provides a forum for sharing the tips and tricks we have developed for collecting clean EEG data, which may help you improve your data quality. We encourage other researchers to either follow and cite our protocol or publish and cite their own protocols. If you’d like more information about why we think this is important, read on…

If you’ve ever recorded or processed raw EEG data, you know how noisy the data can be. The neural signals we want to record are contaminated by a variety of biological and non-biological noise sources, including muscle activity (EMG), heartbeats (EKG), skin potentials, movement artifacts, and induced electrical noise from the environment. To maximize the likelihood of finding the neural effects of interest, researchers need to do everything they can to reduce the noise during a recording session. Postprocessing techniques such as filters can help, but they can’t eliminate all the noise, and they often have a cost (e.g., temporal distortion). This is why one of our ERP Boot Camp mottos is “There is no substitute for clean data!”

When you run an EEG recording session, there are a million little details that together impact the quality of the data. Every lab has its own approach, but our field has no widely used mechanism for sharing these methodological details. Recording methods are usually described in journal articles with only a brief mention of the recording parameters (e.g., filter settings and sampling rate) and no information about the millions of other details that impact data quality. And really, who would want to slog through a Method section that described how the electrodes were oriented in their holders or listed the specific make and model of chair that was used to ensure that the participant remained comfortable?

However, these details really matter. For example, we have shown that the temperature of the recording environment can have a substantial impact on statistical power (Kappenman & Luck, 2010), but we have never seen an EEG/ERP paper from another lab that mentioned the temperature of the recording room.

A mechanism now exists for reporting all of these details. Specifically, one can now easily publish a formal protocol that is permanent and citable (and even contributes to citation counts on Google Scholar, if you care about that sort of thing). There are a variety of ways to publish a protocol, but we chose Nature’s Protocol Exchange web site. It’s free, appears to be robust, and automatically generates a DOI. It does not involve peer review (because you are merely listing your procedures, not drawing any formal conclusions), but it does involve a quick administrative review (to make sure that inappropriate materials are not posted). The protocol is published with a Creative Commons license, so Nature does not own it, and anyone can use it. Other sites may be even better, but Protocol Exchange fits our current needs reasonably well (although we would have appreciated a little more control over the formatting).

We encourage other researchers to read our protocol and use it to get ideas for their own recording methods. Our methods may not be ideal for some kinds of research, and other labs may have equivalent or even better methods.

More than anything, we hope that our protocol inspires other researchers to start publishing their own detailed protocols. This sharing of information will help everyone collect the cleanest possible data, improving the quality of published research in our field. Detailed protocols will also increase reproducibility of research methods and perhaps even replicability of research findings. Note that our protocol is longer and more detailed that what most labs would publish (because we included advice about things like fixing broken electrodes).

You can find the standard version of the protocol at protocolexchange.researchsquare.com/article/663a5a19-c74e-4c7d-b3fc-9c5188332b46/v2 or at doi.org/10.21203/rs.2.18328/v2. You can download a nicely formatted PDF of the protocol here.

You can find the COVID-19 version at https://protocolexchange.researchsquare.com/article/pex-974/v2 or at https://doi.org/10.21203/rs.3.pex-974/v2