Marijke WelvaertpersName, Yves RosseelpersName (2013date). “On the definition of signal-to-noise ratio and contrast-to-noise ratio for FMRI data..” PLoS ONEtitle·j.
Object of study — existing definitions of signal-to-noise and contrast-to-noise ratioterm for fMRIterm·key data
Research question — how SNRterm and CNRterm definitions relate to the power to detect activation
Contribution — reference tables and conversion formulae that make SNRterm/CNRterm values comparable between fMRIterm·key studies
phenomenon · claim-type · cross-domain-transfer · mechanism · claim-relation · replication-status · limitation — grounded in the full text| phenomenon | SNR for fMRI data reported under many different definitions — “Depending on how the signal of interest and the noise are identified, signal-to-noise ratio for fMRI data is reported by using many different definitions.” | |
| claim-type | existence — “It was established that the literature lacks consensus on how to define SNR/CNR for fMRI data.” | |
| method — evidence | — “A simulation study was conducted to investigate the relationship between SNR/CNR levels and the power to detect activation in a basic GLM analysis.” | |
| object of study — evidence | — “In this paper, we provide an overview of existing definitions.” | |
| research question — evidence | — “Further, the relationship with activation detection power is investigated.” | |
| contribution — evidence | — “Reference tables and conversion formulae are provided to facilitate comparability between fMRI studies.” | |
| mechanism | baseline value The higher the baseline value of the data, the less the activation signal affects the SNR value. — “In fact, the higher the baseline value of the data, the less impact the activation signal will have on the value of the SNR.” | mechanisms[0] |
| sense | SNR (as labelled in fMRI simulation studies) - in most cases actually a contrast-to-noise measure — “Note that, although in most papers these formulae were labelled as SNR, the majority of them are in fact CNR measurements.” | senses[0] |
| relation | signal-to-noise ratio —same-as→ SNR — In science and engineering, the signal-to-noise ratio (SNR) is a measure that compares the level of a desired signal to the level of background noise. — “In science and engineering, the signal-to-noise ratio (SNR) is a measure that compares the level of a desired signal to the level of background noise.” | concept_edges[0] |
| weight | signal-to-noise ratio —same-as→ SNR — 0.9 — “In science and engineering, the signal-to-noise ratio (SNR) is a measure that compares the level of a desired signal to the level of background noise.” | concept_edges[0] |
| relation | temporal SNR —same-as→ tSNR — Therefore, temporal SNR (tSNR), in which the (mean) signal over time is taken into account, can be used to determine the SNR of fMRI time series [9] . — “Therefore, temporal SNR (tSNR), in which the (mean) signal over time is taken into account, can be used to determine the SNR of fMRI time series [9] .” | concept_edges[1] |
| weight | temporal SNR —same-as→ tSNR — 0.9 — “Therefore, temporal SNR (tSNR), in which the (mean) signal over time is taken into account, can be used to determine the SNR of fMRI time series [9] .” | concept_edges[1] |
| relation | image SNR —contrasted-with→ tSNR — In short, image SNR should be used to assess data quality of a single image, while tSNR gives information on the data quality of fMRI time series. — “In short, image SNR should be used to assess data quality of a single image, while tSNR gives information on the data quality of fMRI time series.” | concept_edges[2] |
| weight | image SNR —contrasted-with→ tSNR — 0.8 — “In short, image SNR should be used to assess data quality of a single image, while tSNR gives information on the data quality of fMRI time series.” | concept_edges[2] |
| effect direction | field strength —causes→ SNR — increases — “For example, SNR increases almost linearly with field strength [4] and is largely effected by the receiver coils (see [5] for a review).” | concept_edges[3] |
| relation | field strength —causes→ SNR — For example, SNR increases almost linearly with field strength [4] and is largely effected by the receiver coils (see [5] for a review). — “For example, SNR increases almost linearly with field strength [4] and is largely effected by the receiver coils (see [5] for a review).” | concept_edges[3] |
| weight | field strength —causes→ SNR — 0.7 — “For example, SNR increases almost linearly with field strength [4] and is largely effected by the receiver coils (see [5] for a review).” | concept_edges[3] |
| replication | original | |
| limitation | The simulated power values are maximal; in real fMRI data non-white noise lowers power. — “Note that these results represent maximal power values. In real fMRI data, the power will be smaller due to the influence of non-white noise.” | limitations[0] |
finding · quantity · variable · definition · key-term — grounded in the full text| finding | Detection power does not rise linearly with SNR/CNR; the rule that twice the signal doubles the power is not valid. — “Looking at the results, we can immediately conclude that the simple rule “twice as much signal will double the power” is not valid.” | content_tags.findings[0] |
| quantity | 62.2% — — “Moreover, screening of published simulation studies teaches us that no less than 62.2% of these studies avoid reporting an SNR/CNR value.” | content_tags.quantities[0] |
| key-terms | signal-to-noise ratio, contrast-to-noise ratio, SNR, CNR, tSNR, fMRI, activation detection power, BOLD, simulation, resting-state |
| concept | signal-to-noise ratio — a measure that compares the level of a desired signal to the level of background noise — “In science and engineering, the signal-to-noise ratio (SNR) is a measure that compares the level of a desired signal to the level of background noise.” | concepts[0] |
| concept | SNR — signal-to-noise ratio — “In science and engineering, the signal-to-noise ratio (SNR) is a measure that compares the level of a desired signal to the level of background noise.” | concepts[1] |
| concept | temporal SNR — the (mean) signal over time is taken into account — “Therefore, temporal SNR (tSNR), in which the (mean) signal over time is taken into account, can be used to determine the SNR of fMRI time series [9] .” | concepts[2] |
| concept | tSNR — temporal SNR — “Therefore, temporal SNR (tSNR), in which the (mean) signal over time is taken into account, can be used to determine the SNR of fMRI time series [9] .” | concepts[3] |
| concept | contrast-to-noise ratio — a measure of image quality based on a contrast rather than the raw signal — “Also the relationship between SNR and CNR (contrast-to-noise ratio, a measure of image quality based on a contrast rather than the raw signal) has been investigated.” | concepts[4] |
| concept | CNR — contrast-to-noise ratio — “Also the relationship between SNR and CNR (contrast-to-noise ratio, a measure of image quality based on a contrast rather than the raw signal) has been investigated.” | concepts[5] |
| concept | image SNR — not defined in this paper's own words; signal-to-noise ratio computed from a single static image — “In short, image SNR should be used to assess data quality of a single image, while tSNR gives information on the data quality of fMRI time series.” | concepts[6] |
| concept | field strength — not defined in this paper's own words; the strength of the scanner's magnetic field — “For example, SNR increases almost linearly with field strength [4] and is largely effected by the receiver coils (see [5] for a review).” | concepts[7] |
Full text — tagged
On the definition of signal-to-noise ratioterm and contrast-to-noise ratioterm for FMRIterm·key data.
Abstract Signal-to-noise ratioterm, the ratio between signal and noise, is a quantity that has been well established for MRI data but is still subject of ongoing debate and confusion when it comes to fMRIterm·key data. fMRIterm·key data are characterised by small activation fluctuations in a background of noise. Depending on how the signal of interest and the noise are identified, signal-to-noise ratioterm for fMRIterm·key data is reported by using many different definitions. Since each definition comes with a different scale, interpreting and comparing signal-to-noise ratioterm values for fMRIterm·key data can be a very challenging job. In this paper, we provide an overview of existing definitions. Further, the relationship with activation detection powerterm·key is investigated. Reference tables and conversion formulae are provided to facilitate comparability between fMRIterm·key studies.
Introduction In science and engineering, the signal-to-noise ratioterm (SNRterm) is a measure that compares the level of a desired signal to the level of background noise. For data acquired through magnetic resonance imaging (MRI), this quantification is typically used to allow comparison between imaging hardware, imaging protocols and acquisition sequences. In this context, SNRterm is conceptualised by comparing the signal of the MRI image to the background noise of the image [1] , [2] . Mathematically, the SNRterm is the quotient of the (mean) signal intensity measured in a region of interest (ROI) and the standard deviation of the signal intensity in a region outside the anatomy of the object being imaged (i.e. a region from which no tissue signal is obtained) or the standard deviation from the noise distribution when known (e.g. the background noise in magnitude data follows a Rician distribution [3] ). By varying, for example, field of view, scan parameters, magnetic field strengthterm and slice thickness, the SNRterm of MRI images can be increased because these parameters influence the background noise. On the other hand, scanning hardware has also a major influence on the SNRterm levels of fMRIterm·key data. For example, SNRterm increases almost linearly with field strengthterm [4] and is largely effected by the receiver coils (see [5] for a review).
Translating SNRterm of MRI images to fMRIterm·key images is not as straightforward as it may seem. First of all, the noise in fMRIterm·key images does not correspond to the background noise of MRI images (see [6] for an excellent overview). In fMRIterm·key images, system noise effects the image as well as noise stemming from the subject (i.e. cardiac and respiratory pulsations, motion) and the task that is performed. Using time series outside the brain as noise measurement only, will not be sufficient to capture the noise data [1] , [7] , [8] . Secondly, since the main goal of fMRIterm·key studies is to detect small fluctuations over a period of time, image SNRterm might not be suitable. Therefore, temporal SNRterm (tSNRterm), in which the (mean) signal over time is taken into account, can be used to determine the SNRterm of fMRIterm·key time series [9] .
How to define SNRterm for MRI and fMRIterm·key data is documented quite well in terms of its relationship with the MRI acquisition parameters. Several studies have demonstrated the dependence on these parameters and illustrated the necessary conditions to obtain higher SNRterm [1] , [7] , [10] . Also the relationship between SNRterm and CNRterm (contrast-to-noise ratioterm, a measure of image quality based on a contrast rather than the raw signal) has been investigated. For example, Wald investigated the improvement of BOLDterm·key CNRterm at higher field strengthterm [11] . He showed that BOLDterm·key CNRterm is not directly affected by most acquisition parameters such as reciever coil choice, parallel imaging acceleration and voxel size, but only through the influence on the tSNRterm. However, in the end, one is interested in how well the experimentally induced activation can be detected. From a statistical perspective, it is not entirely clear how the SNRterm measurements relate to this detection power, because the small activation fluctuations (typically around 1–5%) cannot be derived from the mean signal based on a static image or time series. So for fMRIterm·key data, using the CNRterm of the time series instead of (t)SNRterm is more preferred because CNRterm compares a measure of the activation fluctuations to the noise [12] . In short, image SNRterm should be used to assess data quality of a single image, while tSNRterm gives information on the data quality of fMRIterm·key time series. CNRterm on the other hand, provides knowledge on how easy, or hard, it is to detect experimentally induced signal fluctuations.
These different conceptualisations of SNRterm make it hard to compare results over studies. Therefore, in this paper, we provide an overview of the most current SNRterm definitions for fMRIterm·key. First, we demonstrate the use of these definitions in the literature and discuss thoroughly how the definitions can be applied. Second, we show analytic results that will enable the comparison between the several definitions. Third, we also analyzed the relationship with activation detection powerterm·key and present simulationterm·mth results that clarifies this relation. Finally, an application on real data illustrates how the definitions can be used in practice.
Methods To retrieve the range of possible values of SNRterm and CNRterm, we looked at the reported values of SNRterm and CNRterm in fMRIterm·key studies. NeuroImage published in 2012 about 458 fMRIterm·key studies that presented original fMRIterm·key data. These papers were manually screened if they reported SNRterm/CNRterm values of their data. In total, 50 of these studies mentioned the role of SNRterm/CNRterm for their experiment or method, while only 18 papers also reported SNRterm or CNRterm values.
Since the determination of the SNRterm and CNRterm of real data can be a demanding job and is not standardly reported, we also looked at the SNRterm/CNRterm values that were reported in simulationterm·mth studies. In simulationterm·mth studies, the range of the reported SNRterm/CNRterm values was determined based on a representative sample of 119 articles describing at least one simulationterm·mth study. This sample containes papers that were published between 1996 and 2012 in about 49 scientific journals. The reported values varied widely across studies and were almost exclusively labelled as SNRterm.
Simulationterm·mth study A simulationterm·mth study was conducted to investigate the relationship between SNRterm/CNRterm levels and the power to detect activation in a basic GLM analysis. time series were simulated for three types or experimental design: (1) a block design, (2) an event-related (ER) design, and (3) a contrast between two conditions. These experimental designs serve as basic templates. More complex designs can be partially reduced to one of these three design types based on the specific research hypotheses at hand (i.e. a specific contrast or the effect of a specific predictor).
An activation signal of 200s was modelled for each design. The block design consisted of alternating task and rest blocks that lasted 20s each. For the ER design, 25 events were randomly distributed over the whole time series. For the contrast, two alternating block conditions of 20s each were modelled with a rest period of 20s after each sequence and the effect of condition was twice as high as the effect of condition . Activation time series were the result of convolving the stimulus boxcar function with the canonical HRF. The baseline value of these time series was considered fixed at 100 and we chose three levels of percent signal change, 1%, 2%, and 5% respectively. Random Gaussian noise was added to these time series and the standard deviation of the noise was allowed to vary between 0.1 and 10.
The empirical power was determined by fitting a standard GLM model to each of the simulated time series. In both the block and the ER design, the power was assessed by testing . For the contrast design, was tested. The obtained power is defined as the average number of correct detections (i.e. rejection of null hypothesis) over all time series. All simulationsterm·mth were carried out using the R package neuRosim [13] .
Data acquisition As an illustration of the discussed definitions, we applied the SNRterm/CNRterm definitions in the context of experimental fMRIterm·key data and resting-stateterm·key fMRIterm·key data. The experimental fMRIterm·key dataset is based on a houses-faces object recognition paradigm [14] and is freely available through the OpenfMRI project ( http://openfmri.org ). Forty 3.5-mm-thick sagittal images were acquired on a GE 3T scanner (General Electric, Milwaukee, WI) with TR = 2500 ms, FOV = 24 cm, TE = 30 ms and flip angle = 90. This resulted in 1452 volume scans. For the resting stateterm·key data, we randomly selected one subject (AnnArbor-sub04111) from the 1000 Functional Connectomes project [15] . These data, consisting of 295 resting scans, were acquired at 3T field strengthterm with a voxel size of , a matrix of and TR of 2s.
Results Reported SNRterm values in the literature Reported SNRterm values ranged over studies from 0.35 to 203.6 for real fMRIterm·key data [17] , [46] – [61] . An overview of the values that were reported in these studies is presented in Figure 1 . Many authors explicitly reported tSNRterm values ranging from 4.42 to 280, while in a few other cases CNRterm values were reported that varied from 0.5 to 1.8. Note that one study reported the possibility of a CNRterm value as low as 0.01, but this was specific to the imaging of orientation columns in the visual cortex and caused by a combination of bias and voxel size [16] . An interesting observation was that Hughes and Beer made an explicit distinction between SNRterm for active clusters and SNRterm for non-active clusters [17] .
Overview of reported SNRterm values in real data (left panel) and simulated data (right panel). [17] , [46] – [61] .
In the simulationterm·mth studies, the reported values varied widely across studies and were almost exclusively labelled as SNRterm. For example, the SNRterm for the simulationsterm·mth varied from 1 to 10 in one study, while the range was 0.01 to 1 in another, and in yet other studies, we found SNRterm values that could be negative, for instance, ranging from −13 to 30.
Both in the experimental and simulationterm·mth studies in our literature search, the reported values demonstrated a range that was much wider than can be explained by natural variation only. There is only one reason that could account for the found variation, namely, the use of different definitions to calculate SNRterm or CNRterm. Indeed, several definitions can be found in the literature, especially for CNRterm. All these CNRterm measurements model some form of relative signal change, related to the contrast of interest, relative to the noise level. However, there is no consensus on how this contrast of interest should be conceptualised. Therefore, the scale of the CNRterm definitions varies widely and this makes comparing studies very hard.
SNRterm and CNRterm definitions for fMRIterm·key data Both SNRterm and CNRterm definitions have in common that a signal measure is compared to the noise level. The distinction between SNRterm versus CNRterm and the differences between the CNRterm definitions will be the result of how the signal measure and the noise is defined. While discussing the definitions, we will consider fMRIterm·key time series as the result of an addition of an activation signal time course and a noise signal time course. Figure 2 illustrates the notation we will use to define the signal and the noise. The activation signal time course, denoted as , contains both the baseline signal and the possible fluctuations in the signal due to the experimental task. In general, can be calculated as the average haemodynamic response function (HRF) of the fMRIterm·key time series in a certain ROI [18] . The noise signal, , will typically be the composition of several noise sources such as system noise, physiological noise and task-related noise. When referring to the noise signal, we implicitly take into account all these sources, ignoring the specific influence or distribution of these sources [7] . To calculate from the fMRIterm·key series in an ROI, the contribution of the activation signal can be reduced by subtracting the average HRF from the time series [18] .
Illustration of the notation in the SNRterm and CNRterm definitions: is the activation signal, the noise signal, defines the amplitude of the activation signal, and and indicate the standard deviation of the activation signal and noise signal respectively.
In the overview of the SNRterm and CNRterm definitions below, we will focus on those definitions that are commonly found in the literature. In fMRIterm·key simulationterm·mth studies, values for SNRterm/CNRterm are often chosen to give an indication of the strength of the modelled signal relative to the modelled noise. Six different definitions were found in total. We will discuss their definition and whether they should be referred to as SNRterm or CNRterm. Note that, although in most papers these formulae were labelled as SNRterm, the majority of them are in fact CNRterm measurements.
Definition 1 (SNRterm) The first definition models SNRterm based on the mean signal of the fMRIterm·key time series and the standard deviation of the noise in the time series [19] , [20] , As such, the global signal level, comprised of the baseline and activation, is related to the noise.
Definition 2 (CNRterm) In contrast, an amplitude measurement can be related to the standard deviation of the noise [21] – [24] and [25] , The amplitude of the signal is generally defined as the absolute difference between the baseline of the signal and the signal peak ( Figure 2 ).
Definition 3 (CNRterm) The previous definition of the CNRterm can also be transformed in decibel (dB) scale, which is a common scale in signal processing [26] – [28] , Definition 4 (CNRterm) Another possibility is to model the strength of the signal based on the standard deviation of the activation signal [29] – [35] , This definition is also implemented in the DCM simulator [36] and is a very intuitive measurement of CNRterm because the ratio of the fluctuations of both activation signal and noise is calculated.
Definition 5 (CNRterm) [37] and [38] used the ratio of the variances, which is of course equal to the square of Definition 4.
Definition 6 (CNRterm) Again, the ratio of the standard deviations is also found in dB scale [39] – [44] , Comments on the definitions Figure 3 provides an overview of the frequencies in which the definitions discussed above are reported in fMRIterm·key simulationterm·mth studies. About one third of the studies does not mention any SNRterm value, another third defines separate parameters for percent signal change (perc. sign. ch.) of the activation signal and for the noise level. The remainder of the studies mentions one of the definitions of which definitions 2 and 4 seem to be the most popular.
Percentage of the 119 simulationterm·mth studies from the literature search that reported a specific SNRterm/CNRterm definition.
Definition 1 is actually a measurement of tSNRterm [9] . Baseline levels are highly dependent on the specific scanning parameters that are used to acquire the fMRIterm·key data. Moreover, because the BOLDterm·key signal fluctuations are very small, no real information about the activation signal strength is included in this definition, which makes it possibly not very suitable for task-related fMRIterm·key data. In fact, the higher the baseline value of the data, the less impact the activation signal will have on the value of the SNRterm. Therefore, the SNRterm value of a certain voxel in itself will not be informative to distinguish active from non-active voxels. On the other hand, tSNRterm can be very useful to evaluate resting-stateterm·key fMRIterm·key, because it provides very accessible and easy to interpret information on the variation of the noise level over the brain.
In contrast, the remainder of the definitions all include some measurement of the activation signal strength. Therefore, these definitions are referred to as CNRterm formulae. It should be clear that, in theory, the value for these CNRterm definitions will always be zero for non-active voxels and larger than zero for active voxels. Consequently, theoretically it would be possible to detect active voxels based on their CNRterm value. In practice however, the activation signal is stricto sensu unknown and it may be complicated to calculate CNRterm values for single voxels.
For the CNRterm definitions, two different sets can be distinguished; the first set (Definition 2–3) focuses on the amplitude of the activation signal, , while the second set (Definition 4–6) incorporates the standard deviation of the activation as the signal of interest. With regard to the first set, these formulae can be interpreted as definitions of effect size based on means or differences between means, like for example Cohen's [45] . As such it is a direct indication of the strength of the signal.
Note that in our literature search, we also found possible negative SNRterm values, which might be confusing to many neuroscientists. These negative values stem from definitions 3 and 6 that define CNRterm on the dB scale, which are often used in signal processing. On this logarithmic scale, a value of 0 means that an equal amount of signal compared to noise is present in the data. Therefore, negative values are an indication of less signal than noise, while positive CNRterm values according to these definitions represent more activation signal than noise.
In the case of a block activation signal ( Figure 2 ), the determination of the amplitude is quite straightforward. However, this is not the case in, for example, an event-related design. In this experimental design, it is typical that multiple events will cause several peaks in the signal and the timing of the stimuli will have an effect on the height of the peak. In this case, the amplitude of the signal could be either the difference between the baseline and the maximal height of the signal, or the mean amplitude over all peaks. In contrast, calculating the standard deviation of the activation signal, , is independent of the experimental design (i.e. block or event-related designs).
So far, the definitions described above were only discussed based on a single condition experiment. As soon as multiple conditions are considered in a experiment, it is not quite clear anymore how to calculate the SNRterm or CNRterm of the fMRIterm·key data. One option could be to determine the SNRterm/CNRterm for each condition separately, which would be valid when distinct regions are activated by the conditions. Another option could be to first create an expected activation signal based on a contrast between the conditions, and then to calculate the SNRterm/CNRterm of the contrast signal in the same manner as for single condition time series. In this way, the signal of interest is directly based on the contrast that will be tested.
In essence all of these definitions have the same denominator (i.e. ) so that differences are just scaling differences based on the definition of the activation signal. One desirable property for an SNRterm or CNRterm definition of fMRIterm·key time series would be that it is closely related to the activation detection powerterm·key. If the SNRterm/CNRterm is high, then the power should be high too (keeping everything else constant). Secondly, the scaling differences make it hard to compare the values of the discussed definitions. In the remainder of this paper, we will present some tools that will enable comparison among the different definitions and further, we will shed some light on the relationship with activation detection powerterm·key.
Comparing the SNRterm and CNRterm values Due to the fact that there is no consensus on how to define the SNRterm or CNRterm for fMRIterm·key data, interpreting a value can be an almost impossible job. Dependent on how the SNRterm/CNRterm is calculated, the values will be on a different scale. This impedes comparability between fMRIterm·key studies and consequently delays convergence of conclusions. In order to facilitate the comprehension of SNRterm and CNRterm values, three reference tables were assembled ( Table 1 – 3 ), based on the three experimental designs that were also used in the simulationterm·mth study. For all levels of the noise and activation parameters, the SNRterm or CNRterm according to the six definitions was calculated and the results are presented in Table 1 , Table 2 and Table 3 . Note that for the ER design the amplitude was defined as the maximal amplitude (i.e. amplitude of the highest peak). In the case of the contrast design, the SNRterm and CNRterm values were calculated based on the contrast signal that was the difference of the activation signals of the two conditions. The amplitude of this contrast signal was calculated as the difference between the maximum and the minimum.
Reference table for the different SNRterm/CNRterm definitions based on a block design.
Reference table for the different SNRterm/CNRterm definitions based on a contrast.
Reference table for the different SNRterm/CNRterm definitions based on an ER design.
The results in Tables 1 – 3 demonstrate that the SNRterm definition (Definition 1) is highly dependent on the value of the baseline, since the formula is based on the mean signal strength. Additionally, the obtained values are almost invariant to changes in the activation signal strength and the experimental design.
The CNRterm definitions based on the amplitude of the signal (Definition 2 and Definition 3) are also partially determined by the baseline since the (maximal) amplitude of the signal will always correspond to the % signal change relative to the baseline. However, given the relative % signal change of the activation or contrast signal, the amplitude is constant over experimental designs. This is not true for the CNRterm definitions based on the standard deviation of the activation signal (Definition 4, Definition 5 and Definition 6). Although these CNRterm definitions are completely independent from the baseline, the activation standard deviation will be influenced by the number of events in an ER design or by the length of the epochs in a block design. The reference tables ( Table 1 , 2 and 3 ) illustrate this variation, but the close range of these CNRterm values over the designs indicates that this variation is rather small. Therefore, the reference tables presented here provide a tool to roughly compare and interpret the values for the different SNRterm/CNRterm definitions.
Analytic similarities Of course, the conversion of one definition to another can also be solved analytically in some cases. For completeness, we explicitly demonstrate here the analytic similarities between the SNRterm/CNRterm definitions. Given the percent signal change of the activation signal, the amplitude of the signal will be defined as with the baseline of the activation signal. A CNRterm value calculated based on Definition 2 or Definition 4 can be converted to a CNRterm value in dB, using Vice versa, a dB CNRterm value can be back transformed to the CNRterm in the original scale, , by Since the standard deviation of the activation signal (as in Definition 4–6) will be partially determined by the experimental design, there is no direct way to go from the percent signal change to the standard deviation. To compare these CNRterm values, either the reference tables, listed here, can be used to provide a rough estimate, or the values have to be calculated specifically for each design.
The relationship with detection power There is no discussion on the fact that SNRterm or CNRterm is somehow related to activation detection powerterm·key. Indeed, the higher the signal or the lower the noise (i.e. higher values for the SNRterm/CNRterm), the higher the power will be. Naively, one could expect that, when, for example, SNRterm and the power , the power will increase to 0.60 for data with an SNRterm of 10. In other words, one may expect an approximate linear relationship between SNRterm/CNRterm values and the power to detect activation. In order to establish the approximate relationship between activation detection powerterm·key and the SNRterm/CNRterm definitions, power results are presented in the last column of the reference tables ( Tables 1 – 3 ). Note that these results represent maximal power values. In real fMRIterm·key data, the power will be smaller due to the influence of non-white noise.
Looking at the results, we can immediately conclude that the simple rule “twice as much signal will double the power” is not valid. Indeed, as power is bounded, a linear relationship with the signal is impossible. In general, the power will be lower for the time series that contain more noise, but their is no linear relationship with the SNRterm or CNRterm values. This is illustrated in Figure 4 for the case of 1% signal change. However, comparing the power values for the different designs, overall lower values can be observed for the ER design notwithstanding equal activation strengths and noise levels. This lower power is in itself not that surprising, but this can only be predicted based on the CNRterm definitions that use the standard deviation of the activation signal, since the SNRterm/CNRterm values for the other definitions are constant over the designs. Additionally, in the lower power cases, the CNRterm values of Definition 4 are within the same range, indicating that these CNRterm values can be used as a rough estimate of activation detection powerterm·key.
The relationship between power and the SNRterm/CNRterm definitions for 1% signal change.
Real data example For both datasets we calculated the tSNRterm (Definition 1), the amplitude-based CNRterm (Definition 2) and the standard deviation CNRterm (Definition 4) on the raw data. The tSNRterm was calculated similarly for both datasets. For each voxel the mean and the standard deviation of the corresponding time series were calculated and then divided to determine the tSNRterm. Note that the interpretation of tSNRterm is only useful in gray matter. The results are presented in Figure 5 (upper panel). The tSNRterm of the task-based data is on average 10.83 and ranges between 0.03 and 161.20. For the resting-stateterm·key data, the mean tSNRterm is 12.98, ranging from 1.07 to 84.54. Based on these results, it seems that the data quality of the resting-stateterm·key data is higher compared to the task-based data. Figure 5 (upper panel) also shows that the spatial distribution of the tSNRterm values is more equal for the resting-stateterm·key data (right) than for the task-based data (left).
tSNRterm results of the example data, illustrating how the definitions can be applied to real task-based and resting-stateterm·key fMRIterm·key data. Upper panel: tSNRterm results for a block design. Lower panel: tSNRterm results for the resting-stateterm·key data.
CNRterm values are only informative for the task fMRIterm·key data, so they were not determined for the resting stateterm·key data. To calculate them, we first had to create an activation signal. For the task-based data, the activation signal was calculated by averaging the time series of all voxels within the activation contrast mask (i.e. the mask indicating the mean response over all categories). A second activation signal was calculated for all voxels outside the mask. These activation signals were then subtracted from the individual voxels time series to eliminate the contribution of activation to the time series and isolate the noise. The resulting signals, both activation signals and the noise signal, were used to calculate the parameters for the CNRterm definitions.
The amplitude-based CNRterm measure (left) is on average 37.06 (with a range from 8.17 to 95.73) for in-mask voxels and 0.48 (with a range from 0.01 to 95.73) for out-mask voxels. Similarly, for the CNRterm measure using the standard deviation of the signal, in-mask voxels had an average CNRterm of 0.029 (ranging from 0.06 to 0.76), while out-mask voxels had an average CNRterm of 0.04 (ranging from 0.01–0.76). Of course, it should be noted that these values are highly dependent on how the mask or ROIs are determined.
Discussion fMRIterm·key data are often characterised by their SNRterm or CNRterm. SNRterm measurements are, for example, used to compare scanner hardware or the quality of scanning sequences, while CNRterm can be indicative of the quality (i.e. detectability) of the contrast of interest. In this paper, an overview was provided of common SNRterm and CNRterm definitions in an fMRIterm·key time series context. It was established that the literature lacks consensus on how to define SNRterm/CNRterm for fMRIterm·key data. Consequently, reported SNRterm and CNRterm values are hard to compare, possibly hindering the convergence of conclusions based on fMRIterm·key studies.
Based on how the signal of interest is defined, an explicit distinction was made between SNRterm and CNRterm. SNRterm compares the global signal level to the amount of noise and can be applied to either MRI images or task-related and resting-stateterm·key fMRIterm·key (e.g. tSNRterm). The main purpose of determining the SNRterm of the data will be to assess the quality of the data (e.g. influence of noise). However, when applied to task-related fMRIterm·key data, the SNRterm of the data will most likely miss out on the small fluctuations present in the activation signal that are caused by the task. Therefore, in the case of these particular data, in which the signal of interest is a specific contrast that models the influence of certain conditions, it would be better to consistently use the concept of CNRterm. The CNRterm value will also give an indication of the quality of the data in terms of noise, but additionally it contains information on the strength of the activation signal for a specific task. This information can be related to activation detection sensitivity.
A sceptical reader would argue that it might be meaningless to capture the information present in 4D fMRIterm·key data, which are characterised by very high inter- and intra-subject and -scanner variability, in one single number (either SNRterm or CNRterm). Indeed, for real data, SNRterm or CNRterm values are seldom reported. Moreover, screening of published simulationterm·mth studies teaches us that no less than 62.2% of these studies avoid reporting an SNRterm/CNRterm value. Instead, they reported separate parameters for the activation strength and the noise level. A second problem might be that the same value of SNRterm/CNRterm can indicate different levels of activation strength and noise, which can have a different impact on the detection accuracy. Despite the justly scepticism, determining the SNRterm or CNRterm of fMRIterm·key data can still hold useful information, because it provides an assesment of the quality of the data at a glance. However, we recommend to calculate the values only for small regions that are likely to have the same value of SNRterm/CNRterm based on anatomy or function. For simulationterm·mth studies in particular, it would be interesting to report the SNRterm/CNRterm of the simulated value along with the specific values of activation strength and noise level. As such, generalising the conclusions from these studies to real data will be facilitated.
Conclusion Consensus on a common SNRterm/CNRterm definition for fMRIterm·key data might be difficult to achieve, because the measurement depends very much on how the signal of interest and the noise is defined. Therefore, we strongly recommend that authors reporting SNRterm/CNRterm values, at least mention the type of definition they use and provide an interpretation on the meaning of the reported values. The tables presented in this chapter can then be a reference allowing easy comparison from one definition to another. Furthermore, these tables are an excellent tool to provide an estimate of the maximal power that can be expected to detect activation in data with a given SNRterm/CNRterm value. Finally, a better understanding of the SNRterm/CNRterm values might encourage fMRIterm·key researchers to report these measurements in a more systematic way. Consequently, the ability to compare these reported values will facilitate the convergence of fMRIterm·key based knowledge.
Funding Statement The authors have no support or funding to report.
References