standOff. When we have changed our mind. Some entries in the table begin with a word in capitals and the reason for it. EVIDENCE CORRECTED — the finding still stands, but we had quoted the wrong sentence from the paper, and the quotation has been replaced with the right one. RETRACTED — the entry itself was wrong; it stays on the page, marked, with the reason, rather than being deleted. WITHDRAWN AND REPLACED — the entry was wrong, and a corrected version of it appears in the entries below. Each mark carries its own reason, in brackets, because the reasons differ from one entry to the next. An entry we have WITHDRAWN is removed from this page and kept in the record, with its reason. A line reading Audit and a date is a later re-reading of the entry against its whole sentence: DOUBTFUL means it was kept, and the reason says what is loose about it. Quotation marks inside the tagger's sentence. Where a tag is the tagger's own sentence, a phrase in quotation marks inside it is borrowed from the paper — the tagger's wording around it is not. The paper's own sentence is the evidence quote shown on the same row, so the borrowing can be checked against the thing borrowed from without leaving this page. Nothing inside quotation marks anywhere on this page is ours: if it is quoted, it is the paper's. Whose words a concept carries. A concept entry records a term the paper itself uses, so the term, the sense given for it, and its evidence are the paper's own words, quoted where the paper fixes them. This is the opposite of a sense entry in the tag table, which is the tagger's sentence about how the paper uses a term. Where a concept entry could not be grounded in the paper's words, the entry says so on its own row.| claim type | claim_type | the shape of the claim: existence, mechanism, method, critique, prediction, null |
| concept edge | concept_edges | an asserted relation between two concepts, with the sentence asserting it |
| concept | concepts | an idea the paper works with, quoted where the paper uses it |
| content tag | content_tags | a finding, definition, quantity, statistic or variable named in the paper |
| contribution | contribution | what the paper claims to add |
| control | controls | an experiment run to eliminate a rival explanation |
| limitation | limitations | what the paper says its evidence cannot support |
| mechanism | mechanisms | how the reported effect is said to come about |
| method | method | how the paper produced its evidence |
| object of study | object_of_study | what the paper is about — the thing it investigates |
| phenomenon | phenomenon | the effect or regularity under study |
| research question | research_question | the question the paper sets itself |
| sense | senses | a distinct use of a term, quoted where the paper fixes it |
Deep learning unmasks the ECG signature of Brugada syndrome
Abstract
concepts↗concepts↗concept_edgesOne in 10 cases of sudden cardiac death strikes without warning as the result of an inherited arrhythmic cardiomyopathy, such as Brugada Syndrome (BrS). concepts↗concepts↗concept_edgesNormal physiological variations often obscure visible signs of this and related life-threatening channelopathies in conventional electrocardiograms (ECGs). Sodium channel blockers can reveal previously hidden diagnostic ECG features, however, their use carries the risk of life-threatening proarrhythmic side effects. The absence of a nonintrusive test places a grossly underestimated fraction of the population at risk of SCD. object_of_studyHere, we present a machine-learning algorithm that extracts, aligns, and classifies ECG waveforms for the presence of BrS. This protocol, which succeeds without the use of a sodium channel blocker (88.4% accuracy, 0.934 AUC in validation), can aid clinicians in identifying the presence of this potentially life-threatening heart disease.
Keywords: artificial intelligence, Brugada Syndrome, deep neural network, electrocardiogram, Sudden Cardiac Death
Sudden cardiac death (SCD) persists as a significant public health problem, claiming millions of lives every year, including many young and otherwise healthy individuals. Among patients without evident structural heart disease, SCD often occurs as the first clinical manifestation of an inherited disorder, such as Brugada Syndrome (BrS). Unfortunately, such patients seldom show overt signs of disease. research_questionphenomenonThe present study demonstrates that a deep neural network can detect the signature of BrS in an ECG, even in the frequent case when these signs are undetectable by the human eye. This tool, when applied to routine clinical ECGs, will alert clinicians to potentially life-threatening conditions that would otherwise go undiagnosed.
Introduction
concepts↗concepts↗concept_edgescontent_tagsSudden cardiac death (SCD) kills more than 4.2 million people worldwide every year ( 1 ). Among young and otherwise healthy individuals, SCD often appears without warning as the first clinical manifestation of an inherited arrhythmic disease ( 2–4 ), such as Brugada Syndrome (BrS) ( 5–8 ). Two-thirds of patients afflicted with BrS show no symptoms of cardiovascular disease, and SCD often serves as its first clinical manifestation ( 5 ).
The hidden and dynamic nature of this disease underlines the need for an improved diagnostic test ( 9 ). The incidence of confirmed BrS varies by country ( 5 ); but, the difficulty of diagnosis coupled with the complex genetic architecture ( 10 , 11 ) and inheritability of this disease suggests that its true prevalence is unknown. Most affected patients present a normal ECG, and nearly half of BrS-afflicted individuals who survive a cardiac arrest fail to show a diagnostic type 1 pattern in a routine ECG ( 12 ). Both factors severely hinder the recognition of this lethal disease.
concepts↗concepts↗concept_edgesWhere permitted, cardiologists may administer one of several sodium channel blockers (SCB) to unmask the BrS type 1 pattern ( 5 , 13 , 14 ) as demonstrated in Fig. 1 . However, these drugs can cause life-threatening proarrhythmic effects, which limit their use to those individuals with a known family history of SCD ( 15 , 16 ). And ajmaline, the most effective diagnostic SCB, is unavailable for clinical use in many countries. including the United States of America and Japan. Thus, the development of an easily applied, nonintrusive BrS diagnostic test remains an important and pressing objective.
Representative heartbeats recorded for V1, V2, and V3 in ( left ) baseline electrocardiograms of three typical patients diagnosed as spontaneous type 1 BrS( + ) ( top ), BrS( + ) ( middle ), and BrS( − ) ( bottom ). Electrocardiograms are recorded during ajmaline administration for patients not presenting a spontaneous type 1 pattern ( right ). Note the ST-elevation feature signifying BrS in the type 1 ECG traces. sensescontent_tagsIn our study, only 17% of BrS( + ) patients exhibit a spontaneous type 1 pattern, while the remaining 83% of patients required an ajmaline challenge to reveal a hidden type 1 pattern.
The interpretation of an electrocardiogram for medical diagnosis requires the application of expert knowledge in a full consideration of the many interconnected factors that influence ECG waveform patterns. concepts↗concepts↗concept_edgesThis central problem of learning and retention lends itself well to an approach that classifies on the basis of a deep neural network (DNN), tied to a very large library of digital waveform standards ( 17 ). An extensive body of effort has applied artificial intelligence with the processing power of modern computers to recognize diagnostic features of gross rhythm disorders such as atrial fibrillation, and certain common cardiomyopathies for which large digital ECG databases exist ( 18–30 ). However, thus far, machine learning has yet to establish digital signatures for more subtle, but no less-threatening conditions such as BrS, often harbored by asymptomatic individuals who present apparently normal ECGs. The difficulty of assembling a large-scale digitized dataset of expertly diagnosed ECGs presents a significant challenge to progress ( 31 ).
Here, we describe the development of a robust noninvasive method to diagnose the electrophysiological signature of BrS from the digital analysis of a routine clinical electrocardiogram. This work differs substantially from the many other machine-learning approaches to ECG classification, particularly those that target BrS with only a capacity to identify affected individuals who present a visible type 1 pattern in their baseline ECG ( 32–35 ).
method↗sensesRather than surveying a continuous ECG for abnormalities, much like a medical professional might perform a visual assessment, our approach reduces a standard multi-lead ECG trace to a set of high-quality representative single heartbeats, one for each lead, and then classifies upon this basis. This preprocessing strategy better isolates the persistent baseline function of the heart’s electrical conduction system by overcoming transient uncorrelated beat-to-beat variance present in the raw traces. mechanisms↗This dimensionality reduction helps the neural network recognize the persistent ECG features that most consistently encode for BrS.
Methods
Study population
content_tagsThe present study draws upon an existing database of 1,455 consecutive patients undergoing electrophysiological evaluation for the diagnosis of BrS at the Arrhythmia Department of IRCCS Policlinico San Donato (San Donato Milanese, Milano, Italy), beginning in April 2015 (Fig. 2 and Table S1 ).
(A) Flowcharts illustrating the organization of electrocardiograms into one cohort for the purposes of training and validating DNN models, and into a second cohort for independent validation. (B) Distributions of patient clinical statistics, including medical and family history in the Claris training cohort. RBBB refers to right bundle branch block. Complete details can be found in the Supplementary material .
A second set of ECGs, collected in a separate clinic beginning in March 2020, serves as a second independent validation cohort, consisting of 405 consecutive new patients in the Brugada screening program (Table S2 ). The data collected for each patient include a physical examination, complete personal and family medical histories, and a complete set of digital ECG traces.
These populations each contain two overarching classification groups. Patients in the Brugada Group BrS( + ) present evidence of a spontaneous or drug-induced type 1 BrS ECG pattern. concepts↗content_tags↗The Control Group BrS( − ) is comprised of patients, all of whom presented a negative sodium channel blocker test, defined as an ECG that does not convert to yield a type 1 pattern after a pharmacological provocation test (ajmaline injection at the maximal dose of 1 mg/kg, according to the current consensus statement ( 5 )). Although we obtained ECGs for eligible patients during ajmaline administration to confirm BrS diagnoses, we trained and tested our classification algorithms exclusively on baseline ECGs, recorded without ajmaline.
The study patients presented as candidates for ajmaline infusion owing to diagnostic indicators of risk, associated with the possibility of BrS for at least one of the following reasons: (i) Family history of SCD or family history of BrS, (ii) unexplained syncope, (iii) nondiagnostic Brugada pattern or suspicious ECG, (iv) aborted cardiac arrest, (v) unexplained ventricular arrhythmias. The exclusion criteria for the ajmaline test included the presence of a spontaneous type 1 pattern ( n = 106 ; 7.3 % ), an established diagnosis of an overt structural cardiomyopathy, and severe conduction disturbances (e.g. left or right bundle branch block with QRS > 140 ms ). During the study period, a small number of patients ( n = 53 ; 3.5 % ) refused to undergo the ajmaline test. This retrospective study subscribed to the plan described in a protocol approved by the Ethical Committee of the I.R.C.C.S. Policlinico San Donato. All participants provided informed consent.
Acquisition and storage of ECG traces
All ECG records were digitally acquired and stored in the Arrhythmology Department digital repository at the IRCCS Policlinico San Donato. The principal calibration and validation effort relied upon measurements made using a set of Workmate Claris instruments (Abbott Laboratories, Abbott Park, IL, USA). The hospital outpatient clinic afforded ECGs for the supplemental validation cohort recorded using a Mortara ELI 350 system (Mortara Instrument, Inc., Milwaukee, WI, USA).
Both systems were configured to simultaneously acquire and digitize two limb leads (L1, L2) and six precordial leads (V1 through V6), and automatically reconstruct the 12-lead ECG. The Claris system records the ECG with a sampling frequency of 2,000 Hz and a resolution of 5 μ V, while the Mortara system records at a sampling frequency of 1,000 Hz and a resolution of 1 μ V. All ECG records were collected using a customized high precordial lead placement optimized for the detection of the BrS ECG pattern. The six precordial leads were placed at the left and right parasternal positions in the second (V1 II ICS, or V1; V2 II ICS, or V2), third (V1 III ICS, or V3; V2 III ICS, or V4), and fourth intercostal spaces (V1 IV ICS, or V5; V2 IV ICS, or V6).
All patients exhibited stable sinus rhythm during baseline ECG acquisition without premature ectopies. All baseline ECG records were analyzed by three trained and independent cardiologists, who each provided an initial index classification: (i) normal (i.e. no evident abnormalities resembling a BrS pattern), (ii) spontaneous type 1 BrS pattern, and (iii) suspicious BrS pattern (i.e. ECG abnormalities including but not limited to complete or incomplete right bundle branch block, type 2, or type 3 morphology).
Routine diagnosis calls for the acquisition of a baseline ECG, followed by one recorded prior to and during an ajmaline challenge for all cases, except for patients whose baseline ECG exhibited a spontaneous type 1 BrS pattern. Approximately one minute of an ECG recording prior to ajmaline administration was recorded, anonymized, and exported as a set of text files from the hospital database. Additional patient clinical characteristics, including age, sex, personal history of syncope and cardiac arrest, and family history of sudden death and BrS diagnosis, were also logged in the export files as additional factors of variation. This information was archived in an SQL database. ECG traces recorded on the Mortara system were collected for a new set of patients upon admission to the hospital and reserved for independent validation. ECG traces recorded from both systems are subject to the same ECG trace processing, outlined below.
ECG trace processing
We reduce the pulse train in each lead to a single de-noised and representative heartbeat. This procedure, which is detailed in the Supplementary material , combined with down-sampling to 200 Hz, yields a much sparser representation (Fig. 3 a). Averaged, single-lead heartbeats, concatenated end-to-end, forms a fused, one-dimensional representation of the entire electrocardiogram for each patient. The results presented in this study classify on the basis of a 9-lead ECG (all leads excluding the unipolar limb leads aVF, aVR, and aVL). In the Supplementary material , we additionally explore individual and other lead combinations in detail.
(A) Flowchart illustrating the ECG data processing workflow from trains of heartbeats as monitored by each ECG lead, to segmentation, outlier discrimination, and averaging to form a set of single representative beats. (B) Structure of the neural network used for training the Brugada syndrome classifier including input, hidden, and output layers. The hidden layer unit includes a fully connected layer followed by Gaussian noise, ReLU activation, and batch normalization. The hidden layer unit is repeated three times, followed by a fully-connected output layer with sigmoid activation. (C) Data partitioning strategy for training a neural network. concepts↗concepts↗concept_edgesThe overall data partitioning scheme implements leave-one-out cross-validation (LOOCV) to assess the performance of independent neural networks constructed for every patient. For each patient, a 7-fold cross-validation separates the dataset into seven training and validation subsets, each tested on the holdout patient. This analysis yields an average score and standard deviation for each patient across the 7-fold DNNs.
limitationsThe results reported here stem from the analysis of retrospective clinical databases. The ECGs in these databases were not recorded for the purpose of digitally training a machine-learning algorithm, but rather to enable a clinician to assess visually for the presence of diagnostic features. Consequently, we found it necessary to screen for measurement artifacts and deemed some recordings unsuitable for multivariate analysis. We performed this screening manually prior to any application of machine learning. content_tagsAs diagrammed in Fig. 2 a, 1,455 unique patients yielded a set of 1,154 high-quality ECGs. A total of 370 of 405 ECGs met acceptance standards in the Mortara validation cohort.
Neural networks
The representative heartbeats for each patient, along with the attendant factors of variation populate a design matrix X E C G . We define a disease-state vector Y by assigning 0 or 1 to every ECG, representing Brugada-negative and-positive, respectively, determined by the presence or the absence of a type 1 ECG pattern, confirmed where necessary by a positive response to ajmaline.
We train a deep neural network (DNN), consuming the elements of the design matrix X E C G . supervised by the disease state Y , to optimize the parameters of a classification function F ( X E C G ) = Y (Fig. 3 b). Details about the training, optimization, and validation procedures for our neural networks can be found in the Supplementary material . All computer codes developed for ECG processing, neural network training, and statistical analysis are written in-house using Python 3.9 and Tensorflow 2.
Independent validation of DNNs
Two distinct tests confirm the validity with which the DNN models developed in this work classify newly encountered ECGs for BrS. A large-scale process of leave-one-out cross-validation (LOOCV) (Fig. 3 c) independently gauges the degree to which ensemble learning correctly classifies each and every individual patient in the training dataset.
In a procedure repeated for all N patients in the database, we withhold one patient in turn and use the N − 1 other patients to train a distinct set of seven DNN models that are blind to the withheld patient. We employ ensemble learning for each N − 1 training subset to minimize sampling bias and overfitting. Consequently, a unique set of seven DNN models trained on exclusive N − 1 populations subsampled by 7-fold cross-validation independently classify each patient.
concepts↗content_tags↗By design, the corresponding set of seven independent DNN models assigns a set of seven numbers between 0 and 1 to every withheld ECG, which we term the DNN score, or y ^ , which could be interpreted as a probability of positive diagnosis. We compute the final DNN score for each validated patient as the average of the scores produced by the corresponding seven exclusive DNNs. We further test the utility of a DNN model trained by all the Claris patients by deploying it to classify a second independent cohort of validation data containing 370 patients (Mortara dataset).
Interpreting statistical results
We gauge the validation success of the DNN models by means of the areas under curve (AUC) of receiver-operating characteristics (ROC) plots ( 36 ). DNN scores close to 0 or 1 indicate high classification certainty for the absence or the presence of a BrS pattern, respectively, while scores close to the decision threshold of 0.5 point to ECGs that yield a low classification certainty. content_tags↗The decision threshold of 0.5 is determined using Youden’s J statistic ( 37 , 38 ).
To assess our results, we compare continuous variables using a Student t -test and binomial variables with χ 2 or Fisher’s exact test, as appropriate. We compute the AUC of ROC curves of DNN performance, determining confidence intervals by DeLong’s method ( 36 ), and recognizing statistical significance for p < 0.05 . Further details on statistical analyses and methods for minimizing overfitting are described in the Supplementary material .
Results
Independent validation within the claris training dataset
content_tagscontent_tags↗content_tags↗The DNN, applied in LOOCV within the Claris (training) dataset, correctly predicts the ajmaline response for 84.0% (969 of 1,154) of patients, with an AUC of 0.912 ± 0.017 (Fig. 4 ), a sensitivity of 85.4%, and a specificity of 82.4% (Tables 1 , S1 and S5 ). Furthermore, the DNN classifies patients showing a spontaneous type 1 pattern with an accuracy of 100% (103 of 103).
Receiver–operator characteristic curve for the Claris (training, green, plotted foreground) and Mortara (independent validation, orange, plotted foreground) cohorts.
Classification metrics of the trained neural networks on independent holdout cases in the claris (training) and mortara (independent validation) cohorts.
We determine that the 9-lead fused representative ECG trace yields the best classification performance by comparing AUC values for various lead combinations (Table S4 ). content_tagsThe incorporation of clinical factors of variation such as age, gender, and family history of cardiac events did not significantly change the DNN performance (Table S6 ). In a thorough exploration of classification strategies, we observed superior performance of the training dataset DNN to other popular supervised learning techniques such as a convolutional neural network (CNN) (Tables S8 and S9 ), decision trees, Naive Bayes, support vector machines (SVM), and k-nearest neighbors (KNN), among others (Table S12 ).
Cross-platform independent validation
We performed a second independent validation of a seven-DNN ensemble trained on the basis of the 1,154 patients in the Claris (training) cohort by applying this model to classify for BrS in a new prospectively-studied cohort. Routine examinations at the IRCCS Policlinico San Donato outpatient clinic using several available Mortara ELI 350 instruments afforded a supplemental set of 370 ECGs, which served to define a separate, independent validation cohort. Table S3 details the composition and clinical characteristics of this cohort.
content_tagscontent_tags↗The DNN model, entirely calibrated and validated using data from the Claris platform, correctly identifies BrS( + ) patients in the independent Mortara cohort with an accuracy of 85.1% (327 of 370), an AUC of 0.934 ± 0.027 (See Fig. 4 ), a sensitivity of 79.6%, and a specificity of 93.6% (Table 1 ). The 9-lead classification metrics of this cross-platform independent validation compare with those of the DNN applied to the Claris cohort training data (Table 1 ). Additionally, the DNN correctly classified 100% of the spontaneous BrS type 1 patients. Table S8 further details the accuracy with which the DNN classifies the Mortara cohort.
Comparative manual assessment of the mortara cohort
As a gauge of the present machine learning approach against standard clinical practice, we compiled the diagnoses of two clinicians at the IRCCS Policlinico San Donato, who visually inspected and classified the ECG records in the Mortara cohort, without knowledge of the accompanying ajmaline-confirmed BrS diagnoses. Table 1 summarizes the results. controlscontent_tagsAn expert cardiologist with more than 20 years of experience in clinical arrhythmology and electrophysiology (M.D. 1) classified the Mortara cohort ECGs with an accuracy of 72.4%, a sensitivity of 71.5%, and a specificity of 73.0%. Table S10 provides details. A resident clinician in training (M.D. 2) performed the same classification with an accuracy of 58.9%, a sensitivity of 55.5%, and a specificity of 60.9%. See Table S11 . Most tellingly perhaps, AUC values for MD1 and MD2, 0.722 ± 0.047 and 0.582 ± 0.052 , compare with 0.934 ± 0.027 found in validation of the DNN by the Motara cohort.
DNN feature importance
Figure 5 shows a heatmap indicating the importance of ECG features as perceived by the DNN. concepts↗The type 1 BrS pattern is characterized by a “coved-type” ST segment, while the type 2 pattern is characterized by a “saddle-back” shape with an ST elevation of ≥ 1mm in leads V1 to V3. As such, a neural network classification model that seeks only the type 1 or 2 patterns would likely place a significant weight on the ST-segment of leads V1 to V3. content_tagsHowever, while our DNN model does assign some importance to these regions, it Classifies ECGs on the basis of a complex multivariate relation among waveform amplitudes, including a nonlinear combination of the ST-segments from V1 and V2, and the QRS complexes in leads I, III, V1, V2, and V6. We did not provide our DNN model with any input weights, nor did we label any regions of the ECG as important. Thus, the regions of the fused representative ECG indicated in Fig. 5 detail a positive response to the SCB challenge ab initio . Importantly, note that the DNN model assigns virtually no weight to the eight junctions at which we have concatenated the representative beats from each lead. This DNN indifference affirms the robustness of our preprocessing approach.
DNN feature importance shown on a 9-lead fused ECG trace, representative of the DNN training data. The colormap displays the magnitude of the weights applied by the DNN when predicting ajmaline response. The weights range from 0.0001 to 0.3021; higher–weighted regions have a greater influence on the DNN model.
Discussion
The present study demonstrates a neural network model that learns to recognize the signature of Brugada Syndrome hidden in a conventional ECG in the absence of any proarrhythmic drug challenge. These results establish that an appropriately trained DNN model responds to subtle ECG abnormalities that are undetectable to the human eye. The algorithm correctly classifies a majority of ECGs by predicting the response of a patient to an ajmaline challenge without the need for other clinical information. limitationsDespite the relatively limited size of this database, the neural network assesses apparently normal ECGs with an AUC of 0.912 ± 0.017 (accuracy of 84.0%) and 0.934 ± 0.027 (accuracy of 88.4%) in the training and validation datasets respectively.
To date, when evaluating a patient at an arrhythmia clinic, the clinician must decide whether to administer a sodium channel blocker in an effort to unmask the BrS phenotype ( 5 , 13 , 14 , 39 , 40 ). This drug challenge exposes the patient to the possibility of a life-threatening arrhythmia; but, a decision not to challenge risks overlooking a patient with hidden BrS. At present, owing to the possibility of life-threatening side effects, only patients with a family history of SCD or a suspicious ECG undergo a drug challenge.
Thus, many people who show no visible sign of BrS may well remain undiagnosed ( 9 ). The identification of BrS is particularly limited in countries, including the United States of America and Japan, where ajmaline is generally unavailable, and the SCB challenge is limited to less effective agents such as procainamide and flecainide. Moreover, several conditions expressly contraindicate this diagnostic approach. For example, a fatal ventricular arrhythmia calls for the assessment of family members for BrS; but, clinicians may hesitate to administer ajmaline to children. This limitation may leave many young carriers of BrS undiagnosed. These drugs are also contraindicated in cases of pregnancy, liver diseases, and advanced cardiac conduction disturbances.
Sodium channel blockers have negative inotropic properties that preclude use for patients suffering from cardiomyopathies, particularly those associated with mutations in the SCN5A gene and other conditions overlapping with BrS, such as hypertrophic cardiomyopathy (HCM) and arrhythmogenic right ventricular cardiomyopathy (ARVC) ( 41–44 ). Dynamic effects of these drugs vary a great deal from individual to individual, and this clouds the significance of any particular test result. The direct hepatotoxic effect of these agents further excludes their diagnostic applicability as a screening tool.
Thus, significant considerations limit the diagnostic application of SCB drugs compared with an instrumental measure of heart function, such as an electrocardiogram, which does not rely upon the action of an agonist. limitationsWhile work still remains to validate machine-learning classification algorithms for patients with accompanying conditions not considered in the present study, the accuracy demonstrated thus far, approaching that normally achieved in SCB tests, offers a potential of great benefit as a safe first step in screening a wider population.
To this purpose, several studies have reported the usefulness of some ECG parameters in the discrimination of BrS patterns ( 45–49 ). However, intra- and inter-observer variability in specific measurements limit the power of univariate pattern-recognition methods. More generally, the ability to identify ECG predictors of BrS depends on a clinician’s level of clinical experience. Very recently, a convolutional neural network approach showed success in recognizing the characteristic ST elevation of a type 1 BrS pattern ( 33 ). However, only a small fraction of BrS( + ) individuals spontaneously present this plainly visible ECG feature.
Indeed, in the present cohort, roughly 90% of patients showed a near-normal or merely suspicious ECG waveform, challenging to evaluate even by experienced cardiologists. Thus, the development of this advanced DNN-based ECG interpretation algorithm promises to aid in the diagnosis of BrS by providing a discerning and objective tool to assist the clinician prior to the possible use of potentially harmful SCB challenges. This tool will add considerable insight when clinicians, in keeping with current guidelines, combine the results of an ECG with a full scope of other clinical data to establish a final diagnosis of BrS ( 5 ). The Supplementary material offers additional details concerning classification success upon manual versus DNN analysis with reference to patient demographics and clinical characteristics.
The sensitivity and specificity of our DNN model compare favorably with other diagnostic tests used in cardiology, such as exercise electrocardiography to diagnose coronary artery disease ( 50 ), and exceed other medical screening tests, such as the BNP immunoassay for heart failure (AUC 0.60–0.70) ( 51 ), the Papanicolaou smear for cervical cancer (AUC 0.70) ( 52 ), and the CHA2DS2-VASc Score for stroke risk (AUC 0.57–0.72) ( 53 ). concepts↗concepts↗concept_edgesMoreover, the relatively high negative predictive value (NPV) of the DNN classification will lend reassurance in decisions to forego the invasive and risky step of an ajmaline challenge. The current findings will translate to a clinical application that informs clinicians who are considering ordering an SCB challenge for suspected Brugada Syndrome.
Of 1,455 patients in the present cohort, 7% presented an ECG with a spontaneous type 1 pattern. Using standard clinical protocols, a conventional BrS screening program would have found only these patients. content_tagsAmong asymptomatic individuals in this study, we diagnosed more than 49% as having BrS. Most of these patients had no idea that they carried this condition. They were referred for screening only because of the sudden and unexplained death of a relative, reinforcing the idea that the actual prevalence of BrS is likely underestimated.
Remarkably, the DNN model correctly classifies every patient who presented a spontaneous type 1 ECG. This marker signals a heightened danger of cardiac arrest ( 5 , 54 , 55 ). But, nearly half of BrS patients who survive cardiac arrest do not show a spontaneous type 1 pattern, underlining the critical need to clinically identify patients that harbor a hidden disease signature and face a substantial probability of SCD ( 12 ). In young adults, the first clinical manifestation of BrS is often atrial fibrillation ( 56 ). This suggests that BrS may represent a complex and diffuse phenotype, sharing genetic mutations with various supraventricular arrhythmias ( 43 , 57 , 58 ), as well as with other cardiomyopathies, such as HCM ( 44 ), ARVC ( 10 ) and early repolarization syndrome ( 59 ).
This broader relevance points to an additional reach of noninvasive BrS screening as a means to reduce the risk of life-threatening arrhythmias and sudden death. This is particularly relevant for patients who present a nondiagnostic ECG pattern that may mask a clinically aggressive phenotype requiring further cardiac investigation. The classification success of the DNN suggests that machine learning will enable clinicians to identify these patients even from an apparently normal ECG.
Furthermore, as plainly evident in Fig. 4 , a completely independent cross-platform dataset validates the DNN with virtually the same accuracy (AUC 0.93 vs 0.9) as LOOCV applied to the training dataset. This not only proves again that the algorithm generalizes well to classify previously unseen data, but also to successfully classify ECG data acquired on different machines. A larger ECG dataset and multiparametric diagnostic assessment, performed by combining ECG machine learning and genetic information ( 60 ), could provide better accuracy, and advance substantially in diminishing the devastating impact of a family of lethal diseases by screening the general population. Additionally, next-generation electrocardiographs and new implantable or wearable devices could support operating systems that incorporate artificial intelligence built upon this DNN model for output processing ( 61 ).
A DNN algorithm for assisting the diagnosis of BrS offers several advantages compared with current practices: (i) reduction of test-related adverse events, such as life-threatening arrhythmias and ajmaline-induced liver injury, (ii) reduction of the cost compared with an SCB test, which must be performed in a hospital setting, and (iii) identification of family members at risk of BrS in centers with limited access to drug testing or no access to ajmaline.
Interpreting DNN feature importance
Understanding where a DNN places the greatest importance in the input data is crucial for interpreting the decisions a model makes (see Fig. 5 ). By identifying which ECG features the DNN weights most heavily in its classification model, we can understand which aspects of the ECG signal play the greatest role in identifying the BrS phenotype. This information can help guide the selection of new data for training, improve the interpretability of the model, and explain why the model might fail to correctly identify the BrS phenotype in some cases.
We observe that the DNN’s interpretation largely aligns with the cardiologists’ approach, as it considers not only ST elevation, but also other aspects of the ECG, including QRS interval, QT interval, J point depression, and the presence of an incomplete right bundle branch block. This convergence is significant, as it illustrates how the DNN learns to recognize important ECG features in a completely unbiased data-driven approach, supervised solely on a patient’s response to the ajmaline challenge.
DNN multivariate classification evaluates ECG data by means of thousands of nonlinear decision-making pathways, allowing it to identify patterns and features that escape notice in conventional approaches. This enables the DNN model to recognize subtle covariance of diagnostic significance. We believe that feature importance patterns established by our DNN approach could help refine and expand the understanding of Brugada Syndrome, potentially leading to the development of more robust diagnostic criteria.
The substantial data preprocessing method described here reduces a raw, noisy ECG trace to yield a representative heartbeat as a single, averaged complete cardiac cycle (750 ms in duration) centered near the R peak. The high signal-to-noise representative heartbeat yields a persistent, reproducible waveform for classification by the DNN. Our segmentation strategy overcomes uncorrelated beat-to-beat variance in the raw traces. This transformation aids the DNN in recognizing persistent ECG morphology that consistently encodes for BrS while ignoring transient abnormalities.
Conclusion
contributionclaim_typeThe present work demonstrates an ECG screening algorithm for BrS that competes with the sodium-channel-blocker challenge while presenting the clear advantage of no life-threatening side effects. This mode of computer-assisted analysis can be applied to digital ECG traces from all current electrocardiographs. The broad application of this methodology will enable clinicians to test widely for this deadly disease. We foresee that this machine learning approach to ECG analysis will extend beyond the diagnosis of BrS to broader risk stratification and mitigation of SCD.
Supplementary Material
Click here for additional data file.
Acknowledgments
The authors wish to express their gratitude to the I.R.C.C.S. Policlinico San Donato for providing resources and a conducive environment facilitating the success of this research. Thanks in particular go to Flavio Mastrocinque and Roberto Manuello for technical assistance in ECG database management.
Contributor Information
Luke Melo, Department of Chemistry, University of British Columbia, Vancouver, BC V6T 1Z1, Canada.
Giuseppe Ciconte, Arrhythmia and Electrophysiology Center, IRCCS Policlinico San Donato, Milan 20097, Italy.
Ashton Christy, Department of Chemistry, University of British Columbia, Vancouver, BC V6T 1Z1, Canada.
Gabriele Vicedomini, Arrhythmia and Electrophysiology Center, IRCCS Policlinico San Donato, Milan 20097, Italy.
Luigi Anastasia, Stem Cell Laboratory for Tissue Engineering, Università Vita-Salute San Raffaele, Milan 20132, Italy.
Carlo Pappone, Arrhythmia and Electrophysiology Center, IRCCS Policlinico San Donato, Milan 20097, Italy; Department of Cardiology, Università Vita-Salute San Raffaele, Milan 20132, Italy.
Edward Grant, Department of Chemistry, University of British Columbia, Vancouver, BC V6T 1Z1, Canada.
Supplementary Data
Supplementary material is available at PNAS Nexus online.
Funding
This work was partially supported by Ricerca Corrente funding from the Italian Ministry of Health to IRCCS Policlinico San Donato. L.M., A.C and e.g. gratefully acknowledge financial support from the Natural Sciences and Engineering Research Council of Canada.
Author Contributions
L.M., G.C., and A.C. contributed equally to this research. G.C., G.V., and C.P. gathered electrocardiograms and diagnosed patients. L.M. and A.C. developed data processing methods and wrote DNN multivariate analysis programs, e.g. and L.A. defined strategic avenues of inquiry and interpreted logistic regression results. All authors took an active part in writing and revising this manuscript.
Data Availability
Summary demographic and diagnostic data are included in the manuscript and Supplementary material . Anonymized data created for the study are available in a persistent repository: Melo, Luke (2023). Deep learning unmasks the ECG signature of Brugada Syndrome [Dataset]. Dryad. https://doi.org/10.5061/dryad.s1rn8pkd9 .
References
Associated Data
Supplementary Materials
Click here for additional data file.
Data Availability Statement
Summary demographic and diagnostic data are included in the manuscript and Supplementary material . Anonymized data created for the study are available in a persistent repository: Melo, Luke (2023). Deep learning unmasks the ECG signature of Brugada Syndrome [Dataset]. Dryad. https://doi.org/10.5061/dryad.s1rn8pkd9 .
Relations on this page carry a quotation for the claim. Where a relation was separately evidenced — and so tested against the vocabulary for its type — the row says so; 7 of 7 relations here carry that mark. The rest are the tagger’s reading of the sentence quoted beside them.
This record holds no relations between claims. A layer is empty when the tagger recorded nothing in it — which is not the same as the paper having nothing to record.
| facet | tag | field | conf. | whose words |
|---|---|---|---|---|
| object_of_study | detecting Brugada syndrome from baseline ECGs with a deep neural network | object_of_study | the paper's words | |
| research_question | whether a deep neural network can detect the signature of BrS in a conventional ECG when it is invisible to the eye | research_question | the paper's words | |
| contribution | an ECG screening algorithm for BrS that competes with the sodium-channel-blocker challenge without its side effects | contribution | the paper's words | |
| claim_type | method | claim_type | the paper's words | |
| phenomenon | the hidden ECG signature of Brugada syndrome | phenomenon | the paper's words | |
| method | computational-model also in: computational-model | method | the paper's words | |
| mechanisms | Reducing each lead to one representative heartbeat removes uncorrelated beat-to-beat variance so the network sees persistent BrS features. | mechanisms[0] | 0.75 | the tagger's words |
| limitations | Patients with accompanying conditions not in this study still need validation. | limitations[0] | 0.8 | the tagger's words |
| limitations | The database is of relatively limited size. | limitations[1] | 0.8 | the tagger's words |
| limitations | The results come from retrospective clinical databases. | limitations[2] | 0.8 | the tagger's words |
| controls | comparison with blind visual classification by an expert cardiologist and a resident outcome: held | controls[0] | 0.75 | the tagger's words |
| concepts | BrS also in: BrS | concepts[0] | 0.95 | the paper's words |
| concepts | Brugada Syndrome also in: Brugada Syndrome | concepts[1] | 0.85 | the paper's words |
| concepts | SCD also in: SCD | concepts[2] | 0.95 | the paper's words |
| concepts | Sudden cardiac death also in: Sudden cardiac death | concepts[3] | 0.7 | the paper's words |
| concepts | ECGs also in: ECGs | concepts[4] | 0.95 | the paper's words |
| concepts | electrocardiograms also in: electrocardiograms | concepts[5] | 0.7 | the paper's words |
| concepts | SCB also in: SCB | concepts[6] | 0.95 | the paper's words |
| concepts | sodium channel blockers also in: sodium channel blockers | concepts[7] | 0.7 | the paper's words |
| concepts | DNN also in: DNN | concepts[8] | 0.95 | the paper's words |
| concepts | deep neural network also in: deep neural network | concepts[9] | 0.7 | the paper's words |
| concepts | LOOCV also in: LOOCV | concepts[10] | 0.95 | the paper's words |
| concepts | leave-one-out cross-validation also in: leave-one-out cross-validation | concepts[11] | 0.7 | the paper's words |
| concepts | DNN score also in: DNN score | concepts[12] | 0.85 | the paper's words |
| concepts | negative sodium channel blocker test also in: negative sodium channel blocker test | concepts[13] | 0.85 | the paper's words |
| concepts | type 1 BrS pattern also in: type 1 BrS pattern | concepts[14] | 0.85 | the paper's words |
| concepts | NPV also in: NPV | concepts[15] | 0.95 | the paper's words |
| concepts | negative predictive value also in: negative predictive value | concepts[16] | 0.7 | the paper's words |
| senses | representative heartbeat - a single de-noised averaged heartbeat per ECG lead, used as the classifier's input | senses[0] | 0.8 | the tagger's words |
| senses | hidden BrS - Brugada syndrome with no visible type 1 pattern on the baseline ECG | senses[1] | 0.75 | the tagger's words |
| concept_edges | BrS —same-as→ Brugada Syndrome the relation itself is separately evidenced · strength of the relation: 0.95 also in: BrS · Brugada Syndrome | concept_edges[0] | 0.95 | the tagger's words |
| concept_edges | SCD —same-as→ Sudden cardiac death the relation itself is separately evidenced · strength of the relation: 0.95 also in: SCD · Sudden cardiac death | concept_edges[1] | 0.95 | the tagger's words |
| concept_edges | ECGs —same-as→ electrocardiograms the relation itself is separately evidenced · strength of the relation: 0.95 also in: ECGs · electrocardiograms | concept_edges[2] | 0.95 | the tagger's words |
| concept_edges | SCB —same-as→ sodium channel blockers the relation itself is separately evidenced · strength of the relation: 0.95 also in: SCB · sodium channel blockers | concept_edges[3] | 0.95 | the tagger's words |
| concept_edges | DNN —same-as→ deep neural network the relation itself is separately evidenced · strength of the relation: 0.95 also in: DNN · deep neural network | concept_edges[4] | 0.95 | the tagger's words |
| concept_edges | LOOCV —same-as→ leave-one-out cross-validation the relation itself is separately evidenced · strength of the relation: 0.95 also in: LOOCV · leave-one-out cross-validation | concept_edges[5] | 0.95 | the tagger's words |
| concept_edges | NPV —same-as→ negative predictive value the relation itself is separately evidenced · strength of the relation: 0.95 also in: NPV · negative predictive value | concept_edges[6] | 0.95 | the tagger's words |
| content_tags | In LOOCV the DNN predicted the ajmaline response for 84.0% of patients (AUC 0.912). | content_tags.findings[0] | 0.9 | the tagger's words |
| content_tags | On the independent Mortara cohort the DNN reached 85.1% accuracy and AUC 0.934. | content_tags.findings[1] | 0.9 | the tagger's words |
| content_tags | An expert cardiologist reached 72.4% accuracy on the same cohort. | content_tags.findings[2] | 0.85 | the tagger's words |
| content_tags | Adding clinical factors did not significantly change DNN performance. | content_tags.findings[3] | 0.85 | the tagger's words |
| content_tags | The DNN classifies on a multivariate relation among waveform amplitudes, not only ST segments. | content_tags.findings[4] | 0.8 | the tagger's words |
| content_tags | More than 49% of asymptomatic individuals were diagnosed with BrS. | content_tags.findings[5] | 0.8 | the tagger's words |
| content_tags | seven numbers between 0 and 1 assigned to every withheld ECG, interpretable as a probability of positive diagnosis also in: DNN score | content_tags.definitions[0] | 0.85 | the tagger's words |
| content_tags | an ECG that does not convert to yield a type 1 pattern after a pharmacological provocation test also in: negative sodium channel blocker test | content_tags.definitions[1] | 0.85 | the tagger's words |
| content_tags | people killed by sudden cardiac death every year | content_tags.quantities[0] | 0.8 | the tagger's words |
| content_tags | consecutive patients in the database | content_tags.quantities[1] | 0.85 | the tagger's words |
| content_tags | high-quality ECGs | content_tags.quantities[2] | 0.85 | the tagger's words |
| content_tags | BrS(+) patients with a spontaneous type 1 pattern | content_tags.quantities[3] | 0.85 | the tagger's words |
| content_tags | area under the curve also in: area under the curve | content_tags.statistics[0] | 0.85 | the tagger's words |
| content_tags | Youden's J statistic also in: Youden's J statistic | content_tags.statistics[1] | 0.8 | the tagger's words |
| content_tags | sensitivity also in: sensitivity | content_tags.statistics[2] | 0.85 | the tagger's words |
| content_tags | the classification target: whether the ECG converts to a type 1 pattern also in: ajmaline response | content_tags.variables[0] | 0.8 | the tagger's words |
Tags that could not be placed in the text:
What was deliberately not tagged, and why, is recorded per paper by the tagger. Where a paper has no such record, this page says so rather than implying that nothing was declined.