There is still controversy which type of anesthesia, plexus anesthesia (PA) or general anesthesia (GA), is best for carotid endarterectomy (CEA). Guidelines of both the European Society of Vascular Surgery and the Dutch Society for Vascular Surgery recommend that choice of anesthesia for carotid endarterectomy (PA or GA) be left to the surgical team’s preference , , . Patients preferences or instruct ability could also play a role in the choice of technique.
The technique of CEA is previously described . When a patient receives GA, the patient receives an opioid, muscle relaxant and an intravenous anesthetic such as propofol followed by intubation and mechanical ventilation . When a patient receives PA a local anesthetic will be used e.g. ropivacaine. The patient is in a supine position facing away from the side of the surgery. The anesthetic will be put in place with guidance of anatomical landmarks or with help of an ultrasound by an anesthesiologist. Prior to the injection of the anesthetic lidocaine–prilocaine is applied to numb the skin. After skin disinfection the needle will be put in place at the level of the carotid bifurcation nearby the carotid sheath and a depot of the anesthetic will be placed superiorly and inferiorly along the posterior border of the sternocleidomastoid muscle. The carotid sheath can be numbed using ultra sound by the anesthesiologist of during surgery by the vascular surgeon.
Next to the plexus anesthesia, sedation can be considered to keep the patient comfortable. This sedation may consist of Dexmedetomidine, the first 10 minutes at 1 mcg/kg/h, after 10 min around 1/3 of the dosage guided by the heart frequency and or blood pressure. Simultaneously remifentanil is used at 0.1 mcg/kg/min, and after 10 min the dosage is continued at 0.05 lowered by 50%. Noradrenaline can be used to keep the blood pressure within its desired range to keep the brain adequately perfused.
Each type of anesthesia has its (dis)advantages. PA allows real-time monitoring compared to using Transcranial Doppler (TCD) and/or Electroencephalography (EEG) monitoring with GA. TCD and/or EEG monitoring are not perfect and assessment may be normal in 6% to 30% of those who develop neurological signs and abnormal in 3% to 11% of those who do not develop signs of ischemia . Another advantage of PA is that the awake state of the patient does not impair the blood pressure regulation in contrast to GA, which may lower the risk of a periprocedural stroke . PA is associated with a lower incidence of shunt placement during carotid endarterectomy . The use of a shunt can prevent a perioperative ischemic event. However, it can cause damage to the arterial wall and/or cause an ischemic event . Patients may have less post procedural pain compared with those after GA . The main disadvantage of PA is conversion to GA, which can be necessary when the patient experiences too much pain. PA could also numb the phrenic nerve which can lead to intubation of patients with an already impaired pulmonary function. Other reasons for conversion to general anesthesia can be e.g. claustrophobia, airway obstruction due to cervical hematoma, loss of consciousness at carotid clamping, and shunt-related complications . incidences of operative complications, such as local hemorrhage, cranial nerve damage, and pulmonary complications have been reported for both PA and GA and showed no differences .
Preventive management of (a)symptomatic carotid artery stenosis includes antiplatelet therapy, statins, antihypertensive therapy, diabetic control, as well as lifestyle modifications , , . When a patient shows symptoms, different operation techniques are available and described in literature such as carotid endarterectomy with primary closure, eversion technique and traditional carotid endarterectomy with patch closure. Carotid endarterectomy with patch angioplasty is the preferred guideline treatment for patients with symptomatic stenosis of the carotid artery , , primarily based on the European Carotid Surgery Trial (ECST) and the North American Symptomatic Carotid Endarterectomy Trial (NASCET) , , , .
A multicenter, randomized clinical trial (RCT) included 3523 operations in 3523 symptomatic and asymptomatic patients and compared PA with GA and concluded that there was no significant difference between the two techniques for stroke (including retinal infarction), myocardial infarction, and death between randomization and 30 days after surgery . However, the observed difference or lack of difference may or may not be affected by several confounding factors and/or differential use of co-interventions, such as the use of different surgical techniques, selected use of shunting, and variations in materials used for patching , .
Previous conducted systematic reviews with meta-analysis of the randomized trials showed that there was no statistically significant difference between the PA and GA groups in the proportion of patients who had a stroke, died, or had a myocardial infarction within 30 days of carotid endarterectomy , . These reviews were conducted without Trial Sequential Analysis (TSA). To confirm or reject meta-analysis results we will add and TSA and include Grading of Recommendations Assessment, Development and Evaluation (GRADE) assessments of the evidence. We also try to reduce clinical heterogeneity by comparing only technique (PA) with one other technique (GA) in patients for carotid endarterectomy with patch angioplasty and also reduce the risk for random error.
To determine which technique, PA or GA is more effective for carotid endarterectomy with patch angioplasty in symptomatic carotid stenosis from the patients’ perspective, it is important that all available evidence is evaluated according to the risks of errors in a systematic review in line with the Cochrane Handbook for Systematic Reviews of Interventions , . Therefore, an updated systematic review with meta-analyses is needed.
The objective is to conduct a systematic review with meta-analysis and Trial Sequential Analysis of randomized clinical trials, evaluating the benefits and harms of plexus anesthesia versus general anesthesia in carotid endarterectomy with patch angioplasty according to a pre-published protocol based on aspects of the Cochrane Handbook for Systematic Reviews of Interventions.
This review will be conducted according to this protocol, registered at PROSPERO CRD42019139913  based on aspects of the recommendations of the ‘Cochrane Handbook for Systematic Reviews of interventions’  and will be reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement (www.prisma-statement.org) .
According to the current guideline , ,  patients with a symptomatic stenosis (≥50 – ≤99%) of the carotid artery will be considered. Only trials which evaluate plexus anesthesia versus general anesthesia in carotid endarterectomy with patch angioplasty in adult patients (≥18 years) will be included . Trials will be considered irrespective of language, blinding, outcomes, or publication status.
Plexus anesthesia (PA) in carotid endarterectomy with patch angioplasty.
General anesthesia (GA) in carotid endarterectomy with patch angioplasty.
We want to test the null-hypothesis that there is no difference between the two treatments (H0: RRR = 0.00% or RR = 1.00) as well as both the alternative hypotheses (H1a and H1b) that there is a difference (H1a of a 10% RRR or H1b of a 15% RRR) between plexus anesthesia (PA) and general anesthesia (GA) in patients with a symptomatic carotid lesion. We think that patients operated with plexus anesthesia will do better because the neurological status of the patient can be monitored in real time compared with patients operated with general anesthesia in which the surgeon depends on a derived monitoring through TCD and EEG.
The outcome measures will be graded from the patients’ perspective (GRADE working group 2008, Fig. 1) . Examples of serious adverse events: stroke, bleeding, persisting neurological deficits, myocardial infarction, conversion PA to GA due to any cause, patients developing airway obstruction or phrenic nerve palsy and hypertension in need for (intravenous) medication.
• Proportion of participants who suffered death (<30 days).
• Proportion of participants with postoperative stroke (<30 days).
• Proportion of participants with one or more serious adverse events; which is defined as: any untoward medical occurrence that results in death, is life threatening, requires hospitalization or prolongation of existing hospitalization, results in persistent or significant disability or incapacity (or is a congenital anomaly or birth defect) .
• Proportion of participants with one or more non-serious adverse events: any untoward medical occurrence in a participant that does not meet the above criteria for a serious adverse event is defined as a non-serious adverse event .
• Costs: hospitalization duration, duration of surgical procedure, ICU admission (e.g. blood pressure management).
• Separately reported serious adverse events.
• Separately reported non-serious adverse events.
The number of patients with one or more complications will be evaluated rather than the numbers of events, depending on the availability of data.
The Cochrane Central Register of Controlled Trials (CENTRAL) in the Cochrane Library, PubMed/MEDLINE and EMBASE will be searched. References of the identified trials will be searched to identify any further relevant randomized clinical trials. The search strategies are provided in the appendix. Searches will include MeSH descriptors such as “Clinical Trials”, “carotid endarterectomy”, “plexus”, “carotid artery disease”, “anesthesia”, “patch”. We will also search online trial registries such as ClinicalTrials.gov (https://clinicaltrials.gov/), European Medicines Agency (EMA) (www.ema.europa.eu/ema/), WHO International Clinical Trial Registry Platform (www.who.int/ictrp), and the Food and Drug Administration (FDA) (www.fda.gov) for ongoing or unpublished trials. In addition, we plan to search Google Scholar (https://scholar.google.nl/) using the terms: anesthesia and/or plexus and/or local anesthesia and/or carotid and/or endarterectomy in the title of the abstract/paper.
Two authors will perform screening and select the trials for inclusion, independently. Excluded trials and studies will be listed with their reasons for exclusion. When disagreements should occur, a third author will be approached to reconcile. The authors will extract the following data when available: type of anesthesia, trial characteristics (year and language of publication, country in which the trial was conducted, year of conduction of the trial, single or multicenter trial, number of patients), patient characteristics (inclusion and exclusion criteria, mean age, mean body mass index and gender, smoking, diabetes mellitus, use of statin and platelet inhibitors), intervention characteristics (general anesthesia, plexus anesthesia, closure by type of patch, use of shunting), co-interventions (conversion to general anesthesia, perioperative transcranial Doppler monitoring, perioperative carotid pressure measurement, electroencephalographic monitoring) and the outcome measures evaluated. If there are any unclear or missing data, the corresponding authors of the individual trials will be contacted, at least twice, for clarification.
Two authors will assess the risks of bias, without masking for trial names, according to the Cochrane Handbook for Systematic Reviews of Interventions , including the domains of generation of the allocation sequence, allocation concealment, blinding of participants, personnel, and outcome assessors, incomplete outcome data, selective outcome reporting, and bias risks such as vested interests (financial interest, academical interest or other parties such as the medical industry). Risk of bias components will be scored as low, unclear, or high risk of bias.
Some aspects of the conduct of randomized trials, particularly blinding, are associated with a modest exaggeration of treatment effects on average, but there is little evidence that the average bias differs according to whether the outcome was subjectively or objectively assessed. However, lack of blinding in trials with subjective outcomes leads to increased heterogeneity and hence unpredictable bias in effect estimates. As far as possible, clinical and policy decisions should be cautious when they are based on trials in which blinding was not reported or not feasible and outcome measures were subjectively assessed .
In surgical procedures it is impossible to blind the surgeon who performs the procedure of CEA, while it is possible to blind the caregivers responsible for postoperative care as well as the patients . In this type of comparison with PA and GA no blinding is possible. For this domain we cannot consider the surgeon, caregivers and patients, so a certain risk of bias will inevitably be present when evaluating surgical procedures.
Trials were classified as trials with low overall risk of bias if all risk of bias domains were scored as having low risk of bias. If one or more of the bias domains were scored as unclear or high risk of bias, the trial was considered to have high overall risk of bias. Trials classified as low risk of bias in all domains of sequence generation, allocation concealment, blinding, incomplete data, selective outcome reporting, source of funding and other potential risks of bias will be considered trials at overall low risk of bias. Trials with one or more of these domains scored as unclear or high risk of bias will be considered trials at overall high risk of bias , , .
Meta-analyses will be performed according to the Cochrane Handbook for Systematic Reviews of Interventions . The software package Review Manager (RevMan) Version 5.3 will be used . Significance levels will be adjusted due to multiplicity of several outcomes. The results of each outcome will require an adjusted statistical significance level (threshold). An alfa of respectively (0.05/((1 + 3)/2) = ) 0.025 will be used for the primary and 0.033 for the secondary outcomes to keep the family wise error rate (FWER) below 0.05 , . For exploratory outcomes, we will consider a p-value less than 0.05 as significant, because we view these outcomes as only hypothesis-generating outcomes. For dichotomous variables, the risk ratio (RR) with TSA-adjusted confidence intervals (CI) will be calculated. For continuous variables, the mean difference (MD) with TSA-adjusted CI will be calculated or the standardized mean difference (SMD) with 95% CI will be calculated.
For the outcome of SAE we plan to estimate the proportion of patients with one or more SAE in each group and to analyze this outcome in a binary meta-analysis. However, as we anticipate the reporting of SAEs in trials to vary considerably we plan to do two analyses and to avoid multiple counts of SAE in the same patients (SAE counting is not a statistical independent outcome):
1) The cumulated SAE analysis: Assuming that only one SAE is reported per patient. We will summarize all reported SAE in each trial and calculate the proportion of summed SAE divided with number of randomized patients in the experimental and control intervention group, the number of patients in each group will constitute a maximum of SAEs (maximum proportion = 1.00).
2) The highest proportion of SAEs registered: we will analyze the most frequent SAE in each included trial as if it represents the total number of patients with SAEs in the experimental and control intervention group assuming that if a patient don’t get the SAE with the highest proportion in the trial they don’t get another SAE either. Being aware that none of these intervention effect estimates (1 or 2) are exactly correct we will discuss differences between the effect of the experimental vs the control intervention on the proportion of patients with one or more SAEs.
The impact of attrition bias will be explored using best/ worst and worst/ best case scenarios: a best/ worst case scenario is one where all patients lost to follow-up in the intervention group are supposed to have survived while all patients lost to follow-up in the control intervention group have died. A worst/best case scenario is the reverse.
Heterogeneity will be explored by chi-squared test with significance set at p-value of 0.10, and the quantity of heterogeneity will be measured by I2. We will conduct both random-effects model and fixed-effect model meta-analyses. In case of discrepancies the results of both models will be presented and we will primarily stress the result of the model with the result closest to null effect due to principle of cautiousness . The analyses will be performed on an intention-to-treat basis whenever possible.
A funnel plot will be used to explore small trial bias and to use asymmetry in funnel plot of trial size against treatment effect to assess this bias. Begg’s and Egger’s tests will be used to test for asymmetry in funnel plots .
Meta-analyses may result in type-I errors and type-II errors due to an increased risk of random error when sparse data are analyzed and due to repeated significance testing when a cumulative meta-analysis is updated with new trials , . To assess the risk of type-I and type-II errors, TSA will be used. The vast majority of meta analyses (nearly 80%) in Cochrane systematic reviews have less than the required information size to conclude on a 30% relative risk reduction (RRR) and less than 2% have sufficient power to conclude on a 10% RRR , , .
TSA combines information size estimation for meta-analysis (cumulated sample size of included trials) with an adjusted threshold for statistical significance of meta-analysis , , . The latter, called trial sequential monitoring boundaries (TSMB), reduce type-I errors. In TSA the addition of each trial in a cumulative meta-analysis is regarded as an interim analysis and helps to clarify whether additional trials are needed or not. The idea in TSA is that when the cumulative z-curve crosses the TSMB, a sufficient level of evidence has been reached and no further trials may be needed. If the z-curve does not cross the boundary of benefit and the required information size has not been reached, there may be insufficient evidence to reach a conclusion , , , . TSA can also be used for the evaluation of type II errors, that is, to evaluate whether further randomized trials are futile to show or discard the anticipated intervention effect (RRR or MD). This happens when the cumulative z-curve does cross the TSMBs for futility. TSA will be applied since it controls the risks of type-I and type-II errors in a cumulative meta-analysis and may provide important information on how many more patients need to be included in further trials. The information size will be calculated as diversity-adjusted required information size (DARIS) . We will do the primary analysis calculating the DARIS based on an a priori anticipated intervention effect of a 10% RRR which is close to a minimal important difference. We will conduct sensitivity analyses for a 15% RRR as well as the RRR suggested by the meta-analysis of the included trials . If the estimated Diversity of the meta-analysis is 0%, a sensitivity analysis with TSA using a Diversity of 25% will be conducted. TSA will be performed on all outcomes. The required information size for primary outcomes will be calculated based on an a priori RRR of 10% and appropriately adjusted for diversity according to an overall type-I error of 2.5% for the co-primary outcomes and 3.3% for the secondary outcomes to account for a family wise error (FWER) of 5% all in all, we will use a power of 90% considering sparse data and repetitive testing . For secondary outcomes the DARIS will be calculated using a power of 90% . As a sensitivity analysis, the DARIS will be calculated using the estimated intervention effect from the trials at low risk of bias in a conventional meta-analysis. If the required information size is surpassed for the TSA using the estimated intervention effect in the conventional meta-analysis or a TSMB is crossed a TSA with an anticipated intervention effect equal to the confidence limit closest to the null effect in the effect estimate from the conventional meta-analysis will be performed.
The TSAs will be conducted using the control event proportion calculated from the unweighted control event proportion from the control groups of the actual meta-analyses.
The following subgroup analysis will be performed:
Trials at overall low risk of bias (all except blinding of surgeons scored as low risk of bias) compared to trials at high overall risk of bias (two or more of the bias domains (including blinding of surgeons) scored as unclear or high risk).
We will use summary of findings tables to summarize the results of the trials with overall low risk of bias and for all trials, separately. Reasons for downgrading the quality of the available evidence are: risk of bias evaluation of the included bias domains, publication bias, heterogeneity, imprecision, and indirectness (e.g. length of stay is a surrogate outcome measure) , , . We will compare the imprecision assessed according to GRADE with that of TSA .
Patients and/ or public were not involved in this study.
The proposed systematic review will collect and analyze secondary data from already performed studies therefore ethical approval is not required. The results of the systematic review will be disseminated by publication in a peer-review journal and submitted for presentation at relevant conferences.
First registration of the protocol at Prospero CRD42019139913 in August 2019.
Proposed date of starting the search: 1st of January 2020. Proposed date of finishing the review is the 31st of March 2020.
MSM is the first author of the protocol. MSM and GGK managed the first draft of this manuscript and coordinated the contributions of coauthors. Contributors JW, PWHEV, DA, FGR, JMMH, FLM, AkhJ, FK, and GGK contributed to the design of the study and revised the paper critically. JW, FK, and GGK provided professional and statistical support. All authors read and approved the final version of the manuscript. GGK was initiator and supervisor.
JW is a member of the taskforce at Copenhagen Trial Unit to develop theory and software doing TSA, presently available as freeware at www.ctu.dk/tsa.
MSM and GGK.
Naylor, A. (2017). Management of Atherosclerotic Carotid and Vertebral Artery Disease: 2017 Clinical Practice Guidelines of the European Society for Vascular Surgery (ESVS). Eur. J. Vasc. Endovasc. Surg. [Internet] 55(1): 1–79. Available from: http://dx.doi.org/10.1016/j.ejvs.2017.06.021.
Liapis, C.D., Bell, S.P.R.F., Mikhailidis, D., Sivenius, J., Nicolaides, A. and Fernandes e Fernandes J, ESVS (2009). Guidelines. Invasive treatment for carotid stenosis: indications, techniques. Eur. J. Vasc. Endovasc. Surg. 37(4 Suppl.): 1–19.
Nederlandse Vereniging voor Neurologie en het Kwaliteitsinstituut voor de Gezondheidszorg CBO. Diagnostiek, behandeling en zorg voor patiënten met een beroerte [Internet]. Richtlijn Diagnostiek, behandeling en zorg voor patiënten met een beroerte. 2008 [cited 2017 Dec 2]. Available from: http://med-info.nl/Richtlijnen/Geriatrie/Beroerte.pdf.
Marsman, M.S., Wetterslev, J., Jahrome, A.K., Gluud, C., Moll, F.L. and Karimi, A. (2019). Carotid endarterectomy with primary closure versus patch angioplasty in patients with symptomatic and significant stenosis: protocol for a systematic review with meta-analyses and trial sequential analysis of randomised clinical trials. BMJ Open, : 1–7.
Wong, D., Dallaire, A., Singh, K., Madhusan, P., Jackson, T. and Singh, M. (2019). High-flow nasal oxygen improves safe apnea time in morbidly obese patients undergoing general anesthesia: a randomized controlled trial. Anesth. Analg. 129(4): 1130–1136. [PubMed]
Rerkasem, K. and Rothwell, P.M. (2009). Routine or selective carotid artery shunting for carotid endarterectomy (and different methods of monitoring in selective shunting). Cochrane Database Syst. Rev. [Internet] (4) CD000190 Available from: https://doi.org/10.1002/14651858.CD000190.pub2.
Trial G and Group C (2008). General anaesthesia versus local anaesthesia for carotid surgery (GALA): a multicentre, randomised controlled trial. Lancet [Internet] 372(9656): 2132–2142. Available from: http://dx.doi.org/10.1016/S0140-6736(08)61699-2.
Watts, K., Lin, P.H., Bush, R.L. and Awad, S. (2004). The impact of anesthetic modality on the outcome of carotid endarterectomy. Am. J. Surg. 188: 741–747. [PubMed]
Do, W., Cho, A.-R. and Kim, E.-J. (2018). Ultrasound-guided superficial cervical plexus block under dexmedetomidine sedation versus general anesthesia for carotid endarterectomy: a retrospective pilot study. Yeungnam Univ. J. Med. 35(1): 45–53. [PubMed]
Pasin, L., Nardelli, P., Landoni, G., Cornero, G., Magrin, S., Tshomba, Y., Chiesa, R. and Zangrillo, A. (2015). Examination of regional anesthesia for carotid endarterectomy. J. Vasc. Surg. 62(3): 631–634.e1. [PubMed]
Rerkasem, K., Bond, R. and Pm, R. (2005). Local versus general anaesthesia for carotid endarterectomy (Review). Cochrane Collab. [Internet] (2) Available from: https://doi.org/10.1002/14651858.CD000126.pub2.
Raman, G., Moorthy, D., Hadar, N., Dahabreh, I.J. and O’Donnell, T.F. (2013). Management Strategies for asymptomatic Carotid Stenosis: a systematic review and meta-analysis. Ann. Intern. Med. 158(9): 676–685. [PubMed]
Abbott, A.L. (2009). Medical (nonsurgical) intervention alone is now best for prevention of stroke associated with asymptomatic severe carotid stenosis: Results of a systematic review and analysis. Stroke 40(10): 573–584.
Constantinou, J., Jayia, P. and Hamilton, G. (2013). Best evidence for medical therapy for carotid artery stenosis. J. Vasc. Surg. 58(4): 1129–1139. [PubMed]
Cina, C.S., Clase, C.M., Haynes, R.B., Orrapin, S. and Rerkasem, K. (2017). Carotid endarterectomy for symptomatic carotid stenosis. Cochrane Database Syst. Rev. [Internet] (2) CD001081. Available from: 10.1002/14651858.CD001081.
Bangalore, S., Kumar, S., Wetterslev, J., Bavry, A.A., Gluud, C. and Cutlip, D.E. (2011). Carotid artery stenting vs carotid endarterectomy: meta-analysis and diversity-adjusted trial sequential analysis of randomized trials. Arch Neurol. 68(2): 172–184. [PubMed]
Warlow, C. (1991). MRC European Carotid Surgery Trial: interim results for symptomatic patients with severe (70–99%) or with mild (0–29%) carotid stenosis. Lancet 337(8752): 1235–1243. [PubMed]
Collaborators NASCET (1991). Beneficial effect of carotid endarterectomy in symptomatic patients with high-grade carotid stenosis. N. Engl. J. Med. 325(7): 445–453. [PubMed]
Orlicky, M., Hrbac, T., Sames, M., Vachata, P., Hejcl, A. and Otahal, D. (2018). Anesthesia type determines risk of cerebral infarction after carotid endarterectomy. J. Vasc. Surg. [Internet] 70(1): 138–147.
Lomivorotov, V.V., Shmyrev, V.A. and Nepomniashchikh, V.A. (2018). Regional versus general anesthesia for carotid endarterectomy: do we need another randomized trial?. J. Cardiothorac. Vasc. Anesth. [Internet], : 7–8. Available from: https://doi.org/10.1053/j.jvca.2018.09.007.
Harky, A., Shi Kai, J., Chan, Ka Ming Kot, T., Sanli, D., Rahimli, R. and Belamaric, Z. (2019). General anaesthesia versus local anaesthesia in carotid endarterectomy: a systematic review and meta-analysis. J. Cardiothorac. Vasc. Anesth.,
Keus, F., Wetterslev, J. and Gluud, C. (2010). Evidence at a glance: error matrix approach for overviewing available evidence. BMC Med. Res. Methodol. 10: 90. [PubMed]
Marsman, M.S., Wetterslev, J., Keus, F., Aalst van, D., Rooij van, F.G. and Heyligers, J.M.M. (2019). Plexus anesthesia versus general anesthesia in patients for carotid endarterectomy with patch angioplasty: protocol for a systematic review with meta-analyses and Trial Sequential Analysis of randomized clinical trials. Prospero [Internet], Available from: https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=139913.
Guyatt, G.H., Oxman, A.D., Kunz, R., Vist, G.E., Falck-Ytter, Y. and Schünemann, H.J. (2008). What is “‘quality of evidence’” and why is it important to clinicians?. BMJ 336(7651): 995–998. [PubMed]
International Conference on Harmonisation Expert Working Group (1997). International conference on harmonization of technical requirements for registration of pharmaceuticals for human use. ICH harmonised tripartite guideline. Guideline for good clinical practic. Guidel. Good Clin. Pract. CFR ICH Guidel. 1
Savović, J., Turner, R.M., Mawdsley, D., Jones, H.E., Beynon, R. and Julian, P.T. (2018). Association between risk-of-bias assesments and results of randomized trials in coachrane reviews: the ROBES Meta-Epidemiologic Study. Am. J. Epidemiol. 187(5): 113–1122. [PubMed]
Gurusamy, K.S., Gluud, C., Nikolova, D. and Davidson, B.R. (2009). Assessment of risk of bias in randomized clinical trials in surgery. Br. J. Surg. 96(4): 342–349. [PubMed]
Jakobsen, J.C., Wetterslev, J., Lange, T. and Gluud, C. (2016). Editorial - Viewpoint: taking into account risks of random errors when analysing multiple outcomes in systematic reviews | Cochrane. Library., : 2–7.
Jakobsen, J.C., Wetterslev, J., Winkel, P., Lange, T. and Gluud, C. (2014). Thresholds for statistical and clinical significance in systematic reviews with meta-analytic methods. BMC Med. Res. Methodol. 14(1): 1–13. [PubMed]
Koning, G.G., Wetterslev, J., van Laarhoven, C.J.H.M. and Keus, F. (2013). The totally extraperitoneal method versus Lichtenstein’s technique for inguinal hernia repair: a systematic review with meta-analyses and trial sequential analyses of randomized clinical trials. PLoS One 8(1)
Wetterslev, J., Thorlund, K., Brok, J. and Gluud, C. (2008). Trial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis. J. Clin. Epidemiol. 61(1): 64–75. [PubMed]
Brok, J., Thorlund, K., Wetterslev, J. and Gluud, C. (2009). Apparently conclusive meta-analyses may be inconclusive - trial sequential analysis adjustment of random error risk due to repetitive testing of accumulating data in apparently conclusive neonatal meta-analyses. Int. J. Epidemiol. 38(1): 287–298. [PubMed]
Mascha, E.J. (2015). Alpha, beta, meta: Guidelines for assessing power and Type I error in meta-analyses. Anesth Analg. 121(6): 1430–1433. [PubMed]
Imberger, G., Thorlund, K., Gluud, C. and Wetterslev, J. (2016). False-positive findings in Cochrane meta-analyses with and without application of trial sequential analysis: an empirical review. BMJ Open 6(8)e011890
Thorlund, K., Devereaux, P.J., Wetterslev, J., Guyatt, G., Ioannidis, J.P.A. and Thabane, L. (2009). Can trial sequential monitoring boundaries reduce spurious inferences from meta-analyses?. Int. J. Epidemiol. 38(1): 276–286. [PubMed]
Pogue, J. and Yusuf, S. (1998). Overcoming the limitations of current meta-analysis of randomised controlled trials. Lancet 351(9095): 47–52. [PubMed]
Pogue, J.M. and Yusuf, S. (1997). Cumulating evidence from randomized trials: Utilizing sequential monitoring boundaries for cumulative meta-analysis. Control Clin. Trials 18(6): 580–593. [PubMed]
Wetterslev, J., Thorlund, K., Brok, J. and Gluud, C. (2009). Estimating required information size by quantifying diversity in random-effects model meta-analyses. BMC Med. Res. Methodol. 9: 1–12. [PubMed]
Wetterslev, J., Jakobsen, J.C. and Gluud, C. (2017). Trial sequential analysis in systematic reviews with meta-analysis. BMC Med. Res. Methodol. 17(1): 1–18. [PubMed]
Guyatt, G.H., Oxman, A.D., Kunz, R., Brozek, J., Alonso-Coello, P. and Rind, D. (2011). GRADE guidelines 6. Rating the quality of evidence – Imprecision. J. Clin. Epidemiol. 64(12): 1283–1293. [PubMed]
Savović, J., Jones, H.E., Altman, D.G., Harris, R.J., Juni, P. and Pildal, J. (2012). Influence of reported study design characteristics on intervention effect estimates from randomised controlled trials: combined analysis of meta-epidemiological studies. Health Technol. Assess (Rockv). 16(35): 1–81.
Savovic, J., Jones, H.E., Altman, D.G., Harris, R.J., Pildal, J. and Als-nielsen, B. (2012). Research and reporting methods influence of reported study design characteristics on intervention. Ann. Intern. Med. 157(6): 429–438. [PubMed]
Castellini, G., Bruschettini, M., Gianola, S., Gluud, C. and Moja, L. (2018). Assessing imprecision in Cochrane systematic reviews: a comparison of GRADE and Trial Sequential Analysis. Syst. Rev. 7(1): 1–10. [PubMed]
Supplementary data to this article can be found online at https://s3-eu-west-1.amazonaws.com/ubiquity-partner-network/ijs/journal/ijsp/IJSP43.zip.
The authors would like to thank Mrs. L.W.M. Boerboom, MSc, medical information specialist (Medical Library, Elisabeth-TweeSteden Hospital, Tilburg, the Netherlands) for her assistance.