Data integrity of 35 randomised controlled trials in women’ health

      Abstract

      While updating a systematic review on the topic of ovulation of induction, we observed unusual similarities in a number of randomised controlled trials (RCTs) published by two authors from the same institute in the same disease spectrum in a short period of time. We therefore undertook a focused analysis of the data integrity of all RCTs published by the two authors. We made pairwise comparisons to find identical or similar values in baseline characteristics and outcome tables between trials. We also assessed whether baseline characteristics were compatible with chance, using Monte Carlo simulations and Kolmogorov-Smirnov test.
      For 35 trials published between September 2006 and January 2016, we found a large number of similarities in both the baseline characteristics and outcomes of 26. Analysis of the baseline characteristics of the trials indicated that their distribution was unlikely to be the result of proper randomisation. The procedures demonstrated in this paper may help to assess data integrity in future attempts to verify the authenticity of published RCTs.

      Keywords

      To read this article in full you will need to make a payment

      References

        • Bordewijk E.M.
        • Ng K.Y.B.
        • Rakic L.
        • Mol B.W.J.
        • Brown J.
        • Crawford T.J.
        • et al.
        Laparoscopic ovarian drilling for ovulation induction in women with anovulatory polycystic ovary syndrome.
        Cochrane Database Syst Rev. 2020;
        • Hullemann S.
        • Schupfer G.
        • Mauch J.
        Application of Benford’s law: a valuable tool for detecting scientific papers with fabricated data? : a case study using proven falsified articles against a comparison group.
        Anaesthesist. 2017; 66: 795-802
        • Bolland M.J.
        • Gamble G.D.
        • Avenell A.
        • Grey A.
        • Lumley T.
        Baseline P value distributions in randomized trials were uniform for continuous but not categorical variables.
        J Clin Epidemiol. 2019; 112: 67-76
        • Carlisle J.B.
        • Loadsman J.A.
        Evidence for non-random sampling in randomised, controlled trials by Yuhji Saitoh.
        Anaesthesia. 2017; 72: 17-27
        • Li W.
        • Suke S.
        • Wertaschnigg D.
        • Lensen S.
        • Wang R.
        • Gurrin L.
        • et al.
        Randomised controlled trials evaluating endometrial scratching: assessment of methodological issues.
        Hum Reprod. 2019; 34: 2372-2380
        • Betensky R.A.
        • Chiou S.H.
        Correlation among baseline variables yields non-uniformity of p-values.
        PLoS One. 2017; 12e0184531
        • Bolland M.J.
        • Gamble G.D.
        • Avenell A.
        • Grey A.
        Rounding, but not randomization method, non-normality, or correlation, affected baseline P-value distributions in randomized trials.
        J Clin Epidemiol. 2019; 110: 50-62
        • Carlisle J.B.
        The analysis of 168 randomised controlled trials to test data integrity.
        Anaesthesia. 2012; 67: 521-537
        • Bolland M.J.
        • Avenell A.
        • Gamble G.D.
        • Grey A.
        Systematic review and statistical analysis of the integrity of 33 randomized controlled trials.
        Neurology. 2016; 87: 2391-2402
        • Teede H.J.
        • Misso M.L.
        • Costello M.F.
        • Dokras A.
        • Laven J.
        • Moran L.
        • et al.
        Recommendations from the international evidence-based guideline for the assessment and management of polycystic ovary syndrome.
        Fertil Steril. 2018; 110: 364-379
        • Chambers L.M.
        • Michener C.M.
        • Falcone T.
        Plagiarism and data falsification are the most common reasons for retracted publications in obstetrics and gynaecology.
        BJOG. 2019; 126: 1134-1140
        • Steen R.G.
        • Casadevall A.
        • Fang F.C.
        Why has the number of scientific retractions increased?.
        PLoS One. 2013; 8 (e68397-e)
        • Grey A.
        • Bolland M.J.
        • Avenell A.
        • Klein A.A.
        • Gunsalus C.K.
        Check for publication integrity before misconduct.
        Nature. 2020; 577: 167-169
        • Shehata N.A.A.
        Retraction notice to: "Calcium versus oral contraceptive pills containing drospirenone for the treatment of mild to moderate premenstrual syndrome: A double blind randomized placebo controlled trial" [Eur J Obstet Gynecol Reprod Biol (2016) 100-104].
        Eur J Obstet Gynecol Reprod Biol. 2019; 240: 387
      1. Statement of Retraction: peri-conceptional progesterone treatment in women with unexplained recurrent miscarriage: a randomized double-blind placebo-controlled trial.
        J Maternal-Fetal Neonatal Med. 2020; 33: 1073
      2. Notice of retraction: “Sildenafil citrate therapy for oligohydramnios: a randomized controlled trial” (Maher MA, Sayyed TM, and elkhouly N).
        Obstet Gynecol. 2020; (9000; Publish Ahead of Print)
        • Byrne J.A.
        • Grima N.
        • Capes-Davis A.
        • Labbe C.
        The possibility of systematic research fraud targeting under-studied human genes: causes, consequences, and potential solutions.
        Biomark Insights. 2019; 141177271919829162
        • Roberts I.
        • Ker K.
        • Edwards P.
        • Beecher D.
        • Manno D.
        • Sydenham E.
        The knowledge system underpinning healthcare is not fit for purpose and must change.
        BMJ. 2015; 350: h2463
        • Tan A.C.
        • Jiang I.
        • Askie L.
        • Hunter K.
        • Simes R.J.
        • Seidler A.L.
        Prevalence of trial registration varies by study characteristics and risk of bias.
        J Clin Epidemiol. 2019; 113: 64-74
        • Farquhar C.M.
        • Showell M.G.
        • Showell E.A.E.
        • Beetham P.
        • Baak N.
        • Mourad S.
        • et al.
        Clinical trial registration was not an indicator for low risk of bias.
        J Clin Epidemiol. 2017; 84: 47-53
        • Tovey D.
        • Bero L.
        • Farquhar C.
        • Lasserson T.
        • MacLehose H.
        • Macdonald G.
        • et al.
        A response to Ian Roberts and his colleagues [Letter].
        BMJ. 2015; 2015: h2463
        • Taichman D.
        • Sahni P.
        • Pinborg A.
        • Peiperl L.
        • Laine C.
        • James A.
        • et al.
        Data sharing statements for clinical trials: a requirement of the international committee of medical journal editors.
        Natl Med J India. 2017; 30: 121-124
        • Badawy A.
        • Baker El Nashar A.
        • El Totongy M.
        Clomiphene citrate plus N-acetyl cysteine versus clomiphene citrate for augmenting ovulation in the management of unexplained infertility: a randomized double-blind controlled trial.
        Fertil Steril. 2006; 86: 647-650
        • Badawy A.
        • State O.
        • Abdelgawad S.
        N-Acetyl cysteine and clomiphene citrate for induction of ovulation in polycystic ovary syndrome: a cross-over trial.
        Acta Obstet Gynecol Scand. 2007; 86: 218-222
        • Badawy A.
        • Metwally M.
        • Fawzy M.
        Randomized controlled trial of three doses of letrozole for ovulation induction in patients with unexplained infertility.
        Reprod Biomed Online. 2007; 14: 559-562
        • Badawy A.
        • Goda H.
        • Ragab A.
        Induction of ovulation in idiopathic premature ovarian failure: a randomized double-blind trial.
        Reprod Biomed Online. 2007; 15: 215-219
        • Badawy A.M.
        • Khiary M.
        • Sherif L.S.
        • Hassan M.
        • Ragab A.
        • Abdelall I.
        Low-molecular weight heparin in patients with recurrent early miscarriages of unknown aetiology.
        J Obstet Gynaecol. 2008; 28: 280-284
        • Badawy A.
        • Mosbah A.
        • Shady M.
        Anastrozole or letrozole for ovulation induction in clomiphene-resistant women with polycystic ovarian syndrome: a prospective randomized trial.
        Fertil Steril. 2008; 89: 1209-1212
        • Badawy A.
        • Allam A.
        • Abulatta M.
        Extending clomiphene treatment in clomiphene-resistant women with PCOS: a randomized controlled trial.
        Reprod Biomed Online. 2008; 16: 825-829
        • Badawy A.
        • Elnashar A.
        • El-Ashry M.
        • Shahat M.
        Gonadotropin-releasing hormone agonists for prevention of chemotherapy-induced ovarian damage: prospective randomized study.
        Fertil Steril. 2009; 91: 694-697
        • Badawy A.
        • Inany H.
        • Mosbah A.
        • Abulatta M.
        Luteal phase clomiphene citrate for ovulation induction in women with polycystic ovary syndrome: a novel protocol.
        Fertil Steril. 2009; 91: 838-841
        • Badawy A.
        • Khiary M.
        • Ragab A.
        • Hassan M.
        • Sherief L.
        Ultrasound-guided transvaginal ovarian needle drilling (UTND) for treatment of polycystic ovary syndrome: a randomized controlled trial.
        Fertil Steril. 2009; 91: 1164-1167
        • Badawy A.
        • Mosbah A.
        • Tharwat A.
        • Eid M.
        Extended letrozole therapy for ovulation induction in clomiphene-resistant women with polycystic ovary syndrome: a novel protocol.
        Fertil Steril. 2009; 92: 236-239
        • Badawy A.
        • Abdel Aal I.
        • Abulatta M.
        Clomiphene citrate or letrozole for ovulation induction in women with polycystic ovarian syndrome: a prospective randomized trial.
        Fertil Steril. 2009; 92: 849-852
        • Badawy A.
        • Abdel Aal I.
        • Abulatta M.
        Clomiphene citrate or anastrozole for ovulation induction in women with polycystic ovary syndrome? A prospective controlled trial.
        Fertil Steril. 2009; 92: 860-863
        • Badawy A.
        • Elnashar A.
        • Totongy M.
        Clomiphene citrate or aromatase inhibitors for superovulation in women with unexplained infertility undergoing intrauterine insemination: a prospective randomized trial.
        Fertil Steril. 2009; 92: 1355-1359
        • Badawy A.
        • Shokeir T.
        • Allam A.F.
        • Abdelhady H.
        Pregnancy outcome after ovulation induction with aromatase inhibitors or clomiphene citrate in unexplained infertility.
        Acta Obstet Gynecol Scand. 2009; 88: 187-191
        • Badawy A.
        • Elnashar A.
        • Totongy M.
        Clomiphene citrate or aromatase inhibitors combined with gonadotropins for superovulation in women undergoing intrauterine insemination: a prospective randomised trial.
        J Obstet Gynaecol. 2010; 30: 617-621
        • Badawy A.
        • Khiary M.
        • Ragab A.
        • Hassan M.
        • Sherif L.
        Laparoscopy--or not--for management of unexplained infertility.
        J Obstet Gynaecol. 2010; 30: 712-715
        • Badawy A.
        • Gibreal A.
        Clomiphene citrate versus tamoxifen for ovulation induction in women with PCOS: a prospective randomized trial.
        Eur J Obstet Gynecol Reprod Biol. 2011; 159: 151-154
        • Badawy A.M.
        • Elnashar A.M.
        • Mosbah A.A.
        Aromatase inhibitors or gonadotropin-releasing hormone agonists for the management of uterine adenomyosis: a randomized controlled trial.
        Acta Obstet Gynecol Scand. 2012; 91: 489-495
        • Gibreel A.
        • Badawy A.
        • El-Refai W.
        • El-Adawi N.
        Endometrial scratching to improve pregnancy rate in couples with unexplained subfertility: a randomized controlled trial.
        J Obstet Gynaecol Res. 2013; 39: 680-684
        • Ragab A.
        • Goda H.
        • Raghib M.
        • Barakat R.
        • El-Samanoudy A.
        • Badawy A.
        Does immediate postpartum curettage of the endometrium accelerate recovery from preeclampsia-eclampsia? A randomized controlled trial.
        Arch Gynecol Obstet. 2013; 288: 1035-1038
        • El Refaeey A.
        • Selem A.
        • Badawy A.
        Combined coenzyme Q10 and clomiphene citrate for ovulation induction in clomiphene-citrate-resistant polycystic ovary syndrome.
        Reprod Biomed Online. 2014; 29: 119-124
        • Marzouk T.
        • Barakat R.
        • Ragab A.
        • Badria F.
        • Badawy A.
        Lavender-thymol as a new topical aromatherapy preparation for episiotomy: a randomised clinical trial.
        J Obstet Gynaecol. 2015; 35: 472-475
        • El-Refaie W.
        • Abdelhafez M.S.
        • Badawy A.
        Vaginal progesterone for prevention of preterm labor in asymptomatic twin pregnancies with sonographic short cervix: a randomized clinical trial of efficacy and safety.
        Arch Gynecol Obstet. 2016; 293: 61-67
        • Abu Hashim H.
        • Mashaly A.M.
        • Badawy A.
        Letrozole versus laparoscopic ovarian diathermy for ovulation induction in clomiphene-resistant women with polycystic ovary syndrome: a randomized controlled trial.
        Arch Gynecol Obstet. 2010; 282: 567-571
        • Abu Hashim H.
        • Shokeir T.
        • Badawy A.
        Letrozole versus combined metformin and clomiphene citrate for ovulation induction in clomiphene-resistant women with polycystic ovary syndrome: a randomized controlled trial.
        Fertil Steril. 2010; 94: 1405-1409
        • Abu Hashim H.
        • Anwar K.
        • El-Fatah R.A.
        N-acetyl cysteine plus clomiphene citrate versus metformin and clomiphene citrate in treatment of clomiphene-resistant polycystic ovary syndrome: a randomized controlled trial.
        J Womens Health. 2002; 2010: 2043-2048
        • Abu Hashim H.
        • Wafa A.
        • El Rakhawy M.
        Combined metformin and clomiphene citrate versus highly purified FSH for ovulation induction in clomiphene-resistant PCOS women: a randomised controlled trial.
        Gynecol Endocrinol. 2011; 27: 190-196
        • Abu Hashim H.
        • Ombar O.
        • Abd Elaal I.
        Intrauterine insemination versus timed intercourse with clomiphene citrate in polycystic ovary syndrome: a randomized controlled trial.
        Acta Obstet Gynecol Scand. 2011; 90: 344-350
        • Abu Hashim H.
        • El Lakany N.
        • Sherief L.
        Combined metformin and clomiphene citrate versus laparoscopic ovarian diathermy for ovulation induction in clomiphene-resistant women with polycystic ovary syndrome: a randomized controlled trial.
        J Obstet Gynaecol Res. 2011; 37: 169-177
        • Shokeir T.
        • El-Lakkany N.
        • Sadek E.
        • El-Shamy M.
        • Abu Hashim H.
        An RCT: use of oxytocin drip during hysteroscopic endometrial resection and its effect on operative blood loss and glycine deficit.
        J Minim Invasive Gynecol. 2011; 18: 489-493
        • Abu Hashim H.
        • Foda O.
        • Ghayaty E.
        • Elawa A.
        Laparoscopic ovarian diathermy after clomiphene failure in polycystic ovary syndrome: is it worthwhile? A randomized controlled trial.
        Arch Gynecol Obstet. 2011; 284: 1303-1309
        • Abu Hashim H.
        • Bazeed M.
        • Abd Elaal I.
        Minimal stimulation or clomiphene citrate as first-line therapy in women with polycystic ovary syndrome: a randomized controlled trial.
        Gynecol Endocrinol. 2012; 28: 87-90
        • Abu Hashim H.
        • Alsherbini W.
        • Bazeed M.
        Contraceptive vaginal ring treatment of heavy menstrual bleeding: a randomized controlled trial with norethisterone.
        Contraception. 2012; 85: 246-252
        • Abu Hashim H.
        • El Rakhawy M.
        • Abd Elaal I.
        Randomized comparison of superovulation with letrozole vs. Clomiphene citrate in an IUI program for women with recently surgically treated minimal to mild endometriosis.
        Acta Obstet Gynecol Scand. 2012; 91: 338-345

      Linked Article