Exploring Local Literature Bias: A Critical Evaluation of Iranian Trials on the Efficacy of Psychotherapy for Chronic Pain

Document Type : Systematic Review

Authors

1 Faculty of Management and Accounting, Farabi Campus, University of Tehran, Qom, Iran

2 Department of Psychology, Faculty of Psychology and Education, University of Tehran, Tehran, Iran

Abstract
Background: Seeking local evidence on treatment efficacy is necessary if cultural factors are involved, as in psychotherapy for Chronic Pain (CP). Yet, local evidence is known to be prone to bias, making it difficult to reach reliable conclusions.
Objectives: This study aimed to critically evaluate our local evidence on the efficacy of psychotherapy on quality of life and disability in CP. It has been elaborated that, with some requirements, common meta-analytic tools can be utilized to detect and correct local evidence bias.
Methods: The protocol was registered on PROSPERO, Record [deleted for blind review]. Elmnet, Pubmed, and ProQuest were searched for randomized trials. A multilevel meta-analysis was used to capture the hierarchical structure of the data, and robust variance estimation was used for inference. Several moderation analyses were conducted, and publication and other related sources of bias were examined.
Results: Forty-two trials were initially included. Six were excluded before the analysis due to serious reporting problems undermining their validity. The SMD from 185 effect sizes was 1.08 [.87, 1.3]. The funnel plot showed a strong bias. The bias-corrected estimate from a regression-based method was 0.45 [0.04, 0.87], and from the trim-and-fill was 0.75 [0.48, 1.0].
Conclusion: While our original estimate was large, the corrected estimation showed a medium effect, fairly comparable to the international estimates. Current evidence on different sources of bias in our literature suggests low quality and questionable research practice as the first suspects for our local evidence bias.

Keywords


  1. Jensen MP, Turk DC. Contributions of psychology to the understanding and treatment of people with chronic pain: why it matters to ALL psychologists. Am Psychol. 2014;69(2): 105-18. doi:10.1037/a0035641
  2. Jensen MP. Psychosocial approaches to pain management: an organizational framework. PAIN®. 2011;152(4):717-25. doi:10.1016/j.pain.2010.09.002
  3. Williams AC de C, Eccleston C, Morley S. Psychological therapies for the management of chronic pain (excluding headache) in adults. Cochrane Database Syst Rev. 2012;(11): CD007407. doi:10.1002/14651858.cd007407.pub3
  4. Veehof MM, Trompetter HR, Bohlmeijer ET, Schreurs KMG. Acceptance- and mindfulness-based interventions for the treatment of chronic pain: a meta-analytic review. Cogn Behav Ther. 2016;45(1):5-31. doi:10.1080/16506073.2015.1 098724
  5. Gandy M, Pang ST, Scott AJ, Heriseanu AI, Bisby MA, Dudeney J, et al. Internet-delivered cognitive and behavioural based interventions for adults with chronic pain: a systematic review and meta-analysis of randomized controlled trials. Pain. 2022;163(10):e1041-53. doi:10.1097/j.pain.0000000000002606
  6. Holvast F, Massoudi B, Oude Voshaar RC, Verhaak PF. Non-pharmacological treatment for depressed older patients in primary care: A systematic review and meta-analysis. PloS One. 2017;12(9):e0184666. doi:10.1371/journal.pone.0184 666
  7. Pillay T, van Zyl HA, Blackbeard D. Chronic pain perception and cultural experience. Procedia - Soc Behav Sci. 2014; 113:151-60. doi:10.1016/j.sbspro.2014.01.022
  8. Ko V, Kafa G. Cross-cultural research on psychotherapy: The need for a change. J Cross Cult Psychol. 2019;50(1):100-15. doi:10.1177/0022022118806577
  9. Li S, Xi Z, Barnett P, Saunders R, Shafran R, Pilling S. Efficacy of culturally adapted interventions for common mental disorders in people of Chinese descent: a systematic review and meta-analysis. Lancet Psychiatry. 2023;10(6):426-40. doi:10.1016/S2215-0366(23)00118-9
  10. Towhidi A, Firoozi M, Jandaghi G. Meta-analysis of psychological intervention for chronic pain: Challenges and Strategies for research quality improvement. Anesthesiol Pain. 2019;10(3):91-104.
  11. Jandaghi G, Firoozi M, Zia-Tohidi A. Psychological interventions for depression and anxiety: A systematic review and meta-analysis of Iranian chronic pain trials. Heal Promot Perspect. 2020;10(3):180-91. doi:34172%2Fhpp.2020.31
  12. Jandaghi G, Zia-Tohidi A, Firoozi M. Psychological interventions for irritable bowel syndrome: A meta-analysis of Iranian randomized trials. Arch Iran Med. 2021;24(6):496-504. doi:34172/aim.2021.71
  13. Vickers A, Goyal N, Harland R, Rees R. Do certain countries produce only positive results? A systematic review of controlled trials. Control Clin Trials. 1998;19(2):159-66. doi:1016/S0197-2456(97)00150-5
  14. Cramer H, Lauche R, Langhorst J, Dobos G. Are Indian yoga trials more likely to be positive than those from other countries? A systematic review of randomized controlled trials. Contemp Clin Trials. 2015;41:269-72. doi:1016/ j.cct.2015.02.005
  15. Zhang D, Freemantle N, Cheng KK. Are randomized trials conducted in China or India biased? A comparative empirical analysis. J Clin Epidemiol. 2011;64(1):90-doi:10.1016/j.jclinepi.2010.02.010
  16. Pan Z, Trikalinos TA, Kavvoura FK, Lau J, Ioannidis JPA. Local literature bias in genetic epidemiology: An empirical evaluation of the Chinese literature. PLoS Med. 2005;2(12): 1309-17. doi:1371/journal.pmed.0020334
  17. Panagiotou OA, Contopoulos-Ioannidis DG, Ioannidis JPA. Comparative effect sizes in randomised trials from less developed and more developed countries: meta-epidemiological assessment. BMJ. 2013;346:f707. doi:11 36/bmj.f707
  18. Wood L, Egger M, Gluud LL, Schulz KF, Jüni P, Altman DG, et al. Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. BMJ. 2008;336(7644):601-5. doi:1136/bmj.39465.451748.AD
  19. Xie Y, Wang K, Kong Y. Prevalence of Research Misconduct and Questionable Research Practices: A Systematic Review and Meta-Analysis. Sci Eng Ethics. 2021;27(4):41. doi:100 7/s11948-021-00314-9
  20. Nakagawa S, Lagisz M, Jennions MD, Koricheva J, Noble DWA, Parker TH, et al. Methods for testing publication bias in ecological and evolutionary meta‐ Methods Ecol Evol. 2022;13(1):4-21. doi:10.1111/2041-210X.13724
  21. Sterne JA, Sutton AJ, Ioannidis JP, Terrin N, Jones DR, Lau J, et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled BMJ. 2011;343:d4002. doi:10.1136/bmj.d4002
  22. Vesal M, Neshatdust HT. Meta-analysis of psychological intervention`s effectiveness on reduction of pain intensity among patients with chronic pain. J Anesthesiol Pain. 2019;10(3):21-38.
  23. [Refernce deleted for blind review]
  24. Faizi F, Tavallaee A, Rahimi A, Saburi A, Saghafinia M. Quality assessment of randomized control trials applied psychotherapy for chronic pains in iran: a systematic review of domestic trials. Iran Red Crescent Med J. 2014;16(9): e15312. doi:5812/ircmj.15312
  25. Hedges L V., Tipton E, Zejnullahi R, Diaz KG. Effect sizes in ANCOVA and difference‐in‐differences designs. Br J Math Stat Psychol. 2023;76(2):259-82. doi:1111/bmsp.12296
  26. Borenstein M, Hedges L V. Effect Sizes for Meta-Analysis. In: Cooper H, Hedges L V, Valentine JC, editors. The Handbook of Research Synthesis and Meta-Analysis. 3rd ed. New York: The Russell Sage Foundation; 2019. pp. 107–244.
  27. Langan D, Higgins JP, Jackson D, Bowden J, Veroniki AA, Kontopantelis E, et al. A comparison of heterogeneity variance estimators in simulated random‐effects meta‐ Res Synth Methods. 2019;10(1):83-98. doi:10.1002/jrsm.1316
  28. Viechtbauer W. Confidence intervals for the amount of heterogeneity in meta-analysis. Stat Med. 2007;26(1):37-52. doi:1002/sim.2514
  29. Hedges LV, Tipton E, Johnson MC. Robust variance estimation in meta‐regression with dependent effect size estimates. Res Synth Methods. 2010;1(1):39-65. doi:1002/jrsm.5
  30. Rodgers MA, Pustejovsky JE. Evaluating meta-analytic methods to detect selective reporting in the presence of dependent effect sizes. Psychol Methods. 2021;26(2):141-60. doi:1037/met0000300
  31. Viechtbauer W. Conducting Meta-Analyses in R with the metafor Package. J Stat Softw. 2010;36(3):1-48. doi:18637/jss.v036.i03
  32. Del Re AC. compute.es: Compute Effect Sizes. R Package. 2013.
  33. Mahdipoor M, Zargar Y, Davoodi I. Comparing the efficacy of combining psychological-medical therapy and medical therapy on mental health, improving quality of life, and reducing symptoms in patients with irritable bowel syndrome in Ahvaz. In: Fourth international psychosomatic congress; 2012.
  34. Jafari R, Shalchi B. The efficacy of mindfulness-based cognitive-behavioral therapy on psychological wellbeing and quality of life in patients with chronic pain disorder. In: The 7th Scientific & Research Conference on the Development and Promotion of Educational Sciences & Psychology in Iran, 2020.
  35. Sadeghi M, Moradi Z. Effectiveness of Acceptance- and Commitment-Based Therapy on Pain Perception and Functional Disability in Women with Rheumatoid Arthritis. Sci J Sch Public Heal Inst Public Heal Res. 2020;18(2):199-214.
  36. Shafiee Fard Y, Besharat MA, Bahrami Ehsam H, Taheri A. Effectiveness of Group Cognitive – Behavioral Therapy on Quality of Life, Depression, Anxiety and Stress among Patients with chronic pain. Appl Psychol Res Q. 2015;6(1): 209-24.
  37. Pourmohseni-Koluri F, Eslami F. The effectiveness of group cognitive therapy based on mindfulness on mental health and quality of life of patients with irritable bowel syndrome. Health Psychol. 2017;5(20):48-67.
  38. Esmailpoor B, Aleyasin SA. Effectiveness of emotional intelligence training on anxiety and quality of life for patients with irritable bowel syndrome. In: 3rd international conference on psychology, educational sciences, and lifestyle with international approache; 2017.
  39. Kaviani H, Mousavi AS. Psychometric properties of the Persian version of Beck Anxiety Inventory (BAI). Tehran Univ Med J. 2008;65(2):136-40.
  40. Haghayegh SA. Efficacy of Dialectical Behavioral Therapy and Emotion Focused Therapy on emotional memory and psychological indexes of IBS patients. University of Isfahan; 2012.
  41. Naddafnia L, Ebrahimi A, Neshatdust HT, Talebi H. Comparison of Effectiveness of Cognitive Behavioral Therapy and Spiritual Therapy on Symptoms Intensity, Quality of Life, in Patients with Irritable Bowel Syndrome. J Res Behav Sci. 2019;17(2):291-302. doi:52547/rbs.17.2.291
  42. GhotbinejhadBahreAsmani U, Ahadi H, Hatami H, SaramiForoushani G. Comparison of the Effectiveness of group positive psychotherapy and group psychodrama on spiritual attitude, distress tolerance, and quality of life in women with chronic pain. J Anesthesiol pain. 2019;9(4):51-65.
  43. Salarian B, ShomaliOskouei A, ArefNazari M. The Effect of Mindfulness on Quality of Life and Chronic Pain Management. Med J Mashhad Univ Med Sci. 2020;62:497-506.
  44. Irandoost F, Neshatdoost HT, Nadi MA. The effectiveness of Acceptance and Commitment Therapy (ACT) on quality of life of women with chronic low back pain. Int J Behav Sci. 2014;8(1):89-96.
  45. Tavafian SS, Jamshidi AR, Mohammad K. Treatment of low back pain: Second extended follow up of an original trial (NCT00600197) comparing a multidisciplinary group-based rehabilitation program with oral drug treatment alone up to 30 months. Int J Rheum Dis. 2017;20(12):1910-6. doi:1111/1756-185X.12540
  46. Dwan K, Gamble C, Williamson PR, Kirkham JJ, Reporting Bias Group. Systematic review of the empirical evidence of study publication bias and outcome reporting bias—an updated review. PloS One. 2013;8(7):e66844. doi:10.1371/ journal.pone.0066844
  47. Navabi N, Shahravan A, Yazdi SM, Montajab F. Probability of Publication Bias in Published Articles Resulting from Dental Dissertations of Medical Sciences Universities in Iran. Pesqui Bras Odontopediatria Clin Integr. 2020;19:e4756. doi:10.4034/PBOCI.2019.191.104
  48. Khadem-Rezaiyan M, Dadgarmoghaddam M. Research misconduct: A report from a developing country. Iran J Public Health. 2017;46(10):1374-8.
  49. Afkar A, Ashouri A, Rahmani M, Emami Sigaroudi A. Effect of exercise therapy on quality of life of patients with multiple sclerosis in Iran: a systematic review and meta-analysis. Neurol Sci. 2017;38(11):1901-11. doi:1007/s10072-017-3047-x
  50. Motl RW, Gosney JL. Effect of exercise training on quality of life in multiple sclerosis: A meta-analysis. Mult Scler. 2008;14(1):129-35. doi:1177/1352458507080464
  51. Edmond SN, Turk DC, Williams DA, Kerns RD. Considerations of trial design and conduct in behavioral interventions for the management of chronic pain in adults. Pain Reports. 2019;4(3):1-10. doi:1097%2FPR9.000000 0000000655
  52. Tavafian SS, Jamshidi AR, Mohammad K. Treatment of chronic low back pain: a randomized clinical trial comparing multidisciplinary group-based rehabilitation program and oral drug treatment with oral drug treatment alone. Clin J Pain. 2011;27(9):811-8. doi:1097/ajp.0b013 e31821e7930
  53. Tavafian SS, Jamshidi AR, Shay B. Treatment of low back pain: First extended follow up of an original trial (NCT00600197) comparing a multidisciplinary group-based rehabilitation program with oral drug treatment alone up to 24 months. Int J Rheum Dis. 2017;20(12):1902-9. doi:11 11/1756-185X.12468
  54. Tabatabaee Shahrabad A. The Effectiveness of Metacognitive Therapy on Anxiety, Depression and Quality of life of Patients with Irritable Bowel Syndrome (Thesis) [Internet]. Ferdowsi University of Mashhad; 2014. https://ganj.irandoc.ac.ir/#/ articles/5eba7c222a8b3e725e0f584ec4e485fb [Accessed January 5, 2022]
  55. Zomorrodi S, Rasoulzadeh Tabataba’i SK. Comparison of Effectiveness of Cognitive-Behavioral Therapy and Mindfulness -Based Therapy in Improving quality of life in patients with irritable bowel syndrome. Clin Psychol Stud. 2013;4(13):63-88.
  56. Sadeghi Mazidi S. The Effect of Training on copying with stress and Emotion Regulation on Life Style and pain in Chronic Low Back Pain [thesis]. Payame Noor University-Tehran Jonoub; 2015.
  57. Tavakoli H, Akbari B, Salari A. Group based acceptance and commitment therapy on quality of life and psychological flexibility in patients with non-cardiac chest pain. Middle East J Disabil Stud. 2019;9:108.
  58. Firoozi M, Haghdoost A. The Effectiveness CBT Based on Positive Thinking Using Computer Program and Virtual Social Networks on Improving Quality of Life in Patients with Chronic Low Back Pain. J Anesthesiol pain. 2020; 11(3):66-76.
  59. Rezaie F. [A comparision of the effectiveness of emotion focused cognitive behavioral therapy, and schema therapy on pain, pain catastrophizing, emotion regulation and quality of life in rheumatoid arthritis patients (PHD thesis) (Persian)] [Internet]. 2014. https://ganj.irandoc.ac.ir/#/articles /9d43d8eb2ee06a013a3e031754648b3b [Accessed January 5, 2022]
  60. Masumian S. The Effect of Mindfulness-Based Stress Reduction (MBSR) on Decreasing Depression, increasing Quality of Life and self-efficacy of the Chronic Low back Pain Patients(CLBP) [Internet]. Allameh Tabataba’i university; 2013. https://ganj.irandoc.ac.ir/#/articles/a36bb03bf27a84efa275cd81e9261aba [Accessed January 5, 2022]
  61. Haghayegh S, Kalantari M, Molavi H, Talebi M. Efficacy of cognitive-behavior therapy on the quality of life of patients suffering from irritable bowel syndrome with predominant pain and diarrhea types. J Psychol. 2010;14:195-110.
  62. Abazari N. the effectiveness of hypnotherapy with physiotherapy on pain intensity, psychological distress, and functional disability in paitient with chronic non-specific low back pain. University of Semnan; 2016.
  63. Parhizgar M, Moradi Manesh F, Serajkhorrami N, Ehteshamzadeh P. The Effectiveness of mindfulness integrated cognitive behavior therapy on pain syndrome, quality of life relative with health anxiety. Thoughts and Behavior in Clinical Psychology. 2019;14(54):37-46.
  64. Farokhzadian AA, Ahmadian F, Andalib L. The Effectiveness of Acceptance and Commitment Therapy on the Severity of Symptoms and Quality of Life in Soldiers with Irritable Bowel Syndrome. J Mil Med. 2019;21(1):44-52.
  65. Kamkar A. The Effectiveness of group Cognitive – Behavioral Stress Management on physical Symptoms of Patients with Irritable Bowel Syndrome with and without comorbidity of anxiety and depression and on increase of their quality of life (Thesis) [Internet]. Allameh Tabataba’i University; 2011. https://ganj.irandoc.ac.ir/#/articles/955fef8788af646c279def0e083d54e3 [Accessed January 5, 2022]
  66. Mohamadi J, Azizi A. Dialectical Behavior Therapy Group on the Perception of the Disease and Quality of Life of Patients with Irritable Bowel Syndrome. Sci J Ilam Univ Med Sci. 2017;25(2):18-26.
  67. Azizi A. Mindfulness Efficacy on the Perception of the Disease and the Quality of Life of Patients with Irritable Bowel Syndrome. J Ilam Univ Med Sci. 2018;25(6):1-9. doi:29252/sjimu.25.6.1
  68. Dabbaghi Zarif S. Effectiveness of mindfulness based stress reduction (MBSR) on mental health and quality of life in Irritable Bowel Syndrome (IBS) cases. Payam Noor University; 2015.
  69. Solati-Dehkordi K. A comperhensive study of cognitive-behavioral therapy, life style training, relaxation and medication therapies on quality of life, psychological symptoms, severity and frequency of symptoms IBS-d patients (Thesis) [Internet]. University of Isfahan; 2009. https://ganj.irandoc.ac.ir/#/articles/e3e319fcd99ff7be8095245afbb35258 [Accessed January 5, 2022]
  70. Pashing S, Khosh Lahjeh Sedgh A. Comparison of effectiveness of acceptance commitment therapy and metacognitive therapy on reducing symptoms, psychological capital and quality of life of patients suffering from irritable bowel syndrome. Med Sci J Islam Azad Univ. 2019;29(2):181-90. doi:29252/iau.29.2.181
  71. Kheir-Abadi G, Bagherian R, Nemati K, Daghaghzadeh H, Maracy MR, Gholamrezaei A. The effectiveness of coping strategies training on symptom severity, quality of life and psychological symptoms among patients with irritable bowel syndrome. J Isfahan Med Sch. 2010;28(110):1-11.
  72. Shojaei S, Tavafian SS, Jamshidi AR, Wagner J. A multidisciplinary workplace intervention for chronic low back pain among nursing assistants in Iran. Asian Spine J. 2017;11(3):419-26. doi:4184/asj.2017.11.3.419
  73. Chamani Ghalandary R, Ardalan MA, Dokaneifard F, Chamani S, Ghamchili A, Razei H, et al. The effectiveness of of cognitive-behavioral therapy on the general health and quality of life of patients with irritable bowel syndrome. Nurse Physician Within War. 2019;23(7):5-10.
  74. Anvari MH, Ebrahimi A, Neshatdoost HT, Afshar H, Abedi A. The effectiveness of group-based acceptance and commitment therapy on pain-related anxiety, acceptance of pain and pain intensity in patients with chronic pain. J Isfahan Med Sch. 2014;32(295):1156-65.
  75. Vakili N. effectiveness of group cognitive behavior therapy on depression, quality of life of patients with low back pain (thesis) [Internet]. university of Isfahan; 2009. https://ganj.irandoc.ac.ir/#/articles/b2b7098cf66f60dc929fe74ef784ab4a [Accessed January 5, 2022]
  76. Rezaeian M, Ebrahimi A, Zargham M. The effect of acceptance and commitment therapy on catastrophic and disabling pain in chronic pelvic pain in Females. Res Cogn Behav Sci. 2015;4(2):17-30.
  77. Dadollahi Sarab R. The effect of mindfulness-based stress reduction program (MBSR) on reducing symptoms of irritable bowel syndrome (IBS). Shahid Bahonar University of Kerman; 2016. https://ganj.irandoc.ac.ir/#/articles/36a650 0447f15bfb88f76f6b04c83d67 [Accessed January 5, 2022]
  78. Fouladi N, Mohammadkhani S, Shahidi E, Ebrahimi Daryani N. The Effectiveness of Cognitive Behavioral Therapy in Improving and Promoting of Physical and Mental Health of Patients with Irritable Bowel Syndrome. J Heal Educ Heal Promot. 2018;6(3):312-23. doi:30699/acadpub.ijhehp.6 .3.312
  79. Mansoobi M. The efficacy of acceptance and commitment therapy on quality of life and emotion regulation in patients with chronic low back pain. In: Fourth National Conference on Psychology and Behavioral Sciences, Payame Noor University; 2020.
  80. Vakili T, Hasanzadeh R. The effectiveness of group reality therapy on quality of life among patients with irritable bowel syndrome. In: 3nd international conference on psychology, counseling, and education; 2020.
  81. Soltanian G, Najafi M, Rafienia P, Mirfeizi Z. The effectiveness of cognitive-behavioral group therapy on quality of life in patients with rheumatoid arthritis. Pajoohandeh J. 2016;21(3):122-9.
  82. Ayoughi Rahnama V, Zareipoor M, Ghorbanalipour M. Effect of Stress Inoculation Training on Quality of Life of Patients with Rheumatoid arthritis: A Clinical Trial. Iran J Orthop Surg. 2019;17(2):70-7. doi:10.22034/ijos.2020.121391
  83. Boloorsaz Mashhadi H, Aghaei M, Mohammadkhani M, Mahdavi A. Examining the Effect of Teaching Islamic-based Coping Strategies on Indicators of Chronic Pain and Quality of Life among Women with Fibromyalgia. J Res Reli Heal. 2017;3(4):48-65.