Evaluation of The Psychiatric Research Output From Turkey Via Web Of Science Database: A Bibliometric Analysis

 

Zehra Topala, Ilhan Bahsib, Ali Evren Tufanc

 

Department of Child and Adolescent Psychiatry, Gaziantep University, Gaziantep; 

Department of Anatomy, Faculty of Medicine, Gaziantep University, Gaziantep; 

Department of Child and Adolescent Psychiatry, Abant Izzet Baysal University, Bolu, Turkey

 

 

 

Abstract

Background: Global scientific research output is continuously accelerating. Although psychiatric scientific output is increasing, factors such as health systems, scientific programs and financial supports that vary between countries lead to varied levels of contribution. This cross sectional bibliometric study aims to analysis the articles bibliometrically which conducted by researchers from Turkey and indexed in SCI-E index of the Web of Science (WoS)database in the category of Psychiatry.

Methods: According to 2019 data, in the WoS database, journals in the Psychiatry category and indexed in the SCI-E were determined. Publications from Turkey that were published in these journals was determined. For each publication, all information relevant to the analysis was exported to Microsoft Excel and EndNote Desktop. Also, VOSviewer software was used to create a collaboration and word co-occurrence network.

Results: There were 5293 publications which have at least one author from Turkey. Only 774 articles (14.62%) were written as international collaborations. The authors from Turkey were collaborating with the researchers from 66 diffrent countries and USA was leading these countries with 420 publications (%7.93), followed by England (3.3%) and Germany (2.4), respectively. The total number of citations was 53931 for these publications (mean: 10.19±22.51). The most prolific institution is Istanbul University while the most frequently selected journal by Turkish authors is Psychiatry and Clinical Psychopharmacology.

Conclusion: Bibliometric studies are crucial in evaluating domain specific research and in planning for efficient use of limited resources. Psychiatric literature from Turkey greatly increased within the last two decades. However, international collaborations are still limited and most of the publications are in journals published in Turkey.

Keywords: Bibliometric analysis, Turkey, Psychiatric research output

 

 

 

INTRODUCTION

The history of psychiatry is probably as old as that of humanity, although psychiatry as a science is a relatively younger branch of medicine [1]. Mental disorders in ancient times were attributed to supernatural causes and magical rituals were used in healing. Through this time, magicians and religious authorities functioned in treatment [2,3]. Acceptance of psychiatry as a branch of medicine and the onset of contemporary psychiatric practice is a much more recent phenomenon. Actual breakthroughs in psychiatric science had to wait for the emergence of psychopharmacological treatments, construction of a shared language for psychopathology by means of classification systems (e.g. Diagnostic and Statistical Manual of Mental Disorders; DSM, International Classification of Diseases; ICD, Chinese Classification of Mental Disorders, CCMD) as well as innovations in neuroscience and genetics. This period was greatly assisted by increased scholarly output [4].

Global scientific research output is continuously accelerating. According to a report released in 2015, 2.5 million research articles were published annually [5]. Zhang and colleagues [4] reported that psychiatric scientific journals published 84760 articles between 2011- 2015, globally. According to the same authors, within the four-year period of evaluation, approximately 17000 articles were published yearly and the research output increased 1.3 times [4].

Although psychiatric scientific output is increasing, factors such as health systems, scientific programs and financial supports vary between countries leading to varied levels of contribution between countries [6,7]. Zhang and colleagues [4] reported that the most productive country (among 122) in terms of psychiatric research output in their sample was the USA (32.7 %). United States was followed by the UK (8.6 %), Germany (6.8 %) and Canada (4.9 %). Mean number of citations were ranked as the UK (9.9/ article), the Netherlands (9.8/ article) and the USA (8.8/ article) [4]. Zhang and colleagues [4] found that 87.7 % of the research output was originated from high-income countries while countries with middle- high (11.1 %) and low- middle (1.0 %) income accounted for much less. Only 0.2 % of the research output was from low income countries. In their list, Turkey was ranked as middle- high income and listed as thirteenth in terms of research output [4]. The dramatic divide in research output across countries according to their income levels was also noted previously by Saxena and colleagues [7]. In a more recent study, Moghadami and colleagues [8] found that the USA, the UK and Germany were foremost among psychiatric research output listed in SCOPUS database. In that study, the most active institutions were the King’s College in London, the Veterans’ Affairs Medical Center and the Harvard Faculty of Medicine from the USA [8].

Only one aspect of scientific output may be measured by the number of articles published, however, and scientific efficiency also depends on the quality of articles published. Bibliometric analysis emerged as a novel method to evaluate various aspects of scientific output. This method depends on “bibliometrics” which is defined as application of statistical methods on scientific books, articles and other communication media [9-12]. Bibliometric analysis allows researchers to evaluate scientific output on identified subjects within selected regions, periods and by isolated individuals/ institutions. It also allows evaluations of relationships between those publications and scientific efficiency [11,12]. Bibliometric studies on psychiatric research output as well as on output of allied disciplines from Turkey are relatively limited [13-16]. Therefore, this study aims to evaluate psychiatric research output from Turkey indexed in Web of Science (WoS)and SCI- E index by means of bibliometric methods.

 

 

METHODS

Identification of articles

Using Advanced Search, from the WoS database, articles published in journals classified within the category of Psychiatry were selected (Web of Science Category, WC=Psychiatry). The journals had to be indexed in Science Citation Index- Expanded (SCI-E) database for inclusion. Meeting abstracts, proceedings papers, book chapters, book reprints and early access were excluded as document types. Study period was set as 1980- 2019 and articles from 2020 were also excluded. “Turkey” was selected from the scroll-down menu of Countries/ Regions. At least one of the authors of articles had to be from Turkey for inclusion.

 

Analysis

For each publication, all information relevant to the analysis was exported to Microsoft ExcelTM (Microsoft Corp., WA, USA) and a bibliography manager [EndNoteTM Desktop, Clarivate Inc., Philadelphia, PA, USA]. The extracted information included; Author (s), Title, Source, Addresses, Times Cited, and Keywords. VOSviewer software (Version 1.6.15, Centre for Science and Technology Studies, Leiden University, The Netherlands) was used to create a collaboration and word co-occurrence network and to evaluate citation densities [17]. Descriptive analyses were used in summarizing data. Nominal data were summarized as counts and frequencies while quantitative data were summarized as means and standard deviations.

 

RESULTS

More than five thousand (n= 5293) articles were published in journals in the psychiatry category indexed in SCI-E section of the WoS database between 1980- 2019 in which at least one of the authors were from Turkey. Yearly distribution of articles is illustrated in Figure 1. The majority of the articles were written by a team composed of authors solely from Turkey (n= 4519, 85.4%). Only 774 articles (14.6%) were written as international collaborations. The authors from Turkey were collaborating with the researchers from 66 diffrent countries and USA was leading these countries with 420 publications (%7.93), followed by England (3.3%) and Germany (2.4), respectively. The international collaboration map of the publications is shown in Figure 2.

More than a hundred institutions from Turkey were sources of articles. Ten of the most prolific institutions are listed in Table 1 with institutional collaboration map illustrated in Figure 3. More than half of those institutions were from the largest cities in Turkey (Istanbul, n= 3, Izmir, n= 2, Ankara, n=2) while Elazig, Gaziantep and Manisa were represented by one institution, each. According to VOSviewer analysis, there was a total of 59350 different words in the titles and abstracts of 5293 publications. The distribution map of the 200 most frequently used words in the titles and abstracts is given in Figure 4. The colors used in this figure indicate words within the same topic cluster and distinguishing five colored clusters.

Those articles were published in more than 100 journals. The twenty journals most frequently selected by Turkish authors are listed in Table 2. Psychiatry Clin Psychopharmacol (16.53 %), Anadolu Psikiyatri Derg (16.44 %) and Prog Neuro-Psychopharmacol Biol Psychiatry (3.63 %) were most frequent outlets for Turkish authors. When the fact that Bulletin of Clinical Psychopharmacology changed its name to Psychiatry and Clinical Psychopharmacology in 2016 was considered, that journal emerged as the most frequent outlet for Turkish authors (i.e. n= 875, 16.53 %, Table 2).

More than fifty-thousand citations were made (n= 53931) to the 5293 articles prior to January 2020. Mean number of citations was calculated as 10.19±22.51. More than half of the articles (n= 3779, 71.4%) received at least one citation. Most frequently cited twenty-five articles [18-42] were listed in Table 3, while twenty-five journals most frequently cited were listed in Table 4 and illustrated in Figure 5.

Most commonly cited articles concerned mood disorders (n= 16) and especially depression (n= 10). Oxidative stress and suicidality in depression were evaluated in two studies, each while neurotrophic factors in depression were evaluated in three studies. Other studies concerned oxidative stress in schizophrenia (n=2), neuropsychological features of bipolar disorders (n= 2), magnetic resonance findings in mood disorders (n= 2), treatment of bipolar disorders (n= 2) and alcohol/ substance use disorders (n= 2, Table 3). Most of the frequently cited studies were published in 2005 and 2006 (n= 3, each) and the majority of the frequently cited studies were published from 1997 to 2015 (n=24, 96.0 %).

The most commonly cited journals which published the evaluated articles were Prog Neuropsychopharmacol Biol Psychiatry (9.4 %), Psychiatry Res (5.9 %), Comprehensive Psychiatry (5.5%), J Affect Disord (5.4 %) and Psychiatry Clin Neurosci (4.7 %). Rate of citations to Anadolu Psikiyatri Dergisi- Anatolian Journal of Psychiatry and Klinik Psikofarmakoloji Bülteni- Bulletin of Clinical Psychopharmacology were found to be 3.5 % and 3.0 %; respectively.

Using the VOSviewer software, it was found that more than six thousand key words (n= 6745) were used in the evaluated articles. The most commonly used key words were “depression” (n= 496, 7.4%), “schizophrenia” (n= 470, 7.0%), and “bipolar disorder” (n= 299, 4.4%). Most commonly used keywords according to their clusters is illustrated in Figure 6. Most frequent citations according to authors’ institutions were listed as Istanbul University (n= 7298, 13.5%), Ege University (n= 3729, 6.9%) and Dokuz Eylul University (n= 3681, 6.8%). Top twenty-five author institutions according to number of citations is illustrated in Figure 7.

 

DISCUSSION

This study aimed to evaluate psychiatric research output from Turkey indexed in WoS and SCI- E index by means of bibliometric methods. All articles published between 1980- 2019 for which at least one of the authors was from Turkey were eligible for inclusion. As a result, we found that more than five thousand articles were published with a significant increase after 2000 (Figure 1 and Table 3). The majority of articles were written by a team composed solely of Turkish authors and only more than one-tenth were written as international collaborations. Most prolific authors were from Istanbul, Dokuz Eylul and Ege Universities. Most common outlets for publications were Psychiatry Clin Psychopharmacol, Anadolu Psikiyatri Derg and Prog Neuro-Psychopharmacol Biol Psychiatry. More than fifty-thousand citations were made to the articles prior to January 2020. Mean number of citations was calculated as 10.19±22.51. More than half of the articles (71.4%) received at least one citation. Most frequently cited articles addressed mood disorders (especially depression). Most frequently cited articles were published in Prog Neuropsychopharmacol Biol Psychiatry, Psychiatry Res and Comprehensive Psychiatry. Most frequently cited institutions were Istanbul University, Ege University and Dokuz Eylul University.

It is known that science has developed over the course of thousands of years with the contributions of numerous scientists [43]. As a result of scientific and technological innovations, the number of scientific articles published, are increasing daily, especially in the last hundred years. However, psychiatry and allied disciplines display an even greater increase in scientific output [44,10] compared to other disciplines. Larivière and Grant [10] conducted a bibliometric analysis of 366322 articles from 20 countries published between 1980- 2007 and reported that articles on mental health and disorders increased four-fold within the study period. Evaluations of temporal trends in psychiatric studies from Turkey demonstrated a significant increase in output within the last two decades (Figure 1). Accordingly, we could find 22 articles from Turkey indexed in WoS and SCI-E databases for the year 2000 which increased to 541 for the year 2019 (i.e. an increase of 24.6 times). This elevation may reflect the increased use of web-based services for publication and collaborations among clinicians as well as the introduction of electronic publication services [45,46]. The increase in the number of Turkish higher education institutions within the last two decades as well as the importance of international publications for academic tenure in our country may also have contributed to this finding [47]. Regardless of this increase; Larivière and Grant [10] reported that psychiatric scientific output of Spain, France, South Korea, Japan and Turkey still lagged behind what is expected of those countries when their total scientific output was evaluated.

Despite the ubiquity of web-based services for collaboration as well as the endorsement of the international collaborations by The Scientific and Technological Research Council of Turkey; the majority of the publications we evaluated included intra-national groups of authors. Along with global research output, international collaborations are also increasing. In study, international collaborations in mental health research was reported to increase to 22.0% for the year 2011 (vs. 3.0% in 1980) [48]. Larivière and Grant reported that Israel, Brazil and Turkey displayed significantly less international collaboration compared to their scientific output and this may reflect the regional dominance of those countries for mental health research [10]. Two studies conducted on scientific output from Turkey reported that although international collaborations were increasing, Turkish authors still chose intra-national colleagues for collaborations over international ones [49,50]. Our results may also support the need for supporting international collaborations of Turkish psychiatrists, child and adolescent psychiatrists and psychologists.

Most prolific as well as the most cited institutions in our study were Istanbul University, Dokuz Eylul University and Ege University. The leading one is located in Istanbul while the remainder are located in Izmir. Both Istanbul and Izmir are located in the western part of Turkey and are major communication, technology and service hubs. This may have increased their scientific output.

The most common journals chosen by Turkish authors for psychiatric research in our study were Psychiatry Clin Psychopharmacol (The journal name Bulletin of Clinical Psychopharmacology changed to Psychiatry and Clinical Psychopharmacology in 2016), Anadolu Psikiyatri Derg and Prog Neuro-Psychopharmacol Biol Psychiatry. The first two journals are located in Turkey which may have affected the authors’ choices. Most frequently cited journals in our study were Prog Neuro-Psychopharmacol Biol Psychiatry (IF= 4.3), J Affect Disord (IF= 4.1) and Psychiatry Res (IF= 2.2) which may expected from their impact factors.

The mean number of citations per article in our study was 10.19±22.51. Igoumenou and colleagues [44] reported that articles from the USA received the highest number of citations (mean 11.5), followed by the Netherlands (mean 11.4), Canada (mean 9.8) and the UK (mean 9.7). The average number of citations in our study was lower than the USA and the Netherlands while it was higher than Canada and the UK. However, this figure is only correct for the studies we evaluated and Turkish scientific output in mental health as well as total citations received in this domain were repeatedly reported as low in the past [4,8,10]. Besides, the high mean number of citations in our study may be related to the wide time interval. However, Igoumenou et al. [44] examined only the articles that published between the years 2005-2009. Scientific impact is favorably affected by specialization in a niche topic, structured/ informative abstracts, greater number of references, longer/ detailed reports, inclusion of study design in the title as well as being published as open access [48,51]. Therefore, citations to mental health research from Turkey may be increased by considering those factors as well as increasing international and intra-national collaborations.

Most common keywords for studies evaluated in our research were “depression”, “schizophrenia” and “bipolar disorder”. This may reflect the fact that depression is the commonest psychiatric disorder globally. Global research output on bipolar disorder is rapidly increasing within the last quarter century although literature on this disorder is still patchy compared to that on schizophrenia [52,53]. Research output on schizophrenia is also increasing but its share in total psychiatric output is reducing (from 5.2% to 2.6% within the last 50 years) [54]. Larivière and colleagues [48] found that research areas varied between countries. According to their results, bipolar and obsessive compulsive disorders were more frequently foci of research from Turkey and that Turkish research output mostly focused on journals covering clinical observations. The last observation may be explained by the greater clinical experience of Turkish clinicians and their lack of access to sophisticated neuroimaging tools [48].

Our results should be evaluated within their limitations. Firstly, we evaluated studies only from 1980 to 2019 and our results may not be valid for other dates. Secondly, we included studies indexed in WoS and SCI-E databases and not inclusion of other databases may have affected our results. Thirdly, we did not use formal network analysis in evaluating relationships between institutions, journals and keywords [55]. Using formal network analysis methods may have allowed us to determine central and peripheral nodes and strengths of connections as well as separate clusters. Finally, it is known that not all publications in the field of psychiatry are published only in journals scanned in the category of psychiatry. This issue is one of the important limitations of our study.

 

CONCLUSION

Bibliometric studies are crucial in evaluating domain specific research and in planning for efficient use of limited resources. This study aimed to evaluate the contribution of Turkish researchers to the psychiatric literature, to determine gaps in research and increase awareness of researchers. Psychiatric literature from Turkey greatly increased within the last two decades. However, international collaborations are still limited and most of the publications were in journals published in Turkey. Citations to studies may also be increased further. Higher education institutions and training hospitals in Turkey may consider interventions to ease both intra-national and international collaborations between researchers focusing on psychiatry. Also, Turkish journals publishing psychiatric research may consider using recent innovations such as social networking etc. to increase global awareness of research from Turkey.

 

REFERENCES

1. Porter R, Micale MS (1994) Introduction: reflections on psychiatry and its histories. In: Micale M, Porter R (eds) Discovering the history of psychiatry. Oxford University Press, New York, pp 3-38

2. Metzger N. Battling demons with medical authority: werewolves, physicians and rationalization. Hist Psychiatry 2013;24(3):341-355. doi: 10.1177/0957154X13482835

3. Westerink H. Demonic possession and the historical construction of melancholy and hysteria. Hist Psychiatry 2014;25(3):335-349. doi: 10.1177/0957154X14530818

4. Zhang J, Chen X, Gao X, Yang H, Zhen Z, Li Q, Lin Y, Zhao X. Worldwide research productivity in the field of psychiatry. Int J Ment Health Syst 2017;11:20. doi: 10.1186/s13033-017-0127-5

5. Ware M, Mabe M (2015) The STM report: An overview of scientific and scholarly journal publishing.

6. Patel V, Sumathipala A. International representation in psychiatric literature: survey of six leading journals. Br J Psychiatry 2001;178:406-409. doi: 10.1192/bjp.178.5.406

7. Saxena S, Paraje G, Sharan P, Karam G, Sadana R. The 10/90 divide in mental health research: trends over a 10-year period. Br J Psychiatry 2006;188:81-82. doi: 10.1192/bjp.bp.105.011221

8. Moghadami M, Hassanzadeh M, Shokreian S. A Bibliometric Study of Scientific Literature of Psychiatry in Scopus. Depiction of Health 2019;6(4):56-66

9. Pritchard A. Statistical bibliography or bibliometrics. Journal of documentation 1969;25(4):348-349

10. Lariviere V, Grant J. Bibliometric Analysis of Mental Health Research: 1980–2008. Rand Health Q 2017;6(2):12. doi: 10.1016/j.euroneuro.2013.01.006

11. Ellegaard O, Wallin JA. The bibliometric analysis of scholarly production: How great is the impact? Scientometrics 2015;105(3):1809-1831. doi: 10.1007/s11192-015-1645-z

12. Adanır SS, Bahşi İ, Kervancıoğlu P, Orhan M, Cihan ÖF. Bibliometric analysis of articles published in Anatomy, the official publication of the Turkish Society of Anatomy and Clinical Anatomy between 2007–2018. Anatomy 2020;14(1):39-43. doi: 10.2399/ana.20.019

13. Kocak M, García-Zorita C, Marugán-Lázaro S, Çakır MP, Sanz-Casado E. Mapping and clustering analysis on neuroscience literature in Turkey: a bibliometric analysis from 2000 to 2017. Scientometrics 2019;121(3):1339-1366. doi: 10.1007/s11192-019-03259-w

14. Önder Ç, Sevkli M, Altinok T, Tavukçuoǧlu C. Institutional change and scientific research: A preliminary bibliometric analysis of institutional influences on Turkey’s recent social science publications. Scientometrics 2008;76(3):543-560. doi: 10.1007/s11192-007-1878-6

15. Altalib HH, Elzamzamy K, Fattah M, Ali SS, Awaad R. Mapping global Muslim mental health research: analysis of trends in the English literature from 2000 to 2015. Glob Ment Health (Camb) 2019;6:e6. doi: 10.1017/gmh.2019.3

16. Arik E. A bibliometric analysis of a national Journal: The case of the Turkish Journal of Psychology. J Scientometric Res 2013;2(3):173-184. doi: 10.4103/2320-0057.135407

17. van Eck NJ, Waltman L. Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics 2010;84(2):523-538. doi: 10.1007/s11192-009-0146-3

18. Ağargün MY, Kara H, Solmaz M. Sleep disturbances and suicidal behavior in patients with major depression. J Clin Psychiatry 1997;58(6):249-251. doi: 10.4088/jcp.v58n0602

19. Agelink MW, Boz C, Ullrich H, Andrich J. Relationship between major depression and heart rate variability. Clinical consequences and implications for antidepressive treatment. Psychiatry Res 2002;113(1-2):139-149. doi: 10.1016/s0165-1781(02)00225-1

20. Akyol O, Herken H, Uz E, Fadillioğlu E, Unal S, Söğüt S, Ozyurt H, Savaş HA. The indices of endogenous oxidative and antioxidative processes in plasma from schizophrenic patients. The possible role of oxidant/antioxidant imbalance. Prog Neuropsychopharmacol Biol Psychiatry 2020;26(5):995-1005. doi: 10.1016/s0278-5846(02)00220-8

21. Aydemir C, Yalcin ES, Aksaray S, Kisa C, Yildirim SG, Uzbay T, Goka E. Brain-derived neurotrophic factor (BDNF) changes in the serum of depressed women. Prog Neuropsychopharmacol Biol Psychiatry 2006;30(7):1256-1260. doi: 10.1016/j.pnpbp.2006.03.025

22. Aydemir O, Deveci A, Taneli F. The effect of chronic antidepressant treatment on serum brain-derived neurotrophic factor levels in depressed patients: a preliminary study. Prog Neuropsychopharmacol Biol Psychiatry 2005;29(2):261-265. doi: 10.1016/j.pnpbp.2004.11.009

23. Bilici M, Efe H, Koroglu MA, Uydu HA, Bekaroglu M, Deger O. Antioxidative enzyme activities and lipid peroxidation in major depression: alterations by antidepressant treatments. J Affect Disord 2001;64(1):43-51. doi: 10.1016/s0165-0327(00)00199-3

24. Bora E, Eryavuz A, Kayahan B, Sungu G, Veznedaroglu B. Social functioning, theory of mind and neurocognition in outpatients with schizophrenia; mental state decoding may be a better predictor of social functioning than mental state reasoning. Psychiatry Res 2006;145(2-3):95-103. doi: 10.1016/j.psychres.2005.11.003

25. Bora E, Vahip S, Gonul AS, Akdeniz F, Alkan M, Ogut M, Eryavuz A. Evidence for theory of mind deficits in euthymic patients with bipolar disorder. Acta Psychiatr Scand 2005;112(2):110-116. doi: 10.1111/j.1600-0447.2005.00570.x

26. Bourne C, Aydemir Ö, Balanzá-Martínez V, Bora E, Brissos S, Cavanagh JT, Clark L, Cubukcuoglu Z, Dias VV, Dittmann S, Ferrier IN, Fleck DE, Frangou S, Gallagher P, Jones L, Kieseppä T, Martínez-Aran A, Melle I, Moore PB, Mur M, Pfennig A, Raust A, Senturk V, Simonsen C, Smith DJ, Bio DS, Soeiro-de-Souza MG, Stoddart SD, Sundet K, Szöke A, Thompson JM, Torrent C, Zalla T, Craddock N, Andreassen OA, Leboyer M, Vieta E, Bauer M, Worhunsky PD, Tzagarakis C, Rogers RD, Geddes JR, Goodwin GM. Neuropsychological testing of cognitive impairment in euthymic bipolar disorder: an individual patient data meta-analysis. Acta Psychiatr Scand 2013;128(3):149-162. doi: 10.1111/acps.12133

27. Ching MS, Shen Y, Tan WH, Jeste SS, Morrow EM, Chen X, Mukaddes NM, Yoo SY, Hanson E, Hundley R, Austin C, Becker RE, Berry GT, Driscoll K, Engle EC, Friedman S, Gusella JF, Hisama FM, Irons MB, Lafiosca T, LeClair E, Miller DT, Neessen M, Picker JD, Rappaport L, Rooney CM, Sarco DP, Stoler JM, Walsh CA, Wolff RR, Zhang T, Nasir RH, Wu BL. Deletions of NRXN1 (neurexin-1) predispose to a wide spectrum of developmental disorders. Am J Med Genet B Neuropsychiatr Genet 2010;153b(4):937-947. doi: 10.1002/ajmg.b.31063

28. Demirci K, Akgönül M, Akpinar A. Relationship of smartphone use severity with sleep quality, depression, and anxiety in university students. J Behav Addict 2015;4(2):85-92. doi: 10.1556/2006.4.2015.010

29. Erol A, Karpyak VM. Sex and gender-related differences in alcohol use and its consequences: Contemporary knowledge and future research considerations. Drug Alcohol Depend 2015;156:1-13. doi: 10.1016/j.drugalcdep.2015.08.023

30. Gonul AS, Akdeniz F, Taneli F, Donat O, Eker C, Vahip S. Effect of treatment on serum brain-derived neurotrophic factor levels in depressed patients. Eur Arch Psychiatry Clin Neurosci 2005;255(6):381-386. doi: 10.1007/s00406-005-0578-6

31. Herken H, Uz E, Ozyurt H, Söğüt S, Virit O, Akyol O. Evidence that the activities of erythrocyte free radical scavenging enzymes and the products of lipid peroxidation are increased in different forms of schizophrenia. Mol Psychiatry 2001;6(1):66-73. doi: 10.1038/sj.mp.4000789

32. Howes OD, McCutcheon R, Agid O, de Bartolomeis A, van Beveren NJ, Birnbaum ML, Bloomfield MA, Bressan RA, Buchanan RW, Carpenter WT, Castle DJ, Citrome L, Daskalakis ZJ, Davidson M, Drake RJ, Dursun S, Ebdrup BH, Elkis H, Falkai P, Fleischacker WW, Gadelha A, Gaughran F, Glenthøj BY, Graff-Guerrero A, Hallak JE, Honer WG, Kennedy J, Kinon BJ, Lawrie SM, Lee J, Leweke FM, MacCabe JH, McNabb CB, Meltzer H, Möller HJ, Nakajima S, Pantelis C, Reis Marques T, Remington G, Rossell SL, Russell BR, Siu CO, Suzuki T, Sommer IE, Taylor D, Thomas N, Üçok A, Umbricht D, Walters JT, Kane J, Correll CU. Treatment-Resistant Schizophrenia: Treatment Response and Resistance in Psychosis (TRRIP) Working Group Consensus Guidelines on Diagnosis and Terminology. Am J Psychiatry 2017;174(3):216-229. doi: 10.1176/appi.ajp.2016.16050503

33. Monkul ES, Hatch JP, Nicoletti MA, Spence S, Brambilla P, Lacerda AL, Sassi RB, Mallinger AG, Keshavan MS, Soares JC. Fronto-limbic brain structures in suicidal and non-suicidal female patients with major depressive disorder. Mol Psychiatry 2007;12(4):360-366. doi: 10.1038/sj.mp.4001919

34. Pacchiarotti I, Bond DJ, Baldessarini RJ, Nolen WA, Grunze H, Licht RW, Post RM, Berk M, Goodwin GM, Sachs GS, Tondo L, Findling RL, Youngstrom EA, Tohen M, Undurraga J, Gonzalez-Pinto A, Goldberg JF, Yildiz A, Altshuler LL, Calabrese JR, Mitchell PB, Thase ME, Koukopoulos A, Colom F, Frye MA, Malhi GS, Fountoulakis KN, Vazquez G, Perlis RH, Ketter TA, Cassidy F, Akiskal H, Azorin JM, Valenti M, Mazzei DH, Lafer B, Kato T, Mazzarini L, Martinez-Aran A, Parker G, Souery D, Ozerdem A, McElroy SL, Girardi P, Bauer M, Yatham LN, Zarate CA, Nierenberg AA, Birmaher B, Kanba S, El-Mallakh RS, Serretti A, Rihmer Z, Young AH, Kotzalidis GD, MacQueen GM, Bowden CL, Ghaemi SN, Lopez-Jaramillo C, Rybakowski J, Ha K, Perugi G, Kasper S, Amsterdam JD, Hirschfeld RM, Kapczinski F, Vieta E. The International Society for Bipolar Disorders (ISBD) task force report on antidepressant use in bipolar disorders. Am J Psychiatry 2013;170(11):1249-1262. doi: 10.1176/appi.ajp.2013.13020185

35. Sarandol A, Sarandol E, Eker SS, Erdinc S, Vatansever E, Kirli S. Major depressive disorder is accompanied with oxidative stress: short-term antidepressant treatment does not alter oxidative-antioxidative systems. Hum Psychopharmacol 2007;22(2):67-73. doi: 10.1002/hup.829

36. Tuglu C, Kara SH, Caliyurt O, Vardar E, Abay E. Increased serum tumor necrosis factor-alpha levels and treatment response in major depressive disorder. Psychopharmacology (Berl) 2003;170(4):429-433. doi: 10.1007/s00213-003-1566-z

37. Ustün B, Compton W, Mager D, Babor T, Baiyewu O, Chatterji S, Cottler L, Göğüş A, Mavreas V, Peters L, Pull C, Saunders J, Smeets R, Stipec MR, Vrasti R, Hasin D, Room R, Van den Brink W, Regier D, Blaine J, Grant BF, Sartorius N. WHO Study on the reliability and validity of the alcohol and drug use disorder instruments: overview of methods and results. Drug Alcohol Depend 1997;47(3):161-169. doi: 10.1016/s0376-8716(97)00087-2

38. Weihl CC, Temiz P, Miller SE, Watts G, Smith C, Forman M, Hanson PI, Kimonis V, Pestronk A. TDP-43 accumulation in inclusion body myopathy muscle suggests a common pathogenic mechanism with frontotemporal dementia. J Neurol Neurosurg Psychiatry 2008;79(10):1186-1189. doi: 10.1136/jnnp.2007.131334

39. Yildiz A, Vieta E, Leucht S, Baldessarini RJ. Efficacy of antimanic treatments: meta-analysis of randomized, controlled trials. Neuropsychopharmacology 2011;36(2):375-389. doi: 10.1038/npp.2010.192

40. Yildiz-Yesiloglu A, Ankerst DP. Neurochemical alterations of the brain in bipolar disorder and their implications for pathophysiology: a systematic review of the in vivo proton magnetic resonance spectroscopy findings. Prog Neuropsychopharmacol Biol Psychiatry 2006;30(6):969-995. doi: 10.1016/j.pnpbp.2006.03.012

41. Yuksel C, Ongur D. Magnetic resonance spectroscopy studies of glutamate-related abnormalities in mood disorders. Biol Psychiatry 2010;68(9):785-794. doi: 10.1016/j.biopsych.2010.06.016

42. Zoroglu SS, Tuzun U, Sar V, Tutkun H, Savaçs HA, Ozturk M, Alyanak B, Kora ME. Suicide attempt and self-mutilation among Turkish high school students in relation with abuse, neglect and dissociation. Psychiatry Clin Neurosci 2003;57(1):119-126. doi: 10.1046/j.1440-1819.2003.01088.x

43. Bahsi I, Cetkin M, Orhan M. Anatomy of kidney: A comparative historical study. Eur J Ther 2016;22(2):66-71. doi: 10.5578/gmj.32152

44. Igoumenou A, Ebmeier K, Roberts N, Fazel S. Geographic trends of scientific output and citation practices in psychiatry. BMC Psychiatry 2014;14:332. doi: 10.1186/s12888-014-0332-6

45. Markovitz BP. Biomedicine’s electronic publishing paradigm shift: copyright policy and PubMed Central. J Am Med Inform Assoc 2000;7 3):222-229. doi: 10.1136/jamia.2000.0070222

46. Castro RC. [Impact of the Internet on communication flow of scientific health information]. Rev Saude Publica 2006;40 Spec no.:57-63. doi: 10.1590/s0034-89102006000400009

47. Gök E. The Turkish Higher Education System from the Kaleidoscope of Martin Trow. Education and Science 2016;41(184):147-168. doi: 10.15390/eb.2016.3193

48. Lariviere V, Diepeveen S, Ni Chonaill S, Macaluso B, Pollitt A, Grant J. International comparative performance of mental health research, 1980-2011. Eur Neuropsychopharmacol 2013;23(11):1340-1347. doi: 10.1016/j.euroneuro.2013.01.006

49. Aytac S. Scientific international collaboration of Turkey, Greece, Poland, and Portugal: A bibliometric analysis. Proceedings of the American Society for Information Science and Technology 2010;47(1):1-3. doi: 10.1002/meet.14504701305

50. Al U, Soydal İ, Taşkin Z, Düzyol G, Sezen U. Collaboration of Turkish Scholars: Local or Global? CJSIM 2012;6(1):145-159. doi: 10.1080/09737766.2012.10700930

51. Hafeez DM, Jalal S, Khosa F. Bibliometric analysis of manuscript characteristics that influence citations: A comparison of six major psychiatry journals. J Psychiatr Res 2019;108:90-94. doi: 10.1016/j.jpsychires.2018.07.010

52. Clement S, Singh SP, Burns T. Status of bipolar disorder research. Bibliometric study. Br J Psychiatry 2003;182:148-152. doi: 10.1192/bjp.182.2.148

53. Lopez-Munoz F, Vieta E, Rubio G, Garcia-Garcia P, Alamo C.) Bipolar disorder as an emerging pathology in the scientific literature: a bibliometric approach. J Affect Disord 2006;92(2-3):161-170. doi: 10.1016/j.jad.2006.02.006

54. Theander SS, Wetterberg L. Schizophrenia in Medline 1950-2006: a bibliometric investigation. Schizophr Res 2010;118(1-3):279-284. doi: 10.1016/j.schres.2009.05.013

55. Robinaugh DJ, Hoekstra RHA, Toner ER, Borsboom D. The network approach to psychopathology: a review of the literature 2008-2018 and an agenda for future research. Psychol Med 2020;50(3):353-366. doi: 10.1017/S0033291719003404