Hakan Mehmetcik
Marmara University
Hasan Hakses
Selçuk University
This article aims at evaluating three International Relations (IR) journals in
Turkey, namely, All Azimuth, Insight Turkey, and Uluslararası İlişkiler Dergisi.
The scholarly contributions of these three journals to Turkish IR is worthy of
exploration since together they constitute ‘the mainstream’ of Turkish IR journals.
To this end, this article applies a bibliometric analysis in surveying all three
journals' publication records in order to provide a general picture of the field in the
last decade. When we consider an evaluation of the Turkish IR community, these
three journals are also important and represent different sub-groups and interests
among Turkish IR scholars. The field orientations and organization of the IR
discipline in a given country may be understood by studying the leading journals
of the field in that country. With this assumption in mind, this paper attempts
to distinguish certain characteristic differences and similarities among these
three journals by surveying their materials and authorships using comparative
bibliometric analysis. While there are several articles in the literature that discuss
the contents of these publications, no comparative bibliometric analysis has ever
been conducted on them.
1. Introduction
The global higher education landscape has become more and more metric-driven. As a result of this shift, social scientists have grown more interested in journal publishing than they were previously, even while the longer method of authoring books continues to dominate Social Science research practices. However, books and book chapters garner less attention (e.g., citations) than journal articles [1]. Similar to the situation in many other scientific fields, there has been an explosion in the number of specialized journal titles in social sciences aimed at specific readerships as peer-reviewed journal publications have become by far the most prominent form of production. As a result, academic journals have become the principal routes through which scientific knowledge is generated and circulated, and hence reflect established patterns in their respective fields. Furthermore, because journals are selecting what will be published and thus what type of study will be socially and academically rewarded, they have an even broader impact on their field of interest [2]. Furthermore, the field orientations and structure of a discipline in a specific country may be understood by reviewing the publications in the top journals. Therefore, analyzing leading journals in a given scientific field offers extremely rich insights and patterns for evaluating the general/central tendencies in that specific subject.
Since they are field-specific journals, All Azimuth (AA), Insight Turkey (IT), and Uluslararası İlişkiler Dergisi (UI) are three important scientific journals for the study of Turkish IR. These three journals are the only Turkish IR journals indexed by the Web of Science (WoS),[3] which is generally seen as a positive indicator of a journal's quality. Therefore, we may refer to them as ‘the mainstream’ Turkish IR journals and assume that they have a broad impact on and role in any evaluation of Turkish IR studies. This paper analyzes the publication records of these three WoS-indexed journals by employing a comparative bibliometric study. The scholarship in these publications, as well as the themes, are investigated from a comparative perspective.
Considering the related literature, there are studies in IR in which the concepts and theories, regional studies, and field publications are bibliometrically analyzed. The increasing use of statistical programs is one factor that has led to the current surge in bibliometric studies. There also exist studies which are limited to the scope of databases and conducted in terms of bibliometrics on the basis of a given concept such as Regionalism [4], Globalization [5], and Gender[6].
In the same way, several bibliometric analyses exist on center-periphery relations [7], European IR [8], American IR [9], and Chinese and Russian IR [10]. However, relatively few studies on field journals exist [11]. To the best of our knowledge, several quantitative assessments of journal content have been conducted [12] and only one study [13] has tackled publication records for Turkish IR journals. However, there has never been a systematic bibliometric analysis performed by surveying the materials and authors of these Turkish IR journals. Taking this gap in the literature as our starting point, this study aims at analyzing three leading Turkish IR journals using comparative bibliometric analyses. The central aim of the article is to present a general snapshot of the field by surveying records from these three Turkish IR journals. To that end, the data and bibliometric techniques and methodologies used in this research are briefly outlined in the following material and method section. The primary findings are discussed in the next section on results and discussion, and in the conclusion part, there are some ideas on how we may generalize these findings in terms of assessing material and authors.
2. Material and Method
2.1. Material
This article uses bibliometric data from the WoS database, a platform often used for creating bibliometric data in the Arts, Humanities, and Social Sciences. However, several limitations and shortfalls in judging scientific quality and effect using WoS or equivalent database measures should be noted. Most importantly, using WoS or Scopus to evaluate research may induce biases because English-language journals are overrepresented [14]. Nonetheless, this database provides consistent and accessible data for bibliometric studies.
The WoS Core Collection is made up of multiple indexes that contain material obtained from various journals, books, and other sources. Two of these indexes are connected to research in the social sciences and humanities: 1) Social Sciences Citation Index (SSCI) and 2) Arts and Humanities Citation Index (AHCI). In addition to SSCI and AHCI, WoS also includes the Emerging Sources Citation Index (ESCI), which covers all disciplines. Dependency on data consistency and accuracy is an important feature of bibliometric studies, and with inconsistencies and errors being almost inevitable in databases, it is vital to select one that minimizes these. As a result, the WoS was selected by the authors of this study not only because AHCI, SSCI, or ESCI indexation was an essential factor, but also because the WoS is less prone to error while also being a widely available data source for any bibliometric study.
AA is an ESCI-indexed journal published by the Center for Foreign Policy and Peace Research at Bilkent University.[15] IT is again an ESCI-indexed journal published by the SETA Foundation for Political, Economic, and Social Research.[16] UI is an SSCI-indexed journal published by the International Relations Council of Turkey (IRCT).[17] Even though these three journals are published by Foundations, they are closely affiliated with Sakarya University (IT), Kadir Has University (UI), and Bilkent University (AA). Thus, these journals together cover a broad range of topics related to Turkish domestic and foreign policy issues, and global affairs in general, and are not only Turkish IR’s principal intellectual center, but also a hub for various sub-groups and communities among Turkish IR scholars and the scholars interested in Turkey’s international relations.
In brief, a dataset of 1,155 documents were retrieved from the WoS database, all published by these three Turkish IR journals between 2010 and 2021. Several editorial materials were removed from the dataset. When irrelevant or missing contents and duplications were deleted, 969 papers remained, consisting of 596 original research articles, 342 book reviews, and 31 review articles.[18] The data consists of 948 authors, each with 1.02 documents. The three journals combined had an average annual publication number of 80.3, which is a substantial scientific production within the field of Turkish IR.
Even though these journals had publications prior to 2015 or 2010, we only included those that were available via WoS search on December 25th, 2021. It should also be noted that WoS does not instantly index online-first articles. That is, any online-first publications that had not yet been assigned to a volume and issue of the journal at the time of the search were not included in the data. WoS statistics also do not contain pre-indexed articles that were published by journals prior to WoS indexation. We did not set aside any time for certain journals but instead gathered all of the data accessible in the WoS database in order to acquire as much data as possible and to give a general picture of the field in the last decade.
The figure above summarizes key details of the raw publication records for each journal. Even though the top and bottom parts of the figure visualize the same data in different forms, the difference is important. The line graph at the bottom better reveals the time span, showing that UI has had the longest time span in the WoS database. Both AA and IT only extend back to 2015 in the WoS database. However, the top graph better represents total publication counts, showing that IT, despite entering the WoS database at a later date, has had more publications than the earlier-indexed UI cumulatively. This quantifies the numbers of articles; it only makes sense when the emphasis is put on the publication numbers. UI has published 382 articles over a ten-year period, while AA and IT published 90 and 492 respectively over a five-year period. These numbers constitute average publication counts of 15, 82, and 34.7 for AA, IT, and UI respectively. This great difference in average publications seems interesting, but it must be noted that UI and IT are quarterly journals—apart from some special issues—while AA is a biannual journal.
As for the language of the publications, most are in English. The primary Turkish language publication was UI, but it, too, has made English its primary language. From the data, we can see that all of AA’s and IT’s publications—90 and 492 respectively—are in English, while 156 of UI’s publications (41% of the total papers) are in English. English, then, is the primary language for Turkish IR publications, which is not surprising given the predominance of English as a global lingua franca in the field of IR.
2.2. Method
Statistical classifications and analyses of publication content in a field are known as bibliometric studies. E. Wyndham Hulme coined the phrase ‘Statistical Bibliography’ in 1923 [19], while Pritchard and Gross coined the term ‘bibliometrics’ to make it more understandable [20]. Bibliometric techniques are now widely used and considered an important part of research-evaluation methodology. Bibliometric methods are increasingly being used in the study of various aspects of science, in the way institutions and universities are assessed internationally, and in journal and author rankings. [21].
Bibliometrics is, in essence, the measurement of scientific indices such as citation, publication, authorship, and so on. The bibliometric analysis method allows for a thorough examination of journal articles, concepts, study topics, and databases. Thus, it allows for the disclosure of which subjects studies focus on regularly, who the most productive authors are, and whose studies are cited most in a given field. Bibliometric studies use a set of indexes to quantitatively evaluate the literature as well. The evolution of the literature can be examined using factors such as the most commonly used keywords in articles, the most cited publications, and co-author network analysis [22]. As such, bibliometric analysis goes beyond identifying the corpus of literature within a certain subject area [23]. One of the primary goals of journal bibliometrics is actually to give information to editorial boards and authors to help them make better decisions during the publication process. However, evaluating specific publications—Turkish IR journals in our situation—serves to further investigate the field's development and evaluation, and to present an overview of the field.
Bibliometrics can also be used to evaluate the significance of a certain article for a specific topic, taking into consideration the citations referenced in any of a sequence of papers [24]. The majority of the quantitative field entries in this method are based on existing papers in scientific databases that have been indexed. It is possible to evaluate the evolution of any scientific literature by restricting it to a set period of time and by depending on a number of characteristics such as the most frequently used keywords, the most cited articles, author relationships, author nation, and author institution [25].
In brief, bibliometric analysis is known as the statistical classification and assessment of contents of bibliometric data. Bibliometric studies allow for a quantitative assessment of literature using a variety of indexes, which may be used to determine if studies in certain fields present common features [26]. Although bibliometrics is most commonly associated with counting scientific output and assessing its quality and influence, it may also be used to visualize and analyze intellectual, conceptual, and social structures, as well as their development and discipline-specific characteristics [27]. In this sense, bibliometrics tries to characterize the structure and evolution of certain disciplines, scientific areas, or research topics. A bibliometric study can be used to determine general productivity in a specific field, but it can also be used to assess the productivity of individual researchers, journals, nations, or any other level of performance. The goal of our research is to look at the productivity of three Turkish IR journals and the unique bibliometric features of their articles. To put it another way, the goal of this research is to map out these Turkish IR journals using various bibliometric methodologies.
Most of the techniques employed here are among common practices of bibliometric studies. On the technical level, this study used the R statistical computing environment[28] and R-bibliometrix package for the analysis.[29] This research also used a multi-pronged strategy in making code and data accessible, making the complete analysis public, archiving the computational environment, and making the code usable for a broad audience. To this end, all the coding, data, and results are provided in the GitHub Repository in order to encourage transparent and reproducible social science practices.[30] Reproducible scientific procedures and best practices are the only things that will increase research efficiency and the robustness of scientific discoveries [31].
3. Result and Discussion
3.1. Authors
The data shows that 946 authors published 964 articles, from which we can easily infer that most of the articles are single-authored productions. Indeed, 791 of the 964 articles are single-authored, and co-authors per document are 1.22 while the collaboration index is 1.68. The formula derived from Total Authors of Multi-Authored Articles/Total Multi-Authored Articles is used to compute the Collaboration Index (CI).[32] For the individual journals, single-authored documents are 71,436, and 284 units for AA, TI, and UI respectively.
Documents per Author for individual journals are 0.865, 1.04, and 0.895, yielding a collaboration index of 1.89, 1.89, and 1.78 for AA, TI, and UI, respectively. With such a small collaboration index, it would be fair to say that single authorship is by far the most common form of authorship for these three journals. The humanities and social sciences, and particularly IR, have seen a major surge in co-authorship (Sigelman 2009) as the rising frequency of collaborative research and multi-authored publications has become a standard practice in several disciplines including social sciences. Collaborative research has even become a functional prerequisite for current scientific exploration, to varied degrees [33]. We see that this trend is not reflected in Turkish IR journals. The table below summarizes the data in terms of authorship and frequency of different numbers of authorship in the articles published by these three journals. Table 1 above is an authorship frequency table in which we can see how many papers are authored by how many authors, along with a cumulative frequency. These kinds of contingency tables are more informative than the raw numbers since it is much easier to see that works with 3 or more authors are indeed rare for these journals. Table 1 above also provides a collaboration index of the level of collaborative practices across these journals. As stated above, it is clear that most of the published articles here are single-author documents yielding small collaboration scores.
We may also calculate an author dominance ranking index,[34] or in other words, metrics on the frequency of first authorships if a document has more than one author. We have listed the first eight authors with a dominance factor of 1, indicating that she/he is the first author in all of their multi-authored publications. Merging this information, it would be fair to claim that social science investigation as a collaborative effort has not been greatly adopted by Turkish IR scholars, who would appear to favor the lone-wolf research approach. Furthermore, collaborative works are generally driven by dominant authorship practices and collaboration patterns. Both collaborative and ‘lone wolf’ approaches create advantages and disadvantages for scholars, yet this issue is mostly perceived as a common drawback in the creation of a community of Turkish IR scholars[35].
In terms of productivity, the fifteen most productive authors are listed in Figure 2, which, in conjunction with Table 2 on dominance ranking, shows that dominant authors correspond to a great extent with most productive authors.
From Figure 3 above, showing the ‘Most Productive Countries,’ we see that the great majority of authors publishing in these three Turkish IR journals are from Turkey, and a more detailed inquiry would reveal that those authors in other countries are also originally from Turkey. One of the most important insights on authors and their collaboration may be gained by looking at their affiliations and overall publication patterns. It is unsurprising that the authors publishing in these three IR journals are from Turkey. We know that the country of publication has a high propensity to influence authorship, which is hardly an odd situation given that British publications are predominantly produced by British scholars, and that American journals include more American authors than they do authors from any other nation [36].
However, when we look at our authors’ respective affiliations from Figure 4 above, we see that the most frequent affiliations are as follows: Sakarya University, Kadirhas University, and Bilkent University. This finding might be problematic because it may indicate journalistic clientelism and/or favoritism, by which some authors and affiliations enjoy more expedited peer reviews. However, a deeper examination of the publishing formats and editorial materials reveals that the ratio of founding university affiliation on balance cannot be attributed to favoritism.
Table 3 above displays the publication history of the three journals for the past three years, along with the corresponding affiliations. According to the data, scholars affiliated with Bilkent, Sakarya, and Kadirhas Universities account for 8, 4, and 8% of total publications in AA, IT, and UI, respectively (what we called self-affiliation). Because of their high unique affiliation numbers (69, 52, and 59 for AA, IT, and UI, respectively) and low self-affiliations, we can easily rule out favoritism concerns in their editorial processes.
3.2. Papers
The statistics show that these three Turkish IR journals grew by approximately 13.34% every year, and it is worth noting that in doing so, they have helped to broaden the SSCI coverage of Turkish IR.
Figure 5 shows that two metrics useful for estimating the yearly impact of the journals are the average number of citations each year—the sum of all citations divided by the number of years—and the average number of citations per article—the sum of citations per article divided by the number of years, along with Annual Scientific Production. An intriguing finding here is that while yearly scientific production for all journals is rising, the average citation number per year is not doing the same. Furthermore, the average total citations per article have diminished considerably. That is, these publications are producing ever more scientific papers, yet their individual impacts are declining, and the overall scientific impacts of the journals are stagnating.
These findings (in Figure 5 above) are important in determining Journal Impact Factors,[37] a metric often used to draw comparisons among academic journals, the results of which in turn often serve as a proxy for journal quality. According to Table 4 below, AA and IT have Journal Citation Indicator (JCI), which is a normalized citation impact of 0.52 and 0.15, respectively. UI has a 0.33 impact factor and 0.15 JCI. Given that the 1.94 median impact factor for International Relations has increased almost half a percentage point in 2020 from 1.261 in 2019, the diminishing average total citations and overall impact of the three journals is contrary to the general trends in Political Science and International Relations journals.
Journals are often grouped in a distinct and well-known hierarchy, and while this is an insufficient proxy for output quality, it remains the most important predictor of a journal’s relative status in the given discipline. In this sense, citation scores are another important metric when it comes to comparing journals to each other. The impact factor (IF) and JCI as a normalized IF score are directly related to citation scores and are often referred to as important indicators of a journal’s quality in the given field. This comparison exercise can be extended by including several metrics from the 2020 Web of Science Journal Citation Report (JCR).[38] Table 4 is presented for this purpose. 2020 was chosen because in that year, all three of the journals examined here are included in the report. Several citation indexes along with the Web of Science Journal Impact Factor are all included in the JCR. Some of these indicators are shown in Figure 9 above. The Eigenfactor Score computes a network score based on a 5-year citation network density, with highly cited sources having a bigger impact on the network than sources with fewer citations. The normalized Eigenfactor multiplied by the total size of the cited journal over the last 5 years yields the Article Influence Score. A score greater than 1.00 indicates that the citation effect is higher than the average. Another normalized score produced from citable materials and their average citations is the Journal Citation Indicator (JCI). These measures combine to form the Journal Citation Indicator, which is the primary indicator used to rank journals. We can observe that AA is performing better than the other two Turkish IR journals, attaining a higher quartile ranking based on its impact factor (IF) and citations.
Similarly, we can compare three journals on these metrics. The following figures are presented for this purpose. Figures 6 and 7 illustrate that increasing annual publication has not translated into an increasing rate of average citation score for any of the journals.
Author-level metrics are citation metrics that evaluate an individual author's bibliometric influence. The H-index is the most frequently-used measure at the author level, and H-Index ratings are also assigned to journals. The number of a journal’s published papers that have received more than a specific number of citations is referred to as the ‘journal h-index.’ For example, a journal with an h-index of 8 has published 8 papers, each of which has garnered at least 8 citations. The G-index gives highly cited articles more weight, while the M-Index is the H-index divided by the number of years. Publishing in a journal with high H-G-M indexes increases the chances of being cited by other authors. Table 5 below shows the H-G-M indexes for these three Turkish IR journals and reveals that all are relatively similar in terms of these indexes. In a similar way, in terms of total citation number, every publication in AA, IT, and UI produced 2.45, 2.13, and 2.3 citations, respectively.
We have calculated local citations, which measure how many times an author (or a document) included in a collection has been cited by other documents in the collection. This is an interesting piece of information because it shows whether or not cross-referencing exists among different issues of these publications. The result shows that very few articles are actually read and cited by authors newly contributing to these journals. In the figure below, local citation counts (LCC) are given at the top of the bar under the global citation counts (GCC). For example, KHOSRAVINIK M, 2017, the top paper in terms of global citation with a score of 16, received 0 local citations. This data reveals that if Turkish IR journals are cited, it is not by Turkish IR scholars publishing in these journals, but by others elsewhere.
3.3. Networks
Manuscripts’ attributes are connected to each other through the manuscript itself with several linkages via author(s) journal, keywords, publication date, etc. These connections of different attributes generate bipartite networks. The scientific collaboration network, university collaboration network, networks of scientific papers (i.e., citation network, bibliographic coupling network, co-citation network), and keywords network are constructed to reveal relationships between/among authors, affiliations, papers and keywords, respectively [39]. By using these linkages, network analysis reveals important insights on how academics cite and are cited, as well as patterns of collaboration between authors, institutions, and nations.
First among networks that can be extracted from a bibliometric analysis is the co-citation network among authors and articles. Reference Co-citations Networks, one type of citation network that can be drawn from bibliometric data, aims to show a network of references that have been co-cited by the selected publications. Co-citation analysis is a useful method for mapping scientific research subject-matter or topic clustering since changes in research topics would return comparable reference citations. That is, even if not all references for a certain area are identical, there will be meaningful overlaps and similarities among the cited references.
The figure above depicts paper co-citation networks on the left and source co-citation networks on the right. The term ‘most cited papers’ refers to papers referenced in articles published by these three Turkish IR journals, whilst ‘sources’ refers to the most cited sources. When we speak of an author network, as shown in Figure 9 above, we are referring to scholars whose papers are cited in the publications published in these Turkish IR journals. All the citation network figures reveal three intriguing sub-areas emerging from the networks of publications by these three journals. We can elaborate even more on the topics covered by the publication taking these individual papers, sources, and authors. However, there are other, better tools to make such inferences, among which are co-occurrences networks, widely used tools in order to evaluate topics in bibliometric data.
To further evaluate the content of the articles published by these three journals, we look at the bibliographic co-occurrences’ networks for keywords, abstracts, and titles. A co-occurrence network is a metric that establishes co-occurrence links between documents. If two papers used the same keywords, or themes in their title or abstract, or one or more documents in common, they are bibliographically connected. Among these, keywords co-occurrences are particularly noteworthy.
We have performed abstract and keywords co-occurrences network analysis and plotted theme detection results on a bi-dimensional map. The premise is that the more terms that are used in the abstracts and keywords by different articles, the more similar they are in terms of topic.
On the left of Figure 11, we see co-occurrences in keywords, and on the right, co-occurrences in abstracts. The data shows three general themes that appeared in the publications corresponding to the co-citation network plots. Among them, as the authors’ keywords and abstract co-occurrences reveal, are Turkey, Turkish Foreign Policy, and related issues in terms of their common theme. When we read bibliographic co-citation networks with co-occurrence networks, along with degree centralities, we may argue that many of the articles published in these three journals are not closely connected in terms of citations.
We have also created a conceptual structure map of a scientific field, performing Coupled Clusters Analysis (CC) of a bipartite network of terms extracted from keywords, which provides further analysis of the common theme(s) in the publications of these three journals. Both the topic dendrograms and factorial analysis (highest contributing and most-cited documents) show a very similar pattern: 3-4 topic clusters. The calculated clusters are depicted in Figure 12 above. Here, cluster coupling is measured by keywords, impact is measured by global citation scores, and cluster labeling is also done with keywords. We have 7 clusters, with Turkey-Foreign Policy and Eastern Mediterranean having the greatest degree of centrality and global citation impacts. That is, the articles in these clusters are the most impactful articles published by these three Turkish IR journals. The Security-NATO-Iran cluster has the lowest degree of centrality and impact, and leads the least impactful articles in these clusters. Hence, one practical outcome might be that if one is publishing an article in these journals, it would be better to do so on a topic that can be clustered in Turkey-Foreign Policy and Eastern Mediterranean. However, having seven closely-related clusters is a very suggestive finding as it shows that these journals have delved into only a few broader themes/clusters. This is also verified by the topic dendrograms, which is a clustering and mapping scheme for bibliometric analysis. The topic dendrogram in Figure 13 shows that there are two broad topics and several sub-topics emerging in the papers published in these three IR journals.
The figure below provides yearly trend topics based on field tags. Here we see that the dominating themes in the articles published by these three journals change over time. The trend topics also correspond to the finding we presented in the clusters by coupling.
The same experiment may be done with article titles, the results of which are shown in the following figure, in which we see the most frequently used bigrams in the titles of the papers published by our three journals.
Another way to investigate these shifts in theme is to sketch out the changes in keywords used. The first ten keywords and their growth over the years is provided in the figure below. We see that Turkey and Turkish Foreign Policy are among the top authors’ keywords.
Another way to evaluate theme is to provide a contrasting cluster map, which is presented below. In this figure, we have used Key Words Plus, which is based on a specific algorithm exclusive to Clarivate Analytics databases. The words or phrases in Key Words Plus are words or phrases that regularly appear in the titles of an article's references, but not in the article's title itself.[40] The figure shows a thematic evaluation between 2010–2015 and 2016–2021 (five-year periods).
One of the best ways to look at the changes in the thematic evaluation in bibliometric data is to look at three-block plots. We have created such a three-block plot for fields, sources, authors, keywords, and how they are related through a Sankey diagram.
4. Conclusion
By finding trends in modern Turkish IR research, in terms of both material and authors, this study set out to provide systematic documentation of the breadth of scholarship as well as the diversity of authorship of articles published in the field’s leading Turkish IR publications. To this end, we conducted a bibliographic analysis on data retrieved from the WoS database. The data comprises three journals, All Azimuth, Insight Turkey, and Uluslararası İlişkiler Dergisi, and ranges between 2010 and 2021. The materials included in our analysis are representative of the topic of interest because they are all top-tier Turkish IR journals. All the bibliometric indicators were carefully selected based on the study’s objective.
The outcomes of bibliometric studies are quantitative and qualitative. They may also provide assessments of relationships between researchers and study topics through statistical analysis of co-publications and citations. Our findings concerning the three selected journals indicate the following:
The dominant form of authorship is single-authored papers. This may be seen as concerning, indicating as it does that collaboration practices have as yet failed to take root in the Turkish IR community. As the humanities and social sciences worldwide, and particularly IR, are witnessing a major surge in co-authorship, such a lone-wolf attitude among Turkish IR scholars is not a healthy development for the Turkish IR community. We believe this could be addressed through various socialization practices. Another important takeaway from the data is that authorship patterns call for more transparency by these three Turkish IR journals in their peer-review processes. However, we can readily rule out favoritism concerns in their editorial processes due to their high unique affiliation numbers (69, 52, and 59 for AA, IT, and UI, respectively) and low self-affiliations as a percentage of the overall publication counts.
In terms of publication counts, there is a general upward trend, implying that these three publications have been contributing to a broadening of AHCI, SSCI, and ESCI coverage of Turkish IR. However, even as yearly scientific productivity for all journals is increasing, the average citation per year is not. That is, while these publications are producing an increasing number of scientific works, their individual impacts are decreasing, and their aggregate scientific impact remains unchanged. Diminishing average total citations and overall impact contrasts starkly with the general trends in Political Science and International Relations journals. Furthermore, there is very little (almost none) cross-referencing among various issues of these publications, implying that relatively few papers are actually read and cited by the new authors contributing to these journals. According to the statistics, when Turkish IR publications are cited, they are cited abroad rather than by Turkish IR scholars who produce scientific papers in these journals. That is an interesting finding suggesting that Turkish IR scholars follow the research outcomes of others in other countries but not their fellow countrymen. However, it should be noted that new publications provide a challenge for established bibliometric methodologies since citations build over time, even over years in some subjects. IR is such a subject for which citations take time. Given the fact that these journals are relatively young, they are expected to be better cited in the future. Yet, the gap between local and global citations, which is producing almost none in terms of local citations, should be addressed. Overall, we can suggest that Turkish IR researchers publish works in English for Turkish IR researchers, but they are not cited (or may not be read) by Turkish IR researchers.
According to the findings of co-citation and co-occurrence networks, Turkey, Turkish Foreign Policy, and Turkish politics appear most frequently in the publication of the three selected journals. Even though we may argue that many of the articles published in these three journals are not particularly linked in terms of citations, the topic dendrograms and factorial analysis show three or four topic clusters. Having closely connected clusters is a highly noteworthy finding since it illustrates that these journals collectively represent common themes/clusters in their field of interest. The topic clustering and thematic evaluations from keywords, abstracts, or titles reveal similar patterns. From this finding, it could be argued that the existing academic interests and contributions from Turkish IR have not constituted a new space for non-Western inferences. While American and European academics are in charge of generating concepts and theories in this system, others are responsible for creating case studies and testing theories in non-Western contexts, and Turkish IR in its current format is not an exception. The topical coverages and clusters, citation patterns, cited sources, and used keywords derived from the bibliographic data we used in this article clearly illustrate this notion. An analysis of books and book chapters written by Turkish IR scholars may serve as supplementary study in this area and could either confirm or dispute the conclusions we have presented here, but it would be worth looking into.
Andrés, Ana. Measuring Academic Research: How to Undertake a Bibliometric Study. Elsevier, 2009.
Aria, Massimo, and Corrado Cuccurullo. “Bibliometrix: An R-Tool for Comprehensive Science Mapping Analysis.” Journal of Informetrics 11, no. 4 (2017): 959–75.
Aydinli, Ersel, and Julie Mathews. “Are the Core and Periphery Irreconcilable? The Curious World of Publishing in Contemporary International Relations.” International Studies Perspectives 1, no. 3 (2000): 289–303. doi: 10.1111/1528-3577.00028.
Bilgin, Pınar. “Uluslararası İlişkiler çalışmalarında ‘merkez-çevre’: Türkiye nerede?” Uluslararası İlişkiler / International Relations 2, no. 6 (2005): 3–14.
Bilgin, Pinar, and Oktay F Tanrisever. “A Telling Story of IR in the Periphery: Telling Turkey about the World, Telling the World about Turkey.” Journal of International Relations and Development 12, no. 2 (2009): 174–79. doi: 10.1057/jird.2009.5.
Breuning, Marijke, Joseph Bredehoft, and Eugene Walton. “Promise and Performance: An Evaluation of Journals in International Relations.” International Studies Perspectives 6, no. 4 (2005): 447–61. doi: 10.1111/j.1528-3577.2005.00220.x.
Buela-Casal, Gualberto, Pandelis Perakakis, Michael Taylor, and Purificación Checa. “Measuring Internationality: Reflections and Perspectives on Academic Journals.” Scientometrics 67, no. 1 (2006): 45–65.
Çoki̇şler, Elvan. “Uluslararası İlişkiler dergisinin bibliyometrik analizi (2004-2017).” Uluslararası İlişkiler Dergisi 16, no. 64 (2019): 29–56. doi: 10.33458/uidergisi.652899.
Elango, B., and P. Rajendran. “Authorship Trends and Collaboration Pattern in the Marine Sciences Literature: A Scientometric Study.” International Journal of Information Dissemination and Technology 2, no. 3 (2012): 166.
Ellegaard, Ole, and Johan A. Wallin. “The Bibliometric Analysis of Scholarly Production: How Great Is the Impact?” Scientometrics 105, no. 3 (2015): 1809–31.
Gauthier, Élaine. “Bibliometric Analysis of Scientific and Technological Research: A User’s Guide to the Methodology.” Citeseer, 1998.
Goldmann, Kjell. “Im Westen Nichts Neues: Seven International Relations Journals in 1972 and 1992.” European Journal of International Relations 1, no. 2 (1995): 245–58.
Groos, Ole V., and Alan Pritchard. “Documentation Notes.” Journal of Documentation 25, no. 4 (1969): 344–49.
Huang, Mu-hsuan, and Yu-wei Chang. “Characteristics of Research Output in Social Sciences and Humanities: From a Research Evaluation Perspective.” Journal of the American Society for Information Science and Technology 59, no. 11 (2008): 1819–28.
Hulme, Edward Wyndham. “Statistical Bibliography in Relation to the Growth of Modern Civilization,” 1923.
Kilicoglu, Ozge, and Hakan Mehmetcik. “Science Mapping for Radiation Shielding Research.” Radiation Physics and Chemistry 189 (2021). doi: 10.1016/j.radphyschem.2021.109721.
King, Gary. “Ensuring the Data-Rich Future of the Social Sciences.” Science 331, no. 6018 (2011): 719–21.
———. “Restructuring the Social Sciences: Reflections from Harvard’s Institute for Quantitative Social Science.” PS: Political Science & Politics 47, no. 1 (2014): 165–72.
Kristensen, Peter Marcus. “Revisiting the ‘American Social Science’—Mapping the Geography of International Relations.” International Studies Perspectives 16, no. 3 (2015): 246–69. doi: 10.1111/insp.12061.
Kumar, Sudhir, and Surendra Kumar. “Collaboration in Research Productivity in Oil Seed Research Institutes of India.” In Proceedings of Fourth International Conference on Webometrics, Informetrics and Scientometrics, Vol. 28. Humboldt-Universitat zu Berlin, Institute for Library and Information …, 2008.
Kuru, Deniz. “Homegrown Theorizing: Knowledge, Scholars, Theory.” All Azimuth: A Journal of Foreign Policy and Peace 7, no. 1 (2017): 69–86. doi: 10.20991/allazimuth.321993.
Lawani, Stephen Majebi. “Bibliometrics: Its Theoretical Foundations, Methods and Applications.” Libri 31, no. Jahresband (1981): 294–315.
Liu, Xingjian, Song Hong, and Yaolin Liu. “A Bibliometric Analysis of 20 Years of Globalization Research: 1990–2009,” 2012. doi: 10.1080/14747731.2012.658256.
Mas-Verdu, Francisco, Jose-Maria Garcia-Alvarez-Coque, Paula Andrea Nieto-Aleman, and Norat Roig-Tierno. “A Systematic Mapping Review of European Political Science.” European Political Science 20, no. 1 (2021): 85–104. doi: 10.1057/s41304-021-00320-2.
Mehmetcik, Hakan, and Hasan Hakses. “Globalizing IR: Can Regionalism Offer a Path for Other Sub-Disciplines?” All Azimuth-A Journal of Foreign Policy and Peace 11, no. 1 (2022): 49–65.
Mitchell, Sara McLaughlin, Samantha Lange, and Holly Brus. “Gendered Citation Patterns in International Relations Journals1.” International Studies Perspectives 14, no. 4 (November 1, 2013): 485–92. doi:10.1111/insp.12026.
Munafò, Marcus R., Brian A. Nosek, Dorothy V. M. Bishop, Katherine S. Button, Christopher D. Chambers, Nathalie Percie du Sert, Uri Simonsohn, Eric-Jan Wagenmakers, Jennifer J. Ware, and John P. A. Ioannidis. “A Manifesto for Reproducible Science.” Nature Human Behaviour 1, no. 1 (2017): 1–9. doi:10.1038/s41562-016-0021.
Østby, Gudrun, Håvard Strand, Ragnhild Nordås, and Nils Petter Gleditsch. “Gender Gap or Gender Bias in Peace Research? Publication Patterns and Citation Rates for Journal of Peace Research, 1983–20081.” International Studies Perspectives 14, no. 4 (2013): 493–506. doi:10.1111/insp.12025.
Papageorgiou, Maria Mary, and Alena Vieira. “Mapping the Literature on China and Russia in IR and Area Studies: A Bibliometric Analysis (1990–2019).” Journal of Chinese Political Science, October 20, 2021. doi: 10.1007/s11366-021-09768-x.
Reale, Emanuela, Dragana Avramov, Kubra Canhial, Claire Donovan, Ramon Flecha, Poul Holm, Charles Larkin, et al. “A Review of Literature on Evaluating the Scientific, Social and Political Impact of Social Sciences and Humanities Research.” Research Evaluation 27, no. 4 (October 1, 2018): 298–308. doi:10.1093/reseval/rvx025.
Stallings, Jonathan, Eric Vance, Jiansheng Yang, Michael W. Vannier, Jimin Liang, Liaojun Pang, Liang Dai, Ivan Ye, and Ge Wang. “Determining Scientific Impact Using a Collaboration Index.” Proceedings of the National Academy of Sciences 110, no. 24 (June 11, 2013): 9680–85. doi:10.1073/pnas.1220184110.
Starbuck, William H. “How Much Better Are the Most-Prestigious Journals? The Statistics of Academic Publication.” Organization Science 16, no. 2 (2005): 180–200.
Wæver, Ole. “The Sociology of a Not So International Discipline: American and European Developments in International Relations.” International Organization 52, no. 4 (1998): 687–727. doi:10.1162/002081898550725.
Yang, Bo, and Jinhai Li. “Complex Network Analysis of Three-Way Decision Researches.” International Journal of Machine Learning and Cybernetics 11, no. 5 (2020): 973–87. doi: 10.1007/s13042-020-01082-x.