A bibliometric analysis of quality assurance in higher education institutions: Implications for assessing university's societal impact
In: Evaluation and program planning: an international journal, Band 99, S. 102319
ISSN: 1873-7870
220 Ergebnisse
Sortierung:
In: Evaluation and program planning: an international journal, Band 99, S. 102319
ISSN: 1873-7870
In: Proceedings of WIS 2008, S. 1-8
The purpose of this paper is to apply and evaluate the bibliometric method Bradfordizing for information retrieval (IR) experiments. Bradfordizing is used for generating core document sets for subject-specific questions and to reorder result sets from distributed searches. The method will be applied and tested in a controlled scenario of scientific literature databases from social and political sciences, economics, psychology and medical science (SOLIS, SoLit, USB Köln Opac, CSA Sociological Abstracts, World Affairs Online, Psyndex and Medline) and 164 standardized topics. An evaluation of the method and its effects is carried out in two laboratory-based information retrieval experiments (CLEF and KoMoHe) using a controlled document corpus and human relevance assessments. The results show that Bradfordizing is a very robust method for re-ranking the main document types (journal articles and monographs) in today's digital libraries (DL). The IR tests show that relevance distributions after re-ranking improve at a significant level if articles in the core are compared with articles in the succeeding zones. The items in the core are significantly more often assessed as relevant, than items in zone 2 (z2) or zone 3 (z3). The improvements between the zones are statistically significant based on the Wilcoxon signed-rank test and the paired T-Test. (author's abstract)
In: International journal of social ecology and sustainable development: IJSESD ; an official publication of the Information Resources Management Association, Band 14, Heft 1, S. 1-17
ISSN: 1947-8410
An increase is occurring year on year, especially from 2019, in publications related to education for sustainability development (ESD) in the field of tourism. The objective of this paper is to analyse how the concept of sustainability is present in education in this area. To this aim, this article carries out a bibliographic review of the existing scientific literature on the presence of sustainability in tourism training. As an empirical part of the work, a bibliometric review of the works published in the Scopus database on sustainability in tourism education is proposed. Through evaluation and relational methods, it is intended to know the reality of this trend in tourism education. The analysis carried out shows that publications related to ESD in the field of tourism started focusing on the environment to shift on economic and social issues with the passage of time, and that there is greater attention to EDS on university education.
In: HELIYON-D-23-06267
SSRN
In: Corporate social responsibility and environmental management, Band 30, Heft 1, S. 1-16
ISSN: 1535-3966
AbstractCorporate social responsibility (CSR) research in academia has been increasing over time, especially in recent years. Thus, the evaluation of relative research productivity is becoming increasingly relevant due to the current importance of this topic. The paper aims to investigate research productivity in the CSR field by performing a bibliometric analysis. An iterative search strategy was used to firstly identify productive CSR authors and then examine their productivity over a 5‐year period (2015–2020) using the SciVal tool by Elsevier. Drawing on the results from different bibliometric analyses, the study investigates quantitative and qualitative publication performance at the country (macro), institutional (meso) and individual (micro) levels. This study is the first bibliometric analysis on CSR that is not related to a specific journal and has a multi‐level nature by providing the groundwork in determining the knowledge structure of CSR.
In: Economica, Band 88, Heft 352, S. 1107-1129
ISSN: 1468-0335
This paper determines the assessment of publications submitted to the UK research evaluation carried out in 2014, the REF, which would have resulted if they had been assessed with the bibliometric algorithm used by the Italian evaluation agency, ANVUR, for its evaluation of the research of Italian universities. We find extremely high correlations between the two assessment approaches.
The aim of this paper is to offer a contribution to the analysis of the under-representation of women economists in academic positions in Italy, focusing on publications. In Italy women's proportion of PhDs in Economics and Statistics has increased from 39 to 52 per cent in the last decade. Despite this progressive feminization of doctoral degrees in economics, the share of women working as academic staff in departments of Economics at Italian universities is still low: women constitute 28.1% of academic economists in Italy; in particular, women account for 16% of full professors and 27% of associate professors (data for 2010). The much-debated reform of the Italian university system (so called 'Gelmini' reform) is stressing the importance of 'merit evaluation' for academics and consequently it is supporting the use of bibliometric indicators for the purposes of selection. In this context, we aim to assess whether the systematic differences between Italian men and women in terms of academic career in economics, can be explained by their productivity in the last ten years. In order to do so, we first study, from a gender perspective, how the profile of economists who have become full professors in the last decade has changed in terms of individual characteristics and scientific productivity. Then, we study gender differences in the scientific output of academic economists since 2001, in order to find out about differences between men and women and completethe picture of the gender gap in career for economists in the Italian University. ; info:eu-repo/semantics/published
BASE
In: The journal of business & industrial marketing, Band 37, Heft 5, S. 1091-1110
ISSN: 2052-1189
PurposeThis study aims to identify evolution and advancement in the field of business-to-business (B2B) loyalty knowledge area by analyzing its intellectual structure.Design/methodology/approachThe authors use bibliometric analysis for quantitative evaluation of scholarly studies published on B2B loyalty area over a period of 27 years (1993–2020). The authors analyze intellectual knowledge base of B2B loyalty area by looking into 263 studies with 14,028 references authored by 693 researchers.FindingsThe results provide a comprehensive review of B2B loyalty area by identifying its foundations, influential works and intellectual communication linkage between these works. Notably, the analysis reveals most cited studies, key authors, important keywords, intellectual turning points and emerging trends of research in the discipline.Research limitations/implicationsThis study creates a baseline for presenting precise and comprehensive insights into research themes in B2B loyalty area, and identifies progressive trends over a period. This study is also helpful for researchers in identifying future directions of research in the discipline.Originality/valueThis study reveals the intellectual structure of B2B loyalty area.
In: Evaluation journal of Australasia: EJA, Band 22, Heft 4, S. 254-281
ISSN: 2515-9372
This article explores the current evaluation education program opportunities in the Australian higher education market and identifies potential research areas to inform pathways for future investment. Findings from our initial scoping phase are provided as a prelude to future work required in this space. The overarching research question investigates whether there is an opportunity to deliver further evaluation education programs in Australian higher education. Emerging from this question are three objectives: (a) to determine the current landscape of Australian university evaluation education program offerings; (b) to gain an understanding of the evaluation education discourse articulated within six selected evaluation journals and (c) to consider whether evaluation is a viable and meaningful discipline within higher education programs. An action research approach was adopted commencing with a benchmarking activity of Australian university offerings, followed by a bibliometric analysis of six evaluation journals, and concluding with a rapid scan of the literature. The selected methodologies reveal a potential gap in the higher education market, with the literature identifying inconsistent and mismatched programs while emphasising the need to invest in evaluation education. This article seeks to stimulate debate about formal higher education qualifications in evaluation and highlights the importance of potential future curriculum structure that can offer evaluators value, utility and growth.
In: Environmental science and pollution research: ESPR, Band 29, Heft 28, S. 42168-42184
ISSN: 1614-7499
This paper presents an ongoing research project investigating the use of bibliometrics for research evaluation and resource allocation purposes, and to investigate the effects of these evaluation models on individual, organizational and political levels. A main focus has been on bibliometrics based evaluation practices. The use of bibliometrics for local resource allocation at Swedish universities was analyzed (Hammarfelt et.al, 2016; Hammarfelt & Åström, 2015), finding a great degree of variation both in how and where bibliometrics is used; and while the introduction of a bibliometrics based national model for resource allocation in Sweden in 2009 probably had an effect on the increasing use of bibliometrics in local allocation models, there are also great variation in terms of bibliometric indicators and allocation models being in use. But bibliometrics is not just being used in evaluation and resource allocation models at a systemic level. Another important part of the use of bibliometrics in research evaluation practices is how it is being used by academic scholars and scientists serving as external assessors of candidates for academic positions or of research funding proposals. This practice has been studied through analyses of application assessment reports in economics, history, and biomedical research at Swedish universities (Hammarfelt, forthcoming; Hammarfelt & Rushforth, in press). The other main focus of the project thus far has been on the underlying technologies, or the infrastructure of bibliometrics and research evaluation systems. A main aspect of the 'infrastructure' theme is the challenges of understanding complexities and interactions of different technical or auxiliary systems, and their role in evaluation processes. This has been investigated empirically in a minor study of the role of knowledge organization systems in bibliometric analysis and evaluation (Åström et.al, 2016). Another empirical study of infrastructures under development is a study of current research information systems (CRIS). From a theoretical perspective, a conceptual framework has been tentatively developed, describing infrastructures, not so much as specific technical systems, but as systems of relations between hardware, software and people (Åström, 2016). This was operationalized by defining: 'hardware' as databases, software for bibliometric analyses, and so on; 'software' as the evaluation systems, the bibliometric indicators, and the allocation models; and 'people' as the stakeholders involved in evaluation practices. The second aim of the project is to investigate effects of the use of bibliometric methods for research evaluation, on the research system, and on and the academic researchers. This can be seen from two different points of view. One is how academic researchers themselves use bibliometric methods when evaluating their peers assessing applications for research grants and academic positions. The other is effects along the lines of scholars and scientists changing for instance publication behavior to adjust to evaluation systems and resource allocation models. While the former point of view might be more contextually related to traditions within research fields, the other might be more related to local or national research policies. The interplay between these perspectives is of high theoretical interest for the project to develop further, but has to a certain extent been investigated within a master's thesis supervised within the project (Nästesjö, 2016); continued in a PhD-project, analyzing the relation between evaluation practices and academic socialization. The master's thesis, suggest that disciplinary differences, career stage, and academic age are important factors for understanding the relation between research evaluation systems and research practices, where there are potential conflicts between disciplinary norms and political practices, conflicts that affect the behavior of individual scholars, as well as disciplinary norms.
BASE
In: Kajian Malaysia: journal of malaysian studies, Band 40, Heft 2, S. 255-268
ISSN: 2180-4273
Kajian Malaysia, published by Penerbit Universiti Sains Malaysia, is an interdisciplinary journal which provides a forum for a broad range of social sciences and humanities research. This research note presents a bibliometric review of the articles published in the journal Kajian Malaysia between 2011 and 2020. The purpose of this research note is to evaluate publication patterns and the topic model of articles published in Kajian Malaysia. The bibliographical material applied in this study was retrieved from the Scopus database. This study bibliometrically examines 192 documents published in Kajian Malaysia from 2011 to 2020 to rank the most productive countries, institutions, authors, keywords, influential articles and the topic model. This research note assists researchers with an understanding of the development of Kajian Malaysia, provides an important reference for Kajian Malaysia's future trajectory as well as provides an effective method of analysis for the future evaluation of journals.
In: Valuation Studies, Band 9, Heft 1, S. 11-46
ISSN: 2001-5992
One could think that bibliometric measurement of academic performance has always been digital since the computer-assisted invention of the Science Citation Index. Yet, since the 2000s, the digitization of bibliometric infrastructure has accelerated at a rapid pace. Citation databases are indexing an increasing variety of publication types. Altmetric data aggregators are producing data on the reception of research outcomes. Machine-readable persistent identifiers are created to unambiguously identify researchers, research organizations, and research objects; and evaluative software tools and current research information systems are constantly enlarging their functionalities to make use of these data and extract meaning from them. In this article, we analyse how these developments in evaluative bibliometrics have contributed to an extension of indicator-based research evaluation towards data-driven research analytics. Drawing on empirical material from blogs and websites as well as from research and policy papers, we discuss how interoperability, scalability, and flexibility as material specificities of digital infrastructures generate new ways of data production and their assessment, which affect the possibilities of how academic performance can be understood and (e)valuated.
In: Business process management journal, Band 23, Heft 1, S. 71-86
ISSN: 1758-4116
Purpose
The purpose of this paper is to collect data and select a bibliographic portfolio (BP) of the literature on the performance evaluation of business process management (BPM) governance, in order to highlight studies aligned with business process governance, and with scientific recognition and its bibliometric parameters.
Design/methodology/approach
The research method is qualitative and the process of identification, selection, and analysis of the articles in the BP took place through evaluation and interpretation by the authors of this research. Regarding data collection, this research used primary data in the selection of the BP, and secondary data when the authors analyzed the articles.
Findings
The paper selects a set of 19 articles with scientific recognition and aligned with the research topic, which refers to the performance evaluation of BPM governance. This set is called the BP, and highlights and contains the most often present journals, articles, authors, and keywords found in the search performed by the authors.
Originality/value
This research uses thorough procedures for the selection process that differ from traditional procedures: the selection process is structured in a way that allows checking of each research stage; the research topic is fragmented into many areas of study and the search is carried out simultaneously in all these areas; and the researchers interact with the search process and as they expand their learning they adjust the search direction.
In: Evaluation review: a journal of applied social research, Band 24, Heft 1, S. 47-72
ISSN: 1552-3926
The author examines the role of mediators and moderators in the evaluation of programs for children. The terms are defined and examples of each are presented. Using bibliometric analysis, the author examines how evaluators use mediators and moderators in treatment studies in education, juvenile justice, health care, child protection, and mental health. The use of mediators and moderators is sporadic and vague at best. An agenda for improvement is outlined that includes greater use of program theory and intensive case studies to find out why researchers in prevention and health promotion incorporate mediators and moderators more effectively in their evaluations.