Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
RI2A – Towards a Responsible Institute Impact Assessment
University of Borås, Faculty of Librarianship, Information, Education and IT. University of Southern Denmark. (Knowledge Infrastructures)ORCID iD: 0000-0001-5196-7148
University of Southern Denmark.ORCID iD: 0000-0001-8235-0423
University of Southern Denmark.
2019 (English)In: 48th LIBER Annual Conference Research Libraries for Society, Trinity College Dublin, Ireland 26-28 June 2019, Dublin, 2019, p. 138-139Conference paper, Oral presentation with published abstract (Refereed)
Abstract [en]

Recently, there has been a shift in attitudes against improper use of metrics to evaluate research. In our effort to develop alternative approaches to identify relevant measurements for the impact of research at the institute level – beyond simple frequency counts and rankings based on single indicators – we decided to match the publications of a targeted institute to the Web of Science (WoS) database and with the use of machine learning techniques and visualization tools to explore and showcase our results respectively.

We present the Responsible Institute Impact Assessment (RI2A) for evaluating the research impact of a targeted institute with a case study. We used the 448 publications retrieved from the University of Southern Denmark’s (SDU) research registration database for the Department of Marketing and Management between 2012-2017. Of these, 170 publications satisfied the criteria of both being peer-reviewed and having a DOI to be matched in the WoS database. We then used the bibliographic coupling algorithm to cluster the articles that cited the work produced at the targeted institute. This algorithm groups data together based on the number of shared references between the identified units for analysis (article, source journal and institution level). Lastly, a co-word analysis was used to identify pair-wise relationships between keywords found in the citing articles.

A total of 1195 citing articles without self-citations where identified. The results of RI2A assist the targeted institute by allowing them to discover

  • the researchers who cite their publications and the relationships among them,
  • the journals that cite their publications and the relationships among them,
  • the universities, institutes and organizations that use their publications and the relationships among them, and
  • the main groups of keywords used in the citing articles.

Visualizing these results into graphs and making sense of them requires more work than simple publication/citation counts. Although not described in detail here, a collaboration between the SDU library and the university’s research support and policy services has started, where it has been proposed that evaluation should be based on joint work between evaluators and evaluatees focusing on strengths and weaknesses as well as timewise comparison of previous assessments. A straightforward mode would be to compare the results of the mapping exercise with an already known description of the evaluated department’s profile. For instance, by overlaying the targeted department’s research groups on the titles of the citing journals we discovered that the “Strategic Organisation Design” group is referenced a lot in “Organisation Studies”, “Journal of Management Studies”, “Strategic Management Journal” and “Human Relations” journals and that these journals form a distinct cluster based on shared citing practices.

Our approach responds to the conditions of keeping the process relatively simple and short for use in the library setting, yet meaningful for a combined quantitative/qualitative evaluation for both management and faculty whose research is affected by the evaluation procedure. Apart from showcasing the academic impact of an institute, RI2A also provides an opportunity to explore remote connections that otherwise might go unnoticed.

Place, publisher, year, edition, pages
Dublin, 2019. p. 138-139
Keywords [en]
citation, impact, responsible, institutes
National Category
Information Studies
Research subject
Library and Information Science
Identifiers
URN: urn:nbn:se:hb:diva-21620DOI: 10.5281/zenodo.3260276OAI: oai:DiVA.org:hb-21620DiVA, id: diva2:1343424
Conference
48th LIBER Annual Conference Research Libraries for Society, Dublin, June 26-28, 2019
Available from: 2019-08-16 Created: 2019-08-16 Last updated: 2019-08-26Bibliographically approved

Open Access in DiVA

fulltext(45 kB)17 downloads
File information
File name FULLTEXT01.pdfFile size 45 kBChecksum
Type fulltextMimetype application/pdf

Other links

Publisher's full textConference programme

Authority records BETA

Nelhans, Gustaf

Search in DiVA

By author/editor
Nelhans, GustafVlachos, Evgenios
By organisation
Faculty of Librarianship, Information, Education and IT
Information Studies

Search outside of DiVA

GoogleGoogle Scholar
Total: 17 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 44 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf