Change search
Link to record
Permanent link

Direct link
BETA
Publications (10 of 34) Show all publications
Eklund, J., Gunnarsson Lorenzen, D. & Nelhans, G. (2019). MESH classification of clinical guidelinesusing conceptual embeddings of references. In: Giuseppe Catalano, Cinzia Daraio, Martina Gregori, Henk F. Moed and Giancarlo Ruocco (Ed.), Proceedings of the 17th conference of the International society for scientometrics and informetrics, ISSI: with a Special STI Indicators Conference Track. Paper presented at 17th conference of the International society for scientometrics and informetrics, ISSI (pp. 859-864). , 2
Open this publication in new window or tab >>MESH classification of clinical guidelinesusing conceptual embeddings of references
2019 (English)In: Proceedings of the 17th conference of the International society for scientometrics and informetrics, ISSI: with a Special STI Indicators Conference Track / [ed] Giuseppe Catalano, Cinzia Daraio, Martina Gregori, Henk F. Moed and Giancarlo Ruocco, 2019, Vol. 2, p. 859-864Conference paper, Published paper (Refereed)
Abstract [en]

In this study, we investigate different strategies for assigning MeSH (Medical Subject Headings) terms to clinical guidelines using machine learning. Features based on words in titles and abstracts are investigated and compared to features based on topics assigned to references cited by the guidelines. Two of the feature engineering strategies utilize word embeddings produced by recent models based on in the distributional hypothesis, called word2vecand fastText. The evaluation results show that reference-based strategies tend to yield a higher recall and F1 scores for MeSH terms with a sufficient amount of training instances, whereas title and abstract based features yield a higher precision.

Keywords
MESH, clinical guidelines, machine learning, word embedding, word2vec, fasttext
National Category
Information Studies
Research subject
Library and Information Science
Identifiers
urn:nbn:se:hb:diva-22096 (URN)978-88-3381-118-5 (ISBN)
Conference
17th conference of the International society for scientometrics and informetrics, ISSI
Projects
Data for Impact
Funder
EU, Horizon 2020, 770531
Available from: 2019-11-22 Created: 2019-11-22 Last updated: 2019-12-06Bibliographically approved
Gunnarsson Lorenzen, D., Eklund, J., Nelhans, G. & Ekström, B. (2019). On the potential for detecting scientific issues and controversies on Twitter: A method for investigation conversations mentioning research. In: Proceedings of ISSI.: . Paper presented at ISSI, the 17th International Conference on Scientometrics & Informetrics, Rome, 2-5 September, 2019. (pp. 2189-2198). , Article ID 375.
Open this publication in new window or tab >>On the potential for detecting scientific issues and controversies on Twitter: A method for investigation conversations mentioning research
2019 (English)In: Proceedings of ISSI., 2019, p. 2189-2198, article id 375Conference paper, Published paper (Refereed)
Abstract [en]

In this study, we demonstrate how to collect Twitter conversations emanating from or referring to scientific papers. We propose segmenting the conversational threads into smaller segments and then compare them using information retrieval techniques, in order to find differences and similarities between discussions and within discussions. While the method still can be improved, the study shows that it is possible to collect larger conversations about research on Twitter, and that these are suitable for various automated methods. We do however identify a need to analyse these with qualitative methods as well.

Keywords
Twitter, conversations
National Category
Computer and Information Sciences
Research subject
Library and Information Science
Identifiers
urn:nbn:se:hb:diva-21908 (URN)
Conference
ISSI, the 17th International Conference on Scientometrics & Informetrics, Rome, 2-5 September, 2019.
Projects
Data4Impact
Available from: 2019-10-31 Created: 2019-10-31 Last updated: 2019-11-05Bibliographically approved
Nelhans, G., Vlachos, E. & Vignes, M. (2019). RI2A – Towards a Responsible Institute Impact Assessment. In: 48th LIBER Annual Conference Research Libraries for Society, Trinity College Dublin, Ireland 26-28 June 2019: . Paper presented at 48th LIBER Annual Conference Research Libraries for Society, Dublin, June 26-28, 2019 (pp. 138-139). Dublin
Open this publication in new window or tab >>RI2A – Towards a Responsible Institute Impact Assessment
2019 (English)In: 48th LIBER Annual Conference Research Libraries for Society, Trinity College Dublin, Ireland 26-28 June 2019, Dublin, 2019, p. 138-139Conference paper, Oral presentation with published abstract (Refereed)
Abstract [en]

Recently, there has been a shift in attitudes against improper use of metrics to evaluate research. In our effort to develop alternative approaches to identify relevant measurements for the impact of research at the institute level – beyond simple frequency counts and rankings based on single indicators – we decided to match the publications of a targeted institute to the Web of Science (WoS) database and with the use of machine learning techniques and visualization tools to explore and showcase our results respectively.

We present the Responsible Institute Impact Assessment (RI2A) for evaluating the research impact of a targeted institute with a case study. We used the 448 publications retrieved from the University of Southern Denmark’s (SDU) research registration database for the Department of Marketing and Management between 2012-2017. Of these, 170 publications satisfied the criteria of both being peer-reviewed and having a DOI to be matched in the WoS database. We then used the bibliographic coupling algorithm to cluster the articles that cited the work produced at the targeted institute. This algorithm groups data together based on the number of shared references between the identified units for analysis (article, source journal and institution level). Lastly, a co-word analysis was used to identify pair-wise relationships between keywords found in the citing articles.

A total of 1195 citing articles without self-citations where identified. The results of RI2A assist the targeted institute by allowing them to discover

  • the researchers who cite their publications and the relationships among them,
  • the journals that cite their publications and the relationships among them,
  • the universities, institutes and organizations that use their publications and the relationships among them, and
  • the main groups of keywords used in the citing articles.

Visualizing these results into graphs and making sense of them requires more work than simple publication/citation counts. Although not described in detail here, a collaboration between the SDU library and the university’s research support and policy services has started, where it has been proposed that evaluation should be based on joint work between evaluators and evaluatees focusing on strengths and weaknesses as well as timewise comparison of previous assessments. A straightforward mode would be to compare the results of the mapping exercise with an already known description of the evaluated department’s profile. For instance, by overlaying the targeted department’s research groups on the titles of the citing journals we discovered that the “Strategic Organisation Design” group is referenced a lot in “Organisation Studies”, “Journal of Management Studies”, “Strategic Management Journal” and “Human Relations” journals and that these journals form a distinct cluster based on shared citing practices.

Our approach responds to the conditions of keeping the process relatively simple and short for use in the library setting, yet meaningful for a combined quantitative/qualitative evaluation for both management and faculty whose research is affected by the evaluation procedure. Apart from showcasing the academic impact of an institute, RI2A also provides an opportunity to explore remote connections that otherwise might go unnoticed.

Place, publisher, year, edition, pages
Dublin: , 2019
Keywords
citation, impact, responsible, institutes
National Category
Information Studies
Research subject
Library and Information Science
Identifiers
urn:nbn:se:hb:diva-21620 (URN)10.5281/zenodo.3260276 (DOI)
Conference
48th LIBER Annual Conference Research Libraries for Society, Dublin, June 26-28, 2019
Available from: 2019-08-16 Created: 2019-08-16 Last updated: 2019-08-26Bibliographically approved
Schirone, M., Hammarfelt, B. & Nelhans, G. (Eds.). (2018). 23rd Nordic Workshop on Bibliometrics and Research Policy 2018 Book of abstracts. Paper presented at 23rd Nordic Workshop on Bibliometrics and Research Policy 2018, November 7-9, 2018. Borås: Högskolan i Borås
Open this publication in new window or tab >>23rd Nordic Workshop on Bibliometrics and Research Policy 2018 Book of abstracts
2018 (English)Conference proceedings (editor) (Other academic)
Abstract [en]

Initiated by Professors Olle Persson and Peter Ingwersen, bibliometric researchers in the Nordic countries have arranged annual Nordic workshops on bibliometrics since 1996. The general scope of the Nordic Workshop on Bibliometrics and Research Policy is to present recent bibliometric research in the Nordic countries, to create better linkages between the bibliometric research groups and their PhD students, and to link bibliometric research with research policy.The workshop language is English and the workshop is open to participants from any nation. The 23rd Nordic Workshop on Bibliometrics and Research Policy (NWB’2018) was organized by the Swedish School of Library and Information Science (SSLIS) at University of Borås, Sweden. It was held at University of Borås, on November 7-9th, 2018 with 100 participants.In total, we received 35 submissions. After reviewing the submissions, the program committee decided which papers were to be presented orally and which as poster presentations. 21 papers were accepted as oral presentations. These, as well as the titles of the two invited keynote talks and the abstracts of 9 posters, are presented as abstracts in these proceedings. The posters and oral presentation slides are also available for viewing and peer-feedback at figshare (with citable DOIs):https://doi.orgWe would like to thank all authors for their submissions, the session chairs and the keynote speakers, Fredrik Åström and Merle Jacob, for their contributions to the workshop and the student volunteers, for their diligent efforts during the workshop. Further, we would like to thank the sponsors for their generous financial support, without which the Nordic workshops could not be organised in their current form.The NWB’2017 website is at https://hb.se/nwb2018Follow on twitter as @nwb_2018 and #nwb2018

Place, publisher, year, edition, pages
Borås: Högskolan i Borås, 2018. p. 42
Keywords
#NWB2018, Nordic Workshop on Bibliometrics and Research Policy, 7-9 November 2018, Bibliometrics, Informetrics, Research policy
National Category
Information Studies
Research subject
Library and Information Science
Identifiers
urn:nbn:se:hb:diva-15403 (URN)10.6084/m9.figshare.7411559 (DOI)
Conference
23rd Nordic Workshop on Bibliometrics and Research Policy 2018, November 7-9, 2018
Available from: 2018-12-03 Created: 2018-12-03 Last updated: 2019-01-09Bibliographically approved
Nelhans, G. (2018). ”Akademisk frihet kräver någon form av ansvar”. Svenska Dagbladet
Open this publication in new window or tab >>”Akademisk frihet kräver någon form av ansvar”
2018 (Swedish)In: Svenska DagbladetArticle in journal, News item (Other (popular science, discussion, etc.)) Published
Place, publisher, year, edition, pages
Stockholm: , 2018
Keywords
Forskningspolitik, öppen tillgång, open access, OA
National Category
Information Studies
Research subject
Library and Information Science
Identifiers
urn:nbn:se:hb:diva-15410 (URN)
Note

Publicerad 2018-11-26

Available from: 2018-12-03 Created: 2018-12-03 Last updated: 2019-11-22Bibliographically approved
Sīle, L., Pölönen, J., Sivertsen, G., Guns, R., Engels, T. C. E., Arefiev, P., . . . Teitelbaum, R. (2018). Comprehensiveness of national bibliographic databases for social sciences and humanities: Findings from a European survey. Research Evaluation, 1(13), Article ID rvy016.
Open this publication in new window or tab >>Comprehensiveness of national bibliographic databases for social sciences and humanities: Findings from a European survey
Show others...
2018 (English)In: Research Evaluation, ISSN 0958-2029, E-ISSN 1471-5449, Vol. 1, no 13, article id rvy016Article in journal (Refereed) Epub ahead of print
Abstract [en]

This article provides an overview of national bibliographic databases that include data on research output within social sciences and humanities (SSH) in Europe. We focus on the comprehensiveness of the database content. Compared to the data from commercial databases such as Web of Science and Scopus, data from national bibliographic databases (e.g. Flemish Academic Bibliographic Database for the SSH (VABB-SHW) in Belgium, Current Research Information System in Norway (CRISTIN)) are more comprehensive and may, therefore, be better fit for bibliometric analyses. Acknowledging this, several countries within Europe maintain national bibliographic databases; detailed and comparative information about their content, however, has been limited. In autumn 2016, we launched a survey to acquire an overview of national bibliographic databases for SSH in Europe and Israel. Surveying 41 countries (responses received from 39 countries), we identified 21 national bibliographic databases for SSH. Further, we acquired a more detailed description of 13 databases, with a focus on their comprehensiveness. Findings indicate that even though the content of national bibliographic databases is diverse, it is possible to delineate a subset that is similar across databases. At the same time, it is apparent that differences in national bibliographic databases are often bound to differences in country-specific arrangements. Considering this, we highlight implications to bibliometric analyses based on data from national bibliographic databases and outline several aspects that may be taken into account in the development of existing national bibliographic databases for SSH or the design of new ones.

Keywords
national bibliographic databases, social sciences, humanities
National Category
Information Studies
Research subject
Library and Information Science
Identifiers
urn:nbn:se:hb:diva-15411 (URN)10.1093/reseval/rvy016 (DOI)
Available from: 2018-12-03 Created: 2018-12-03 Last updated: 2019-01-08Bibliographically approved
Nelhans, G. & Bodin, T. (2018). Questionable Publishing in Swedish Academia. In: : . Paper presented at 23rd Nordic Workshop on Bibliometrics and Research Policy 2018, Borås, November 2018.
Open this publication in new window or tab >>Questionable Publishing in Swedish Academia
2018 (English)Conference paper, Poster (with or without abstract) (Other academic)
Keywords
alleged questionable publishing, SwePub
National Category
Information Studies
Research subject
Library and Information Science
Identifiers
urn:nbn:se:hb:diva-15405 (URN)
Conference
23rd Nordic Workshop on Bibliometrics and Research Policy 2018, Borås, November 2018
Available from: 2018-12-03 Created: 2018-12-03 Last updated: 2019-01-09Bibliographically approved
Nelhans, G. (2018). Replik: Larhammar svartmålar öppen vetenskap. Stockholm
Open this publication in new window or tab >>Replik: Larhammar svartmålar öppen vetenskap
2018 (Swedish)Other (Other (popular science, discussion, etc.))
Abstract [sv]

Vad som behövs är ett starkare etos i forskarsamhället där vi i stället för att räkna pinnar erkänner att sakkunniggranskning handlar om att bedöma kvalitet. Det skriver Gustaf Nelhans, lektor i Biblioteks och informationsvetenskap, i en replik till Dan Larhammar.

Place, publisher, year, pages
Stockholm: , 2018
Series
Curie - en tidning från vetenskapsrådet
Keywords
öppen tillgång, open access, vetenskaplig publicering, CUDOS
National Category
Information Studies
Research subject
Library and Information Science
Identifiers
urn:nbn:se:hb:diva-13924 (URN)
Available from: 2018-03-28 Created: 2018-03-28 Last updated: 2018-03-29Bibliographically approved
Nelhans, G. (2017). Explorative scientometrics beyond impact indicators – qualitative citation analysis.. In: : . Paper presented at Academic Rankings and Metrics Workshop, Norrköping, November 29 – December 1, 2017.
Open this publication in new window or tab >>Explorative scientometrics beyond impact indicators – qualitative citation analysis.
2017 (English)Conference paper, Oral presentation only (Other academic)
Keywords
citation analysis
National Category
Information Studies
Research subject
Library and Information Science
Identifiers
urn:nbn:se:hb:diva-13511 (URN)
Conference
Academic Rankings and Metrics Workshop, Norrköping, November 29 – December 1, 2017
Note

Invited by David Moats

Available from: 2018-01-15 Created: 2018-01-15 Last updated: 2018-01-16Bibliographically approved
Nelhans, G. (2017). Lösningsförslagen har redan genomförts. Dagens Nyheter, Article ID 13 September.
Open this publication in new window or tab >>Lösningsförslagen har redan genomförts
2017 (Swedish)In: Dagens Nyheter, article id 13 SeptemberArticle in journal, News item (Other (popular science, discussion, etc.)) Published
Abstract [sv]

REPLIK DN Debatt 10/9. Mats Alvesson och Roland Paulsen skriver om sitt eget vetenskapsområdes svaga relevans för samhället. Det är lätt att instämma att vi befinner oss i en publiceringsexplosion av exponentiella mått, något som har diskuterats i åtminstone ett halvsekel inom naturvetenskaperna. Men det är svårt att se hur denna ökning är ett problem i sig, skriver Gustaf Nelhans, fil dr i vetenskapsteori.

Keywords
samhällsvetenskap, relevans, citeringar, resurstilldelning
National Category
Information Studies
Research subject
Library and Information Science
Identifiers
urn:nbn:se:hb:diva-13509 (URN)
Available from: 2018-01-15 Created: 2018-01-15 Last updated: 2019-11-22Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0001-5196-7148

Search in DiVA

Show all publications