Change search
Link to record
Permanent link

Direct link
BETA
Publications (10 of 39) Show all publications
Nelhans, G. (2020). Alleged Questionable Publishing in Swedish Academia. In: : . Paper presented at Open lecture organized by SLU University Library, Swedish University of Agricultural Sciences, Uppsala.
Open this publication in new window or tab >>Alleged Questionable Publishing in Swedish Academia
2020 (English)Conference paper, Oral presentation only (Other (popular science, discussion, etc.))
Abstract [en]

Welcome to an open lecture on questionable scientific publishing. The researcher Gustaf Nelhans has studied how widespread this type of publishing is at Swedish universities and presents the results in this lecture, which is given in English. The library will also briefly provide information on how you as a researcher can avoid deceptive or “predatory” journals.

In recent years, rogue actors, often called "predatory publishers", have appeared in the publishing market. These actors take advantage of the open access model where journals and publishers cover their costs through publication fees. The business idea of these publishers is to publish and charge for as many articles as possible, usually without peer-review. In the lecture "Alleged questionable publishing at the Higher Education Institute (HEI) level in Sweden - what should be counted as a problematic share?" Gustaf Nelhans presents the results of a study he recently conducted.

Gustaf Nelhans is a senior lecturer in library and information science at the University of Borås. His research places emphasis on the use of bibliometrics and citation analysis for both research information and resource allocation.

The open lecture is arranged by the SLU University Library, which also in connection with the lecture briefly tells you how you as a researcher can avoid deceptive or “predatory” journals.

Keywords
Questionable publishing, higher education institutions
National Category
Information Studies
Research subject
Library and Information Science
Identifiers
urn:nbn:se:hb:diva-22690 (URN)
Conference
Open lecture organized by SLU University Library, Swedish University of Agricultural Sciences, Uppsala
Available from: 2020-01-28 Created: 2020-01-28 Last updated: 2020-03-26Bibliographically approved
Nelhans, G. & Bodin, T. (2020). Methodological Considerations for Identifying Questionable Publishing in a National Context – the Case of Swedish Higher Education Institutions. , 1-39
Open this publication in new window or tab >>Methodological Considerations for Identifying Questionable Publishing in a National Context – the Case of Swedish Higher Education Institutions
2020 (English)In: p. 1-39Article in journal (Refereed) Epub ahead of print
Abstract [en]

The overall scope of this study is an attempt at a methodological framework for matching publication lists at the national level against a combined set of blacklists for questionable publishing. Using the total verified set of publications from Swedish Higher Education Institutions (HEI) as a case, we examined the number, distribution, and proportion of publishing in questionable journals at the national level. Journal publication data was extracted from the national SwePub database and matched against three curated blacklists of questionable publishing. For the period 2012–2017, we identified 1,743 published papers in blacklisted journals, equal to an average of 0.5–0.9% of the total publications from Swedish HEIs. There was high variability between different HEI categories, with more established universities at the lower end of the spectrum, while university colleges and new universities had a much higher proportion (∼2%). There was a general decreasing trend during the study period (ρ = 0.83) for all categories of HEI:s. The study presents a methodology to identify questionable publishing in academia which could be applied to other countries with similar infrastructure. Thus, it could serve as a starting point for the development of a general framework for cross-national quantitative estimation of questionable publishing.

Keywords
Questionable Publishing, National level, Publication Ethics, Publication Blacklists
National Category
Information Studies
Research subject
Library and Information Science
Identifiers
urn:nbn:se:hb:diva-23079 (URN)10.1162/qss_a_00033 (DOI)
Available from: 2020-03-25 Created: 2020-03-25 Last updated: 2020-03-26Bibliographically approved
Eklund, J., Gunnarsson Lorenzen, D. & Nelhans, G. (2019). MESH classification of clinical guidelines using conceptual embeddings of references. In: Giuseppe Catalano, Cinzia Daraio, Martina Gregori, Henk F. Moed and Giancarlo Ruocco (Ed.), Proceedings of the 17th conference of the International society for scientometrics and informetrics, ISSI: with a Special STI Indicators Conference Track: . Paper presented at 17th International Conference of the International Society for Scientometrics and Informetrics, Rome, September 2-5, 2019. (pp. 859-864). , 2
Open this publication in new window or tab >>MESH classification of clinical guidelines using conceptual embeddings of references
2019 (English)In: Proceedings of the 17th conference of the International society for scientometrics and informetrics, ISSI: with a Special STI Indicators Conference Track / [ed] Giuseppe Catalano, Cinzia Daraio, Martina Gregori, Henk F. Moed and Giancarlo Ruocco, 2019, Vol. 2, p. 859-864Conference paper, Published paper (Refereed)
Abstract [en]

In this study, we investigate different strategies for assigning MeSH (Medical Subject Headings) terms to clinical guidelines using machine learning. Features based on words in titles and abstracts are investigated and compared to features based on topics assigned to references cited by the guidelines. Two of the feature engineering strategies utilize word embeddings produced by recent models based on in the distributional hypothesis, called word2vecand fastText. The evaluation results show that reference-based strategies tend to yield a higher recall and F1 scores for MeSH terms with a sufficient amount of training instances, whereas title and abstract based features yield a higher precision.

Keywords
MESH, clinical guidelines, machine learning, word embedding, word2vec, fasttext
National Category
Information Studies
Research subject
Library and Information Science
Identifiers
urn:nbn:se:hb:diva-22686 (URN)978-88-3381-118-5 (ISBN)
Conference
17th International Conference of the International Society for Scientometrics and Informetrics, Rome, September 2-5, 2019.
Projects
Data for Impact
Funder
EU, Horizon 2020, 770531
Available from: 2020-01-27 Created: 2020-01-27 Last updated: 2020-03-04Bibliographically approved
Eklund, J., Gunnarsson Lorenzen, D. & Nelhans, G. (2019). MESH classification of clinical guidelinesusing conceptual embeddings of references. In: Giuseppe Catalano, Cinzia Daraio, Martina Gregori, Henk F. Moed and Giancarlo Ruocco (Ed.), Proceedings of the 17th conference of the International society for scientometrics and informetrics, ISSI: with a Special STI Indicators Conference Track. Paper presented at 17th conference of the International society for scientometrics and informetrics, ISSI (pp. 859-864). , 2
Open this publication in new window or tab >>MESH classification of clinical guidelinesusing conceptual embeddings of references
2019 (English)In: Proceedings of the 17th conference of the International society for scientometrics and informetrics, ISSI: with a Special STI Indicators Conference Track / [ed] Giuseppe Catalano, Cinzia Daraio, Martina Gregori, Henk F. Moed and Giancarlo Ruocco, 2019, Vol. 2, p. 859-864Conference paper, Published paper (Refereed)
Abstract [en]

In this study, we investigate different strategies for assigning MeSH (Medical Subject Headings) terms to clinical guidelines using machine learning. Features based on words in titles and abstracts are investigated and compared to features based on topics assigned to references cited by the guidelines. Two of the feature engineering strategies utilize word embeddings produced by recent models based on in the distributional hypothesis, called word2vecand fastText. The evaluation results show that reference-based strategies tend to yield a higher recall and F1 scores for MeSH terms with a sufficient amount of training instances, whereas title and abstract based features yield a higher precision.

Keywords
MESH, clinical guidelines, machine learning, word embedding, word2vec, fasttext
National Category
Information Studies
Research subject
Library and Information Science
Identifiers
urn:nbn:se:hb:diva-22096 (URN)978-88-3381-118-5 (ISBN)
Conference
17th conference of the International society for scientometrics and informetrics, ISSI
Projects
Data for Impact
Funder
EU, Horizon 2020, 770531
Available from: 2019-11-22 Created: 2019-11-22 Last updated: 2019-12-06Bibliographically approved
Gunnarsson Lorenzen, D., Eklund, J., Nelhans, G. & Ekström, B. (2019). On the potential for detecting scientific issues and controversies on Twitter: A method for investigation conversations mentioning research. In: Proceedings of ISSI.: . Paper presented at ISSI, the 17th International Conference on Scientometrics & Informetrics, Rome, 2-5 September, 2019. (pp. 2189-2198). , Article ID 375.
Open this publication in new window or tab >>On the potential for detecting scientific issues and controversies on Twitter: A method for investigation conversations mentioning research
2019 (English)In: Proceedings of ISSI., 2019, p. 2189-2198, article id 375Conference paper, Published paper (Refereed)
Abstract [en]

In this study, we demonstrate how to collect Twitter conversations emanating from or referring to scientific papers. We propose segmenting the conversational threads into smaller segments and then compare them using information retrieval techniques, in order to find differences and similarities between discussions and within discussions. While the method still can be improved, the study shows that it is possible to collect larger conversations about research on Twitter, and that these are suitable for various automated methods. We do however identify a need to analyse these with qualitative methods as well.

Keywords
Twitter, conversations
National Category
Computer and Information Sciences
Research subject
Library and Information Science
Identifiers
urn:nbn:se:hb:diva-21908 (URN)
Conference
ISSI, the 17th International Conference on Scientometrics & Informetrics, Rome, 2-5 September, 2019.
Projects
Data4Impact
Available from: 2019-10-31 Created: 2019-10-31 Last updated: 2019-11-05Bibliographically approved
Nelhans, G., Vlachos, E. & Vignes, M. (2019). RI2A – Towards a Responsible Institute Impact Assessment. In: 48th LIBER Annual Conference Research Libraries for Society, Trinity College Dublin, Ireland 26-28 June 2019: . Paper presented at 48th LIBER Annual Conference Research Libraries for Society, Dublin, June 26-28, 2019 (pp. 138-139). Dublin
Open this publication in new window or tab >>RI2A – Towards a Responsible Institute Impact Assessment
2019 (English)In: 48th LIBER Annual Conference Research Libraries for Society, Trinity College Dublin, Ireland 26-28 June 2019, Dublin, 2019, p. 138-139Conference paper, Oral presentation with published abstract (Refereed)
Abstract [en]

Recently, there has been a shift in attitudes against improper use of metrics to evaluate research. In our effort to develop alternative approaches to identify relevant measurements for the impact of research at the institute level – beyond simple frequency counts and rankings based on single indicators – we decided to match the publications of a targeted institute to the Web of Science (WoS) database and with the use of machine learning techniques and visualization tools to explore and showcase our results respectively.

We present the Responsible Institute Impact Assessment (RI2A) for evaluating the research impact of a targeted institute with a case study. We used the 448 publications retrieved from the University of Southern Denmark’s (SDU) research registration database for the Department of Marketing and Management between 2012-2017. Of these, 170 publications satisfied the criteria of both being peer-reviewed and having a DOI to be matched in the WoS database. We then used the bibliographic coupling algorithm to cluster the articles that cited the work produced at the targeted institute. This algorithm groups data together based on the number of shared references between the identified units for analysis (article, source journal and institution level). Lastly, a co-word analysis was used to identify pair-wise relationships between keywords found in the citing articles.

A total of 1195 citing articles without self-citations where identified. The results of RI2A assist the targeted institute by allowing them to discover

  • the researchers who cite their publications and the relationships among them,
  • the journals that cite their publications and the relationships among them,
  • the universities, institutes and organizations that use their publications and the relationships among them, and
  • the main groups of keywords used in the citing articles.

Visualizing these results into graphs and making sense of them requires more work than simple publication/citation counts. Although not described in detail here, a collaboration between the SDU library and the university’s research support and policy services has started, where it has been proposed that evaluation should be based on joint work between evaluators and evaluatees focusing on strengths and weaknesses as well as timewise comparison of previous assessments. A straightforward mode would be to compare the results of the mapping exercise with an already known description of the evaluated department’s profile. For instance, by overlaying the targeted department’s research groups on the titles of the citing journals we discovered that the “Strategic Organisation Design” group is referenced a lot in “Organisation Studies”, “Journal of Management Studies”, “Strategic Management Journal” and “Human Relations” journals and that these journals form a distinct cluster based on shared citing practices.

Our approach responds to the conditions of keeping the process relatively simple and short for use in the library setting, yet meaningful for a combined quantitative/qualitative evaluation for both management and faculty whose research is affected by the evaluation procedure. Apart from showcasing the academic impact of an institute, RI2A also provides an opportunity to explore remote connections that otherwise might go unnoticed.

Place, publisher, year, edition, pages
Dublin: , 2019
Keywords
citation, impact, responsible, institutes
National Category
Information Studies
Research subject
Library and Information Science
Identifiers
urn:nbn:se:hb:diva-21620 (URN)10.5281/zenodo.3260276 (DOI)
Conference
48th LIBER Annual Conference Research Libraries for Society, Dublin, June 26-28, 2019
Available from: 2019-08-16 Created: 2019-08-16 Last updated: 2019-08-26Bibliographically approved
Nelhans, G. & Eklund, J. (2019). Semantic drift of cited references in the medical literature. In: : . Paper presented at 24th Nordic Workshop on Bibliometrics and Research Policy, Reykjavik, 27-28 November, 2019..
Open this publication in new window or tab >>Semantic drift of cited references in the medical literature
2019 (English)Conference paper, Oral presentation with published abstract (Other academic)
Abstract [en]

Adding the semantic content of texts to the study of citations opens for new means of research in the field. Words can be used in specific or more general terms. Their meaning changes through use. Correspondingly, the meaning of a cited reference is defined by its use. Furthermore, the meaning of the reference changes as it is used in different contexts. Using ‘word embeddings’ we create a conceptual space of references using a window of text around the references. The model is trained on a set of 2 million full-text articles derived from EuroPMC. We measure the length of the journey of the cited references in this space to determine how much their semantic meaning changes over time. Furthermore, we study the topical heterogeneity of the citation contexts inferred to the references by the citing documents.

 

  • RQ1. Can we identify the degree of topical heterogeneity of a subset of investigated cited references?
  • RQ2. Can we identify the semantic drift in cited references over time?
  • RQ3. Can we infer the presence of a cited reference in a given text using our trained model? Correspondingly: can we reconstruct the context of a reference in a text?

 

In this explorative work we investigate to what degree the semantic meaning of a cited reference can be recognized. In the end, we explore the possibility to generate a dynamic classification of research based on its use, rather than on their content. This would make it possible to identify similar works irrespectively of manifest citation links (bibliographic coupling or co-citation) or identical content of words (co-word analysis).

Keywords
semantic modelling, citation context
National Category
Information Studies Other Computer and Information Science
Research subject
Library and Information Science
Identifiers
urn:nbn:se:hb:diva-22688 (URN)
Conference
24th Nordic Workshop on Bibliometrics and Research Policy, Reykjavik, 27-28 November, 2019.
Projects
Data for impact
Funder
EU, Horizon 2020, 770531
Available from: 2020-01-28 Created: 2020-01-28 Last updated: 2020-01-31Bibliographically approved
Nolin, J., Nelhans, G. & Olson, N. (2019). The Naming of the Beast: Scrutinizing Concepts of Technology Rich Futures. In: Andreas Lösch, Armin Grunwald, Martin Meister, Ingo Schulz-Schaeffer (Ed.), Socio-Technical Futures Shaping the Present: Empirical Examples and Analytical Challenges (pp. 231-254). Wiesbaden, Germany: Springer
Open this publication in new window or tab >>The Naming of the Beast: Scrutinizing Concepts of Technology Rich Futures
2019 (English)In: Socio-Technical Futures Shaping the Present: Empirical Examples and Analytical Challenges / [ed] Andreas Lösch, Armin Grunwald, Martin Meister, Ingo Schulz-Schaeffer, Wiesbaden, Germany: Springer, 2019, p. 231-254Chapter in book (Refereed)
Abstract [en]

Constructive Technology Assessment (CTA) aims to involve a multitude of stakeholders in discussions involving technology. However, all technological assessment is mediated through concepts. Development of concepts regarding technology rich futures has been lively but confusing for many stakeholders. Utilizing bibliographic data from Web of Science, this article overviews and discusses ten influential concepts that have played an important role during the 2000s. It is argued that the lively and dynamic concept production leads to numerous problems for a CTA approach.

Place, publisher, year, edition, pages
Wiesbaden, Germany: Springer, 2019
Series
Futures of Technology, Science and Society, ISSN ISSN 2524-3764, E-ISSN ISSN 2524-3772
Keywords
Internet of Things, Semantic Web, Constructive Technology Assessment, Technology rich futures
National Category
Social Sciences
Identifiers
urn:nbn:se:hb:diva-22586 (URN)10.1007/978-3-658-27155-8 (DOI)978-3-658-27154-1 (ISBN)978-3-658-27155-8 (ISBN)
Available from: 2020-01-17 Created: 2020-01-17 Last updated: 2020-01-23Bibliographically approved
Schirone, M., Hammarfelt, B. & Nelhans, G. (Eds.). (2018). 23rd Nordic Workshop on Bibliometrics and Research Policy 2018 Book of abstracts. Paper presented at 23rd Nordic Workshop on Bibliometrics and Research Policy 2018, November 7-9, 2018. Borås: Högskolan i Borås
Open this publication in new window or tab >>23rd Nordic Workshop on Bibliometrics and Research Policy 2018 Book of abstracts
2018 (English)Conference proceedings (editor) (Other academic)
Abstract [en]

Initiated by Professors Olle Persson and Peter Ingwersen, bibliometric researchers in the Nordic countries have arranged annual Nordic workshops on bibliometrics since 1996. The general scope of the Nordic Workshop on Bibliometrics and Research Policy is to present recent bibliometric research in the Nordic countries, to create better linkages between the bibliometric research groups and their PhD students, and to link bibliometric research with research policy.The workshop language is English and the workshop is open to participants from any nation. The 23rd Nordic Workshop on Bibliometrics and Research Policy (NWB’2018) was organized by the Swedish School of Library and Information Science (SSLIS) at University of Borås, Sweden. It was held at University of Borås, on November 7-9th, 2018 with 100 participants.In total, we received 35 submissions. After reviewing the submissions, the program committee decided which papers were to be presented orally and which as poster presentations. 21 papers were accepted as oral presentations. These, as well as the titles of the two invited keynote talks and the abstracts of 9 posters, are presented as abstracts in these proceedings. The posters and oral presentation slides are also available for viewing and peer-feedback at figshare (with citable DOIs):https://doi.orgWe would like to thank all authors for their submissions, the session chairs and the keynote speakers, Fredrik Åström and Merle Jacob, for their contributions to the workshop and the student volunteers, for their diligent efforts during the workshop. Further, we would like to thank the sponsors for their generous financial support, without which the Nordic workshops could not be organised in their current form.The NWB’2017 website is at https://hb.se/nwb2018Follow on twitter as @nwb_2018 and #nwb2018

Place, publisher, year, edition, pages
Borås: Högskolan i Borås, 2018. p. 42
Keywords
#NWB2018, Nordic Workshop on Bibliometrics and Research Policy, 7-9 November 2018, Bibliometrics, Informetrics, Research policy
National Category
Information Studies
Research subject
Library and Information Science
Identifiers
urn:nbn:se:hb:diva-15403 (URN)10.6084/m9.figshare.7411559 (DOI)
Conference
23rd Nordic Workshop on Bibliometrics and Research Policy 2018, November 7-9, 2018
Available from: 2018-12-03 Created: 2018-12-03 Last updated: 2019-01-09Bibliographically approved
Nelhans, G. (2018). ”Akademisk frihet kräver någon form av ansvar”. Svenska Dagbladet
Open this publication in new window or tab >>”Akademisk frihet kräver någon form av ansvar”
2018 (Swedish)In: Svenska DagbladetArticle in journal, News item (Other (popular science, discussion, etc.)) Published
Place, publisher, year, edition, pages
Stockholm: , 2018
Keywords
Forskningspolitik, öppen tillgång, open access, OA
National Category
Information Studies
Research subject
Library and Information Science
Identifiers
urn:nbn:se:hb:diva-15410 (URN)
Note

Publicerad 2018-11-26

Available from: 2018-12-03 Created: 2018-12-03 Last updated: 2019-11-22Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0001-5196-7148

Search in DiVA

Show all publications