5678910118 of 33
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • harvard-cite-them-right
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Evaluating LLM-Based Temporal Subject Assignment in Fiction: The Impact of Evaluation Frameworks on Metadata Interpretation
University of Borås, Faculty of Librarianship, Information, Education and IT.ORCID iD: 0009-0003-6165-2184
University of Borås, Faculty of Librarianship, Information, Education and IT.ORCID iD: 0000-0001-9368-8649
2026 (English)In: Cataloging & Classification Quarterly, ISSN 0163-9374, E-ISSN 1544-4554Article in journal (Refereed) Epub ahead of print
Abstract [en]

This study examines how automatically generated temporal subject metadata for fiction can be evaluated when time is represented as year intervals. Using 45 Swedish novels with manually assigned chronological headings as the basis for comparison with model-generated intervals, the study contrasts two evaluation perspectives: overlap-based classification (precision, recall, F1) and boundary-based deviation (RMSE). The analysis shows how different evaluation frameworks highlight different aspects of temporal alignment between predicted and manually assigned intervals. By combining these perspectives, the study makes visible different types of temporal discrepancies and shows how evaluation design influences what is counted as alignment in interval-based subject metadata. 

Place, publisher, year, edition, pages
Taylor & Francis Group, 2026.
Keywords [en]
Temporal subject assignment, large language model, evaluation framework, subject analysis, temporal metadata
National Category
Information Studies Information Systems, Social aspects
Research subject
Library and Information Science
Identifiers
URN: urn:nbn:se:hb:diva-36048DOI: 10.1080/01639374.2026.2711280ISI: 001850353100001Scopus ID: 2-s2.0-105047392563OAI: oai:DiVA.org:hb-36048DiVA, id: diva2:2096683
Funder
University of BoråsUniversity of BoråsAvailable from: 2026-08-31 Created: 2026-08-31 Last updated: 2026-09-01Bibliographically approved

Open Access in DiVA

fulltext(1457 kB)15 downloads
File information
File name FULLTEXT01.pdfFile size 1457 kBChecksum SHA-512
098ea6d02c6ba44799730f3f63ccaf04df0f36461557b57d6bd17d69868a738bb5ac7d1437539c820b2a33cd81516173430de2f1de7ea89c5c9370137709f159
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Westin, FereshtaEklund, Johan

Search in DiVA

By author/editor
Westin, FereshtaEklund, Johan
By organisation
Faculty of Librarianship, Information, Education and IT
In the same journal
Cataloging & Classification Quarterly
Information StudiesInformation Systems, Social aspects

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 96 hits
5678910118 of 33
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • harvard-cite-them-right
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf