Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • harvard-cite-them-right
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Classification of Fiction Genres: Text classification of fiction texts from Project Gutenberg
Högskolan i Borås, Akademin för bibliotek, information, pedagogik och IT.
2018 (engelsk)Independent thesis Advanced level (degree of Master (Two Years)), 20 poäng / 30 hpOppgave
Abstract [en]

Stylometric analysis in text classification is most often used in authorship attribution studies. This thesis used a machine learning algorithm, the Naive Bayes Classifier, in a text classification task comparing stylometric and lexical features. The texts were extracted from the Project Gutenberg website and were comprised of three genres: detective fiction, fantasy, and science fiction. The aim was to see how well the classifier performed in a supervised learning task when it came to discerning genres from one another. R was used to extract the texts from Project Gutenberg and Python script was used to run the experiment. Approximately 1978 texts were extracted and preprocessed before univariate filtering and tf-idf weighting was used as the lexical feature while average sentence length, average word length, number of characters, number of punctuation marks, number of uppercase words, number of title case words, and parts-of-speech tags for nouns, verbs, and adjectives were generated as the feature sets for the topic independent stylometric features. Normalization was performed using the ℓ² norm for the tf-idf weighting, with the ℓ² norm and z-score standardization for the stylometric features. Multinomial Naive Bayes was performed on the lexical feature set and Gaussian Naive Bayeson the stylometric set, both with 10-fold cross-validation. Precision was used as the measure by which to assess the performance of the classifier. The classifier performed better in the lexical features experiment than the stylometric features experiment, suggesting that downsampling, more stylometric features, as well as more classes would have been beneficial.

sted, utgiver, år, opplag, sider
2018.
Emneord [sv]
text, classification, genre, machine, learning, supervised, Gutenberg, fiction
HSV kategori
Identifikatorer
URN: urn:nbn:se:hb:diva-16007OAI: oai:DiVA.org:hb-16007DiVA, id: diva2:1305700
Fag / kurs
Library and Information Science
Tilgjengelig fra: 2019-04-24 Laget: 2019-04-18 Sist oppdatert: 2025-09-24bibliografisk kontrollert

Open Access i DiVA

fulltext(337 kB)4383 nedlastinger
Filinformasjon
Fil FULLTEXT01.pdfFilstørrelse 337 kBChecksum SHA-512
c1fb6def37ac643542b4fd56386288f898d3dd9ad608bd1428f8904664f1afa7dbfcc240a2bb64168c8ae147982d34ab13c0e4b786f4afa0aa0c70ca293c8409
Type fulltextMimetype application/pdf

Av organisasjonen

Søk utenfor DiVA

GoogleGoogle Scholar
Totalt: 4393 nedlastinger
Antall nedlastinger er summen av alle nedlastinger av alle fulltekster. Det kan for eksempel være tidligere versjoner som er ikke lenger tilgjengelige

urn-nbn

Altmetric

urn-nbn
Totalt: 2452 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • harvard-cite-them-right
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf