sh.sePublikasjoner
Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • harvard-anglia-ruskin-university
  • apa-old-doi-prefix.csl
  • sodertorns-hogskola-harvard.csl
  • sodertorns-hogskola-oxford.csl
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Interpretation of novel literary metaphors by humans and GPT-4
University of Pennsylvania, Philadelphia, USA.ORCID-id: 0000-0002-0928-0809
Södertörns högskola, Institutionen för kultur och lärande, Engelska.ORCID-id: 0000-0002-0121-4591
University of California, Los Angeles, USA.ORCID-id: 0000-0001-8010-6267
2024 (engelsk)Inngår i: Proceedings of the 46th Annual Meeting of the Cognitive Science Society / [ed] L. K. Samuelson; S. L. Frank; M. Toneva; A. Mackey; E. Hazeltine, University of California , 2024, s. 4014-4020Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

Despite the exceptional performance of large language models (LLMs) on a wide range of tasks involving natural language processing and reasoning, there has been sharp disagreement as to whether their abilities extend to more creative human abilities. A core example is the interpretation of novel metaphors. Given the enormous and non-curated text corpora used to train LLMs, a serious obstacle to designing tests is the need to obtain novel yet high-quality metaphors that are unlikely to have been included in the training data. Here we assessed the ability of GPT-4, a state-of-the-art large language model, to provide natural-language interpretations of novel literary metaphors drawn from Serbian poetry and translated into English. Human judges—blind to the fact that an AI model was involved—rated metaphor interpretations generated by GPT-4 as superior to those provided by a group of college students. In interpreting reversed metaphors, GPT-4, as well as humans, exhibited signs of sensitivity to the Gricean cooperative principle. These results indicate that LLMs such as GPT-4 have acquired an emergent ability to interpret literary metaphors.

sted, utgiver, år, opplag, sider
University of California , 2024. s. 4014-4020
Serie
Proceedings of the Annual Meeting of the Cognitive Science Society, ISSN 1069-7977 ; 46
Emneord [en]
Metaphor, Large language models, Natural language processing
HSV kategori
Identifikatorer
URN: urn:nbn:se:sh:diva-54382OAI: oai:DiVA.org:sh-54382DiVA, id: diva2:1878283
Konferanse
The 46th Annual Meeting of the Cognitive Science Society, Rotterdam, July 24-27, 2024.
Tilgjengelig fra: 2024-06-26 Laget: 2024-06-26 Sist oppdatert: 2025-10-07bibliografisk kontrollert

Open Access i DiVA

Fulltekst mangler i DiVA

Andre lenker

Publisher's full text

Person

Stamenković, Dušan

Søk i DiVA

Av forfatter/redaktør
Ichien, NicholasStamenković, DušanHolyoak, Keith J.
Av organisasjonen

Søk utenfor DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric

urn-nbn
Totalt: 211 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • harvard-anglia-ruskin-university
  • apa-old-doi-prefix.csl
  • sodertorns-hogskola-harvard.csl
  • sodertorns-hogskola-oxford.csl
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf