sh.sePublikationer
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • harvard-anglia-ruskin-university
  • apa-old-doi-prefix.csl
  • sodertorns-hogskola-harvard.csl
  • sodertorns-hogskola-oxford.csl
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Interpretation of novel literary metaphors by humans and GPT-4
University of Pennsylvania, Philadelphia, USA.ORCID-id: 0000-0002-0928-0809
Södertörns högskola, Institutionen för kultur och lärande, Engelska.ORCID-id: 0000-0002-0121-4591
University of California, Los Angeles, USA.ORCID-id: 0000-0001-8010-6267
2024 (Engelska)Ingår i: Proceedings of the 46th Annual Meeting of the Cognitive Science Society / [ed] L. K. Samuelson; S. L. Frank; M. Toneva; A. Mackey; E. Hazeltine, University of California , 2024, s. 4014-4020Konferensbidrag, Publicerat paper (Refereegranskat)
Abstract [en]

Despite the exceptional performance of large language models (LLMs) on a wide range of tasks involving natural language processing and reasoning, there has been sharp disagreement as to whether their abilities extend to more creative human abilities. A core example is the interpretation of novel metaphors. Given the enormous and non-curated text corpora used to train LLMs, a serious obstacle to designing tests is the need to obtain novel yet high-quality metaphors that are unlikely to have been included in the training data. Here we assessed the ability of GPT-4, a state-of-the-art large language model, to provide natural-language interpretations of novel literary metaphors drawn from Serbian poetry and translated into English. Human judges—blind to the fact that an AI model was involved—rated metaphor interpretations generated by GPT-4 as superior to those provided by a group of college students. In interpreting reversed metaphors, GPT-4, as well as humans, exhibited signs of sensitivity to the Gricean cooperative principle. These results indicate that LLMs such as GPT-4 have acquired an emergent ability to interpret literary metaphors.

Ort, förlag, år, upplaga, sidor
University of California , 2024. s. 4014-4020
Serie
Proceedings of the Annual Meeting of the Cognitive Science Society, ISSN 1069-7977 ; 46
Nyckelord [en]
Metaphor, Large language models, Natural language processing
Nationell ämneskategori
Psykologi (exklusive tillämpad psykologi)
Identifikatorer
URN: urn:nbn:se:sh:diva-54382OAI: oai:DiVA.org:sh-54382DiVA, id: diva2:1878283
Konferens
The 46th Annual Meeting of the Cognitive Science Society, Rotterdam, July 24-27, 2024.
Tillgänglig från: 2024-06-26 Skapad: 2024-06-26 Senast uppdaterad: 2025-10-07Bibliografiskt granskad

Open Access i DiVA

Fulltext saknas i DiVA

Övriga länkar

Publisher's full text

Person

Stamenković, Dušan

Sök vidare i DiVA

Av författaren/redaktören
Ichien, NicholasStamenković, DušanHolyoak, Keith J.
Av organisationen
Engelska
Psykologi (exklusive tillämpad psykologi)

Sök vidare utanför DiVA

GoogleGoogle Scholar

urn-nbn

Altmetricpoäng

urn-nbn
Totalt: 214 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • harvard-anglia-ruskin-university
  • apa-old-doi-prefix.csl
  • sodertorns-hogskola-harvard.csl
  • sodertorns-hogskola-oxford.csl
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf