sh.sePublications
Planned maintenance
A system upgrade is planned for 24/9-2024, at 12:00-14:00. During this time DiVA will be unavailable.
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • harvard-anglia-ruskin-university
  • apa-old-doi-prefix.csl
  • sodertorns-hogskola-harvard.csl
  • sodertorns-hogskola-oxford.csl
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Interpretation of novel literary metaphors by humans and GPT-4
University of Pennsylvania, Philadelphia, USA.ORCID iD: 0000-0002-0928-0809
Södertörn University, School of Culture and Education, English language.ORCID iD: 0000-0002-0121-4591
University of California, Los Angeles, USA.ORCID iD: 0000-0001-8010-6267
2024 (English)In: Proceedings of the 46th Annual Meeting of the Cognitive Science Society / [ed] L. K. Samuelson; S. L. Frank; M. Toneva; A. Mackey; E. Hazeltine, University of California , 2024, p. 4014-4020Conference paper, Published paper (Refereed)
Abstract [en]

Despite the exceptional performance of large language models (LLMs) on a wide range of tasks involving natural language processing and reasoning, there has been sharp disagreement as to whether their abilities extend to more creative human abilities. A core example is the interpretation of novel metaphors. Given the enormous and non-curated text corpora used to train LLMs, a serious obstacle to designing tests is the need to obtain novel yet high-quality metaphors that are unlikely to have been included in the training data. Here we assessed the ability of GPT-4, a state-of-the-art large language model, to provide natural-language interpretations of novel literary metaphors drawn from Serbian poetry and translated into English. Human judges—blind to the fact that an AI model was involved—rated metaphor interpretations generated by GPT-4 as superior to those provided by a group of college students. In interpreting reversed metaphors, GPT-4, as well as humans, exhibited signs of sensitivity to the Gricean cooperative principle. These results indicate that LLMs such as GPT-4 have acquired an emergent ability to interpret literary metaphors.

Place, publisher, year, edition, pages
University of California , 2024. p. 4014-4020
Series
Proceedings of the Annual Meeting of the Cognitive Science Society, ISSN 1069-7977 ; 46
Keywords [en]
Metaphor, Large language models, Natural language processing
National Category
Psychology (excluding Applied Psychology)
Identifiers
URN: urn:nbn:se:sh:diva-54382OAI: oai:DiVA.org:sh-54382DiVA, id: diva2:1878283
Conference
The 46th Annual Meeting of the Cognitive Science Society, Rotterdam, July 24-27, 2024.
Available from: 2024-06-26 Created: 2024-06-26 Last updated: 2024-06-27Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full text

Authority records

Stamenković, Dušan

Search in DiVA

By author/editor
Ichien, NicholasStamenković, DušanHolyoak, Keith J.
By organisation
English language
Psychology (excluding Applied Psychology)

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 31 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • harvard-anglia-ruskin-university
  • apa-old-doi-prefix.csl
  • sodertorns-hogskola-harvard.csl
  • sodertorns-hogskola-oxford.csl
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf