sh.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • harvard-anglia-ruskin-university
  • apa-old-doi-prefix.csl
  • sodertorns-hogskola-harvard.csl
  • sodertorns-hogskola-oxford.csl
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
The GenAI4IDN Benchmark 2.0 - AI-Assisted Assessment of Generative AI Tools for the Design of Interactive Digital Narratives
Södertörn University, School of Natural Sciences, Technology and Environmental Studies, Media Technology.ORCID iD: 0000-0002-3390-831x
Saint Martin’s Institute of Higher Education, Malta.ORCID iD: 0000-0001-6207-170X
Stockholm University, Sweden.ORCID iD: 0000-0002-1444-5997
2026 (English)In: Interactive Storytelling: 18th International Conference on Interactive Digital Storytelling, ICIDS 2025, Saint Julian, Malta, December 1–5, 2025, Proceedings, Part I / [ed] Reyes, M.C.; Nack, F., Cham: Springer, 2026, p. 254-279Conference paper, Published paper (Refereed)
Abstract [en]

Where do generative AI (GenAI) tools stand in 2025 when it comes to the design of Interactive Digital Narratives (IDNs)? In 2024, we introduced a first effort in benchmarking GenAI tools for IDN design [14]. This paper updates the findings for the current generation of previously evaluated tools (ChatGPT, Claude, Gemini, Copilot), and also adds several open source entries such as DeepSeek, Llama, Mistral, and Qwen. We introduce two key additions to the GenAI4IDN benchmarking framework: methods to benchmark iterative prompting and the effects of contextualized prompting. Furthermore, we introduce and apply a method for AI-assisted evaluation, facilitating rapid evaluation of large amounts of IDN design artifacts with a level of quality similar to human raters.

Place, publisher, year, edition, pages
Cham: Springer, 2026. p. 254-279
Series
Lecture Notes in Computer Science, ISSN 0302-9743, E-ISSN 1611-3349 ; 16374
Keywords [en]
AI-assisted evaluation, contextualized prompting, GenAI tools, IDN benchmarking, interactive digital narrative design, interactive storytelling theory and design, iterative prompting, method, Benchmarking, Design, Human computer interaction, Generative AI tool, Interactive digital narrative benchmarking, Interactive digital narratives, Interactive storytelling, Narrative designs, Theory and designs, Iterative methods
National Category
Information Systems
Identifiers
URN: urn:nbn:se:sh:diva-58808DOI: 10.1007/978-3-032-12408-1_14Scopus ID: 2-s2.0-105023835721ISBN: 978-3-032-12407-4 (print)ISBN: 978-3-032-12408-1 (electronic)OAI: oai:DiVA.org:sh-58808DiVA, id: diva2:2027006
Conference
ICIDS 2025, Saint Julian, Malta, December 1–5, 2025.
Available from: 2026-01-12 Created: 2026-01-12 Last updated: 2026-01-12Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Koenitz, HartmutEladhari, Mirjam Palosaari

Search in DiVA

By author/editor
Koenitz, HartmutBarbara, J.Eladhari, Mirjam Palosaari
By organisation
Media Technology
Information Systems

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 7 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • harvard-anglia-ruskin-university
  • apa-old-doi-prefix.csl
  • sodertorns-hogskola-harvard.csl
  • sodertorns-hogskola-oxford.csl
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf