Autori
Frau, Federico
Bambini, Valentina
Barattieri di San Pietro, Chiara
Mangiaterra, Veronica

Titolo
The pragmatic profile of ChatGPT: Assessing the communicative skills of a conversational agent
Periodico
Sistemi intelligenti
Anno: 2023 - Fascicolo: 2 - Pagina iniziale: 379 - Pagina finale: 400

This study examines the pragmatic abilities of OpenAI’s ChatGPT, a conversational agent based on the multi-layer Transformer network GPT-3.5. To do so, we administered a language battery to assess expressive and receptive pragmatic skills and compared the results with human performance. ChatGPT results were mostly human-like but revealed weaknesses in the domains of the Gricean maxim of quantity, text-based inferences, physical metaphors, and humor comprehension. On the one hand, these findings suggest that at least part of the linguistic pragmatic competence, as evaluated via current assessment tools, might be distributionally encoded in language. On the other hand, situated and meta-representational aspects of pragmatic inferencing appear to be not yet fully accounted for in LLMs.



SICI: 1120-9550(2023)2<379:TPPOCA>2.0.ZU;2-S
Testo completo: https://www.rivisteweb.it/download/article/10.1422/108136
Testo completo alternativo: https://www.rivisteweb.it/doi/10.1422/108136

Esportazione dati in Refworks (solo per utenti abilitati)

Biblioteche ACNP che possiedono il periodico