[SIGCIS-Members] ChatGPT’s Astonishing Fabrications about Percy Ludgate

herbert.bruderer at bluewin.ch herbert.bruderer at bluewin.ch
Tue May 9 06:18:19 PDT 2023

Hi Brian:

Many thanks. That is very interesting.
Microsoft Bing (with AI) also produces a lot of nonsense.



----Ursprüngliche Nachricht----
Von : members at lists.sigcis.org
Datum : 08/05/2023 - 23:00 (MS)
An : members at lists.sigcis.org
Cc : Brian.Coghlan at tcd.ie
Betreff : [SIGCIS-Members] ChatGPT’s Astonishing Fabrications about Percy Ludgate


Motivated by the extensive publicity and excitement about the new AI chatbot ChatGPT, a tool for answering natural language queries across numerous domains, I and colleagues undertook a brief assessment of its ability to answer questions on a computer history topic. To our astonishment ChatGPT responded with 48% fake facts to the twelve questions we posed it!  
A brief account of our assessment has just been accepted for publication by the IEEE Annals of the History of Computing. The full details of the assessment are to be found in the report “ChatGPT’s Astonishing Fabrications about Percy Ludgate” by Brian Coghlan, Noel O'Boyle and myself - available online at https://tinyurl.com/383pbuwb .


Brian Randell

This email is relayed from members at sigcis.org, the email discussion list of SHOT SIGCIS. Opinions expressed here are those of the member posting and are not reviewed, edited, or endorsed by SIGCIS. The list archives are at http://lists.sigcis.org/pipermail/members-sigcis.org/ and you can change your subscription options at http://lists.sigcis.org/listinfo.cgi/members-sigcis.org

More information about the Members mailing list