[SIGCIS-Members] ChatGPT’s Astonishing Fabrications about Percy Ludgate

[herbert.bruderer at bluewin.ch]

Hi Brian:

Many thanks. That is very interesting.
Microsoft Bing (with AI) also produces a lot of nonsense.

http://dx.doi.org/10.13140/RG.2.2.10461.90087 

Best,
Herbert


----Ursprüngliche Nachricht----
Von : members at lists.sigcis.org
Datum : 08/05/2023 - 23:00 (MS)
An : members at lists.sigcis.org
Cc : Brian.Coghlan at tcd.ie
Betreff : [SIGCIS-Members] ChatGPT’s Astonishing Fabrications about Percy Ludgate

Hi:

Motivated by the extensive publicity and excitement about the new AI chatbot ChatGPT, a tool for answering natural language queries across numerous domains, I and colleagues undertook a brief assessment of its ability to answer questions on a computer history topic. To our astonishment ChatGPT responded with 48% fake facts to the twelve questions we posed it!  
A brief account of our assessment has just been accepted for publication by the IEEE Annals of the History of Computing. The full details of the assessment are to be found in the report “ChatGPT’s Astonishing Fabrications about Percy Ludgate” by Brian Coghlan, Noel O'Boyle and myself - available online at https://tinyurl.com/383pbuwb .

Cheers

Brian Randell

_______________________________________________
This email is relayed from members at sigcis.org, the email discussion list of SHOT SIGCIS. Opinions expressed here are those of the member posting and are not reviewed, edited, or endorsed by SIGCIS. The list archives are at http://lists.sigcis.org/pipermail/members-sigcis.org/ and you can change your subscription options at http://lists.sigcis.org/listinfo.cgi/members-sigcis.org