[SIGCIS-Members] ChatGPT’s Astonishing Fabrications about Percy Ludgate

[Julie Cohn]

Thanks, Brian. But … how do we deconstruct a “fake fact”??? 😉

Great article!
Julie Cohn, Ph.D.

Non-Resident Scholar, Center for Energy Studies
Baker Institute for Public Policy, Rice University, and
Research Historian, Center for Public History
University of Houston

email: cohnconnor at gmail.com
cell: 713.516.0849

Author: The Grid: Biography of an American Technology (MIT Press, 2017)
https://mitpress.mit.edu/books/grid


> On May 8, 2023, at 4:00 PM, Brian Randell via Members <members at lists.sigcis.org> wrote:
> 
> Hi:
> 
> Motivated by the extensive publicity and excitement about the new AI chatbot ChatGPT, a tool for answering natural language queries across numerous domains, I and colleagues undertook a brief assessment of its ability to answer questions on a computer history topic. To our astonishment ChatGPT responded with 48% fake facts to the twelve questions we posed it!  
> A brief account of our assessment has just been accepted for publication by the IEEE Annals of the History of Computing. The full details of the assessment are to be found in the report “ChatGPT’s Astonishing Fabrications about Percy Ludgate” by Brian Coghlan, Noel O'Boyle and myself - available online at https://tinyurl.com/383pbuwb .
> 
> Cheers
> 
> Brian Randell
> 
> _______________________________________________
> This email is relayed from members at sigcis.org, the email discussion list of SHOT SIGCIS. Opinions expressed here are those of the member posting and are not reviewed, edited, or endorsed by SIGCIS. The list archives are at http://lists.sigcis.org/pipermail/members-sigcis.org/ and you can change your subscription options at http://lists.sigcis.org/listinfo.cgi/members-sigcis.org

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.sigcis.org/pipermail/members-sigcis.org/attachments/20230508/6e90f47f/attachment.htm>