When prompted to come up with a joke during a study, the chatbot repeated the same 25 jokes over 90% of the time.
German researchers have released a paper that found over 90% of jokes spouted out by ChatGPT 3.5 were the same 25 jokes repeated over and over.
Sophie Jentzsch and Kristian Kersting, from the Insititute for Software Technology, German Aerospace Center (DLR), and Technical University Darmstadt, explored how varied ChatGPT 3.5 (ChatGPT 4.0’s predecessor) was by asking it to tell a joke 1,000 times.
What they found was that “all responses were grammatically correct. Almost all outputs contained exactly one joke. Only the prompt, ‘Do you know any good jokes?’ provoked multiple jokes, leading to 1,008 responded jokes in total.
