TBA Law Blog


Posted by: Kate Prince on Jan 31, 2023

Artificial intelligence program ChatGPT received less than mediocre scores recently when asked a series of questions about the U.S. Supreme Court, the ABA Journal reports. SCOTUSblog posed 50 questions to the chatbot, which has made headlines recently for its passing scores on two sections of a practice bar exam. ChatGPT missed 26 of the 50 questions and was outperformed by Google, even though Google can’t generate multiple paragraphs of text or have a conversation like the chatbot can. “ChatGPT’s mistakes varied widely,” SCOTUSblog reports. “Sometimes, it nailed the spirit of the question but misstated a factual detail or two, forcing us to mark the answer incorrect.” Read more ChatGPT’s answers.