TBA Law Blog


Posted by: Paul Burch on Aug 29, 2023

A new study at the University of Minnesota found that low-performing law students scored 45% higher on final exams when given access to artificial intelligence, reports Reuters. Researchers compared the final exam scores of 48 students in two courses: Introduction to American Law and Legal Reasoning and Insurance Law. The students first took the final without AI, then took a different final using GPT-4, the latest large language model from Open AI. They found that GPT-4, which produces human-like text based on user prompts, vastly improved student performance on multiple-choice questions. Higher performing student scores were about 20% lower when using GPT-4. The use of GPT-4 did not improve essay scores in either group.