ChatGPT bot passes law school exam

A chatbot that draws on massive amounts of data from the internet wrote essays on topics ranging from constitutional law to taxation to tort before passing exams at US law schools.

OpenAI’s ChatGPT – US Company of the Week Got a huge cash injection from Microsoft – Use artificial intelligence (AI) to generate streams of text from simple prompts.

The results have been so positive that educators warn that it could lead to widespread cheating and even signal the end of traditional classroom teaching methods.

Jonathan Choi, a professor at the University of Minnesota Law School, gave the same test that students face on ChatGPT.

In a white paper titled “ChatGPT Goes to Law School,” published Monday, he and his co-authors reported that the bot earned a C+ overall.

This was good enough to pass, but Bot was near the bottom of his class in most subjects and was “bombed” with multiple choice questions on math.

“In writing the essay, ChatGPT had a solid grasp of basic legal rules and consistently had a solid organization and structure,” the authors wrote.

However, the bot “often struggled to find questions when given open-ended prompts, a core skill in law school exams.”

Authorities in New York and other jurisdictions have banned the use of ChatGPT in schools, but Choi suggests that ChatGPT could be a valuable educational aid.

“Overall, ChatGPT was not a good law student acting alone,” he wrote on Twitter.

“But we expect language models like ChatGPT to be very helpful to law students and practicing lawyers taking exams by working with humans.”

It also downplayed the possibility of fraud, writing in a reply to another Twitter user that 2 out of 3 markers had found the paper written by the bot.

“ChatGPT had perfect grammar and was somewhat repetitive, so[they]had a hunch, and they were right,” writes Choi.