ChatGPT wrote essays and passed a US Law School exam: see results

0
20

A chatbot powered by masses of data from the internet has passed exams at a US law school after writing essays on topics ranging from constitutional law to taxation and torts.

ChatGPT from OpenAI, an American company that received a huge cash injection from Microsoft this week, uses artificial intelligence (AI) to generate text streams based on simple prompts.

The results are so good that educators have warned it could lead to widespread cheating and even spell the end of traditional classroom teaching methods.

See also  Oppo A78 5G launched for Rs 18,999: Know features, specs and more here

Jonathan Choi, a professor at Minnesota University Law School, gave ChatGPT the same test students face, consisting of 95 multiple choice questions and 12 essay questions.

In a white paper titled “ChatGPT goes to law school,” published Monday, he and his co-authors reported that the bot scored a C+ overall.

While this was enough to pass, the bot was at the bottom of the class in most subjects and “bombed” in multiple choice math questions.

Not a great student

“In essay writing, ChatGPT showed a strong understanding of the basic laws and had consistently solid organization and composition,” the authors wrote.

See also  OnePlus Buds Pro 2 supports Google's Android 13 Spatial Audio feature

But the bot “often had trouble detecting problems when presented with an open-ended prompt, a core skill on law school exams.”

Officials in New York and other jurisdictions have banned the use of ChatGPT in schools, but Choi suggested it could be a valuable teaching aid.

“Overall, ChatGPT was not a great law student acting alone,” he wrote on Twitter.

“But we expect that working with people, language models like ChatGPT would be very helpful for law students taking exams and lawyers in practice.”

See also  Microsoft said to invest $10 billion in OpenAI, other venture companies

And he downplayed the possibility of cheating, writing in response to another Twitter user that two of the three markers had seen the paper written by the bot.

“(They) had a hunch and their hunch was correct, because ChatGPT had perfect grammar and was somewhat repetitive,” Choi wrote.


Affiliate links may be generated automatically – see our ethics statement for details.

.

LEAVE A REPLY

Please enter your comment!
Please enter your name here