Mark Shope (National Yang Ming Chiao Tung University; Indiana University Robert H. McKinney School of Law) has posted “GPT Performance on the Bar Exam in Taiwan” on SSRN. Here is the abstract:
This paper reports the performance of the GPT-4 Model of ChatGPT Plus (“ChatGPT4”) on the multiple-choice section of the 2022 Lawyer’s Bar Exam in Taiwan. ChatGPT4 outperforms approximately half of human test-takers on the multiple-choice section with a score of 342. This score, however, would not advance a test taker to the second and final essay portion of the exam. Therefore, this paper will not include an evaluation of ChatGPT4’s performance on the essay portion of the exam.
AI Law Blawg 