Choice-75: A Dataset on Decision Branching in Script Learning

09/21/2023
by   Zhaoyi Joey Hou, et al.
0

Script learning studies how daily events unfold. Previous works tend to consider a script as a linear sequence of events while ignoring the potential branches that arise due to people's circumstantial choices. We hence propose Choice-75, the first benchmark that challenges intelligent systems to predict decisions given descriptive scenarios, containing 75 scripts and more than 600 scenarios. While large language models demonstrate overall decent performances, there is still notable room for improvement in many hard scenarios.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset