참고자료:
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:time_dial')
- 설명 :
TimeDial presents a crowdsourced English challenge set, for temporal commonsense reasoning, formulated
as a multiple choice cloze task with around 1.5k carefully curated dialogs. The dataset is derived from
the DailyDialog (Li et al., 2017), which is a multi-turn dialog corpus.
In order to establish strong baselines and provide information on future model development, we
conducted extensive experiments with state-of-the-art LMs. While humans can easily answer these
questions (97.8%), the best T5 model variant struggles on this challenge set (73%). Moreover, our
qualitative error analyses show that the models often rely on shallow, spurious features (particularly text
matching), instead of truly doing reasoning over the context.
- 라이선스 : TimeDial 데이터세트는 CC BY-NC-SA 4.0에 따라 라이선스가 부여됩니다.
- 버전 : 1.1.0
- 분할 :
| 나뉘다 | 예 |
|---|---|
'test' | 1446 |
- 특징 :
{
"id": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"conversation": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"correct1": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"correct2": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"incorrect1": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"incorrect1_rule": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"incorrect2": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"incorrect2_rule": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}