참고자료:
일반 텍스트
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:inquisitive_qg/plain_text')
- 설명 :
A dataset of about 20k questions that are elicited from readers as they naturally read through a document sentence by sentence. Compared to existing datasets, INQUISITIVE questions target more towards high-level (semantic and discourse) comprehension of text. Because these questions are generated while the readers are pro-cessing the information, the questions directly communicate gaps between the reader’s and writer’s knowledge about the events described in the text, and are not necessarily answered in the document itself. This type of question reflects a real-world scenario: if one has questions during reading, some of them are answered by the text later on, the rest are not, but any of them would help further the reader’s understanding at the particular point when they asked it. This resource could enable question generation models to simulate human-like curiosity and cognitive processing, which may open up a new realm of applications.
- 라이센스 : 알려진 라이센스 없음
- 버전 : 1.0.0
- 분할 :
| 나뉘다 | 예 |
|---|---|
'test' | 1894년 |
'train' | 15931 |
'validation' | 1991년 |
- 특징 :
{
"id": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"article_id": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"article": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"sentence_id": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"sentence": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"span": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"span_start_position": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"span_end_position": {
"dtype": "int32",
"id": null,
"_type": "Value"
}
}