参考：
discofuse-sport
使用以下命令在 TFDS 中加载此数据集：
ds = tfds.load('huggingface:discofuse/discofuse-sport')
- 说明：
DISCOFUSE is a large scale dataset for discourse-based sentence fusion.
- 许可：无已知许可
- 版本：1.0.0
- 拆分：
| 拆分 | 样本 |
|---|---|
'test' |
445521 |
'train' |
43291020 |
'validation' |
440902 |
- 特征：
{
"connective_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"discourse_type": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"coherent_second_sentence": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"has_coref_type_pronoun": {
"dtype": "float32",
"id": null,
"_type": "Value"
},
"incoherent_first_sentence": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"incoherent_second_sentence": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"has_coref_type_nominal": {
"dtype": "float32",
"id": null,
"_type": "Value"
},
"coherent_first_sentence": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}
discofuse-wikipedia
使用以下命令在 TFDS 中加载此数据集：
ds = tfds.load('huggingface:discofuse/discofuse-wikipedia')
- 说明：
DISCOFUSE is a large scale dataset for discourse-based sentence fusion.
- 许可：无已知许可
- 版本：1.0.0
- 拆分：
| 拆分 | 样本 |
|---|---|
'test' |
163657 |
'train' |
16310585 |
'validation' |
168081 |
- 特征：
{
"connective_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"discourse_type": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"coherent_second_sentence": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"has_coref_type_pronoun": {
"dtype": "float32",
"id": null,
"_type": "Value"
},
"incoherent_first_sentence": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"incoherent_second_sentence": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"has_coref_type_nominal": {
"dtype": "float32",
"id": null,
"_type": "Value"
},
"coherent_first_sentence": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}