bianet

参考:

en_to_ku

使用以下命令在 TFDS 中加载此数据集:

ds = tfds.load('huggingface:bianet/en_to_ku')
  • 说明
A parallel news corpus in Turkish, Kurdish and English.
Bianet collects 3,214 Turkish articles with their sentence-aligned Kurdish or English translations from the Bianet online newspaper.
3 languages, 3 bitexts
total number of files: 6
total number of tokens: 2.25M
total number of sentence fragments: 0.14M
  • 许可:无已知许可
  • 版本:1.0.0
  • 拆分
拆分 样本
'train' 6402
  • 特征
{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "translation": {
        "languages": [
            "en",
            "ku"
        ],
        "id": null,
        "_type": "Translation"
    }
}

en_to_tr

使用以下命令在 TFDS 中加载此数据集:

ds = tfds.load('huggingface:bianet/en_to_tr')
  • 说明
A parallel news corpus in Turkish, Kurdish and English.
Bianet collects 3,214 Turkish articles with their sentence-aligned Kurdish or English translations from the Bianet online newspaper.
3 languages, 3 bitexts
total number of files: 6
total number of tokens: 2.25M
total number of sentence fragments: 0.14M
  • 许可:无已知许可
  • 版本:1.0.0
  • 拆分
拆分 样本
'train' 34770
  • 特征
{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "translation": {
        "languages": [
            "en",
            "tr"
        ],
        "id": null,
        "_type": "Translation"
    }
}

ku_to_tr

使用以下命令在 TFDS 中加载此数据集:

ds = tfds.load('huggingface:bianet/ku_to_tr')
  • 说明
A parallel news corpus in Turkish, Kurdish and English.
Bianet collects 3,214 Turkish articles with their sentence-aligned Kurdish or English translations from the Bianet online newspaper.
3 languages, 3 bitexts
total number of files: 6
total number of tokens: 2.25M
total number of sentence fragments: 0.14M
  • 许可:无已知许可
  • 版本:1.0.0
  • 拆分
拆分 样本
'train' 7325
  • 特征
{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "translation": {
        "languages": [
            "ku",
            "tr"
        ],
        "id": null,
        "_type": "Translation"
    }
}