مراجع:
اسناد-zz_TR
برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:
ds = tfds.load('huggingface:ccaligned_multilingual/documents-zz_TR')
- توضیحات :
CCAligned consists of parallel or comparable web-document pairs in 137 languages aligned with English. These web-document pairs were constructed by performing language identification on raw web-documents, and ensuring corresponding language codes were corresponding in the URLs of web documents. This pattern matching approach yielded more than 100 million aligned documents paired with English. Recognizing that each English document was often aligned to mulitple documents in different target language, we can join on English documents to obtain aligned documents that directly pair two non-English documents (e.g., Arabic-French).
- مجوز : مجوز شناخته شده ای وجود ندارد
- نسخه : 1.0.0
- تقسیم ها :
| تقسیم کنید | نمونه ها |
|---|---|
'train' | 41 |
- ویژگی ها :
{
"Domain": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"Source_URL": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"Target_URL": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"translation": {
"languages": [
"en_XX",
"zz_TR"
],
"id": null,
"_type": "Translation"
}
}
جملات-zz_TR
برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:
ds = tfds.load('huggingface:ccaligned_multilingual/sentences-zz_TR')
- توضیحات :
CCAligned consists of parallel or comparable web-document pairs in 137 languages aligned with English. These web-document pairs were constructed by performing language identification on raw web-documents, and ensuring corresponding language codes were corresponding in the URLs of web documents. This pattern matching approach yielded more than 100 million aligned documents paired with English. Recognizing that each English document was often aligned to mulitple documents in different target language, we can join on English documents to obtain aligned documents that directly pair two non-English documents (e.g., Arabic-French).
- مجوز : مجوز شناخته شده ای وجود ندارد
- نسخه : 1.0.0
- تقسیم ها :
| تقسیم کنید | نمونه ها |
|---|---|
'train' | 34 |
- ویژگی ها :
{
"translation": {
"languages": [
"en_XX",
"zz_TR"
],
"id": null,
"_type": "Translation"
},
"LASER_similarity": {
"dtype": "float32",
"id": null,
"_type": "Value"
}
}
اسناد-tz_MA
برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:
ds = tfds.load('huggingface:ccaligned_multilingual/documents-tz_MA')
- توضیحات :
CCAligned consists of parallel or comparable web-document pairs in 137 languages aligned with English. These web-document pairs were constructed by performing language identification on raw web-documents, and ensuring corresponding language codes were corresponding in the URLs of web documents. This pattern matching approach yielded more than 100 million aligned documents paired with English. Recognizing that each English document was often aligned to mulitple documents in different target language, we can join on English documents to obtain aligned documents that directly pair two non-English documents (e.g., Arabic-French).
- مجوز : مجوز شناخته شده ای وجود ندارد
- نسخه : 1.0.0
- تقسیم ها :
| تقسیم کنید | نمونه ها |
|---|---|
'train' | 4 |
- ویژگی ها :
{
"Domain": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"Source_URL": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"Target_URL": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"translation": {
"languages": [
"en_XX",
"tz_MA"
],
"id": null,
"_type": "Translation"
}
}
جملات-tz_MA
برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:
ds = tfds.load('huggingface:ccaligned_multilingual/sentences-tz_MA')
- توضیحات :
CCAligned consists of parallel or comparable web-document pairs in 137 languages aligned with English. These web-document pairs were constructed by performing language identification on raw web-documents, and ensuring corresponding language codes were corresponding in the URLs of web documents. This pattern matching approach yielded more than 100 million aligned documents paired with English. Recognizing that each English document was often aligned to mulitple documents in different target language, we can join on English documents to obtain aligned documents that directly pair two non-English documents (e.g., Arabic-French).
- مجوز : مجوز شناخته شده ای وجود ندارد
- نسخه : 1.0.0
- تقسیم ها :
| تقسیم کنید | نمونه ها |
|---|---|
'train' | 33 |
- ویژگی ها :
{
"translation": {
"languages": [
"en_XX",
"tz_MA"
],
"id": null,
"_type": "Translation"
},
"LASER_similarity": {
"dtype": "float32",
"id": null,
"_type": "Value"
}
}
اسناد-ak_GH
برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:
ds = tfds.load('huggingface:ccaligned_multilingual/documents-ak_GH')
- توضیحات :
CCAligned consists of parallel or comparable web-document pairs in 137 languages aligned with English. These web-document pairs were constructed by performing language identification on raw web-documents, and ensuring corresponding language codes were corresponding in the URLs of web documents. This pattern matching approach yielded more than 100 million aligned documents paired with English. Recognizing that each English document was often aligned to mulitple documents in different target language, we can join on English documents to obtain aligned documents that directly pair two non-English documents (e.g., Arabic-French).
- مجوز : مجوز شناخته شده ای وجود ندارد
- نسخه : 1.0.0
- تقسیم ها :
| تقسیم کنید | نمونه ها |
|---|---|
'train' | 249 |
- ویژگی ها :
{
"Domain": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"Source_URL": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"Target_URL": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"translation": {
"languages": [
"en_XX",
"ak_GH"
],
"id": null,
"_type": "Translation"
}
}
جملات-ak_GH
برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:
ds = tfds.load('huggingface:ccaligned_multilingual/sentences-ak_GH')
- توضیحات :
CCAligned consists of parallel or comparable web-document pairs in 137 languages aligned with English. These web-document pairs were constructed by performing language identification on raw web-documents, and ensuring corresponding language codes were corresponding in the URLs of web documents. This pattern matching approach yielded more than 100 million aligned documents paired with English. Recognizing that each English document was often aligned to mulitple documents in different target language, we can join on English documents to obtain aligned documents that directly pair two non-English documents (e.g., Arabic-French).
- مجوز : مجوز شناخته شده ای وجود ندارد
- نسخه : 1.0.0
- تقسیم ها :
| تقسیم کنید | نمونه ها |
|---|---|
'train' | 478 |
- ویژگی ها :
{
"translation": {
"languages": [
"en_XX",
"ak_GH"
],
"id": null,
"_type": "Translation"
},
"LASER_similarity": {
"dtype": "float32",
"id": null,
"_type": "Value"
}
}