মাল্টি_প্যারা_ক্রল

তথ্যসূত্র:

• কোড
• আলিঙ্গন মুখ

cs- হয়

TFDS এ এই ডেটাসেট লোড করতে নিম্নলিখিত কমান্ডটি ব্যবহার করুন:

ds = tfds.load('huggingface:multi_para_crawl/cs-is')

• বর্ণনা :

Parallel corpora from Web Crawls collected in the ParaCrawl project and further processed for making it a multi-parallel corpus by pivoting via English. Here we only provide the additional language pairs that came out of pivoting. The bitexts for English are available from the ParaCrawl release.
40 languages, 669 bitexts
total number of files: 40
total number of tokens: 10.14G
total number of sentence fragments: 505.48M

Please, acknowledge the ParaCrawl project at http://paracrawl.eu. This version is derived from the original release at their website adjusted for redistribution via the OPUS corpus collection. Please, acknowledge OPUS as well for this service.

• লাইসেন্স : কোনো পরিচিত লাইসেন্স নেই
• সংস্করণ : 7.1.0
• বিভাজন :

বিভক্ত	উদাহরণ
'train'	691006

• বৈশিষ্ট্য :

{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "translation": {
        "languages": [
            "cs",
            "is"
        ],
        "id": null,
        "_type": "Translation"
    }
}

ga-sk

TFDS এ এই ডেটাসেট লোড করতে নিম্নলিখিত কমান্ডটি ব্যবহার করুন:

ds = tfds.load('huggingface:multi_para_crawl/ga-sk')

• বর্ণনা :

Parallel corpora from Web Crawls collected in the ParaCrawl project and further processed for making it a multi-parallel corpus by pivoting via English. Here we only provide the additional language pairs that came out of pivoting. The bitexts for English are available from the ParaCrawl release.
40 languages, 669 bitexts
total number of files: 40
total number of tokens: 10.14G
total number of sentence fragments: 505.48M

Please, acknowledge the ParaCrawl project at http://paracrawl.eu. This version is derived from the original release at their website adjusted for redistribution via the OPUS corpus collection. Please, acknowledge OPUS as well for this service.

• লাইসেন্স : কোনো পরিচিত লাইসেন্স নেই
• সংস্করণ : 7.1.0
• বিভাজন :

বিভক্ত	উদাহরণ
'train'	390327

• বৈশিষ্ট্য :

{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "translation": {
        "languages": [
            "ga",
            "sk"
        ],
        "id": null,
        "_type": "Translation"
    }
}

lv-mt

TFDS এ এই ডেটাসেট লোড করতে নিম্নলিখিত কমান্ডটি ব্যবহার করুন:

ds = tfds.load('huggingface:multi_para_crawl/lv-mt')

• বর্ণনা :

Parallel corpora from Web Crawls collected in the ParaCrawl project and further processed for making it a multi-parallel corpus by pivoting via English. Here we only provide the additional language pairs that came out of pivoting. The bitexts for English are available from the ParaCrawl release.
40 languages, 669 bitexts
total number of files: 40
total number of tokens: 10.14G
total number of sentence fragments: 505.48M

Please, acknowledge the ParaCrawl project at http://paracrawl.eu. This version is derived from the original release at their website adjusted for redistribution via the OPUS corpus collection. Please, acknowledge OPUS as well for this service.

• লাইসেন্স : কোনো পরিচিত লাইসেন্স নেই
• সংস্করণ : 7.1.0
• বিভাজন :

বিভক্ত	উদাহরণ
'train'	464160

• বৈশিষ্ট্য :

{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "translation": {
        "languages": [
            "lv",
            "mt"
        ],
        "id": null,
        "_type": "Translation"
    }
}

nb-ru

TFDS এ এই ডেটাসেট লোড করতে নিম্নলিখিত কমান্ডটি ব্যবহার করুন:

ds = tfds.load('huggingface:multi_para_crawl/nb-ru')

• বর্ণনা :

Parallel corpora from Web Crawls collected in the ParaCrawl project and further processed for making it a multi-parallel corpus by pivoting via English. Here we only provide the additional language pairs that came out of pivoting. The bitexts for English are available from the ParaCrawl release.
40 languages, 669 bitexts
total number of files: 40
total number of tokens: 10.14G
total number of sentence fragments: 505.48M

Please, acknowledge the ParaCrawl project at http://paracrawl.eu. This version is derived from the original release at their website adjusted for redistribution via the OPUS corpus collection. Please, acknowledge OPUS as well for this service.

• লাইসেন্স : কোনো পরিচিত লাইসেন্স নেই
• সংস্করণ : 7.1.0
• বিভাজন :

বিভক্ত	উদাহরণ
'train'	399050

• বৈশিষ্ট্য :

{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "translation": {
        "languages": [
            "nb",
            "ru"
        ],
        "id": null,
        "_type": "Translation"
    }
}

ডি-টিএল

TFDS এ এই ডেটাসেট লোড করতে নিম্নলিখিত কমান্ডটি ব্যবহার করুন:

ds = tfds.load('huggingface:multi_para_crawl/de-tl')

• বর্ণনা :

Parallel corpora from Web Crawls collected in the ParaCrawl project and further processed for making it a multi-parallel corpus by pivoting via English. Here we only provide the additional language pairs that came out of pivoting. The bitexts for English are available from the ParaCrawl release.
40 languages, 669 bitexts
total number of files: 40
total number of tokens: 10.14G
total number of sentence fragments: 505.48M

Please, acknowledge the ParaCrawl project at http://paracrawl.eu. This version is derived from the original release at their website adjusted for redistribution via the OPUS corpus collection. Please, acknowledge OPUS as well for this service.

• লাইসেন্স : কোনো পরিচিত লাইসেন্স নেই
• সংস্করণ : 7.1.0
• বিভাজন :

বিভক্ত	উদাহরণ
'train'	98156

• বৈশিষ্ট্য :

{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "translation": {
        "languages": [
            "de",
            "tl"
        ],
        "id": null,
        "_type": "Translation"
    }
}