اسکار

منابع:

• کد
• صورت در آغوش گرفته

unshuffled_deduplicated_af

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_af')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	130640

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_als

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_als')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	4518

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_arz

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_arz')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	79928

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_an

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_an')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	2025

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ast

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ast')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	5343

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ba

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ba')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	27050

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_am

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_am')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	43102

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_as

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_as')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	9212

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_azb

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_azb')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	9985

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_be

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_be')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	307405

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bo

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bo')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	15762

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bxr

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bxr')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	36

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ceb

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ceb')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	26145

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_az

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_az')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	626796

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bcl

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bcl')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_cy

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_cy')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	98225

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_dsb

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_dsb')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	37

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bn

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bn')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1114481

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bs

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bs')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	702

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ce

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ce')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	2984

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_cv

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_cv')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	10130

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_diq

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_diq')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_eml

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_eml')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	80

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_et

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_et')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1172041

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bg

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bg')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	3398679

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bpy

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bpy')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1770

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ca

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ca')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	2458067

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ckb

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ckb')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	68210

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ar

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ar')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • مطالبی را که ادعا می‌شود نقض‌کننده حقوق است و اطلاعاتی که به‌طور معقولی برای یافتن مطالب به ما امکان می‌دهد، به وضوح شناسایی کنید.

  ما با حذف منابع آسیب‌دیده از نسخه بعدی مجموعه، درخواست‌های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	9006977

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_av

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_av')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح مجوز منتشر می شوند. ما مالک هیچ یک از متن هایی نیستیم که این داده ها از آن استخراج شده است. ما بسته‌بندی واقعی این داده‌ها را تحت مجوز Creative Commons CC0 مجوز می‌دهیم ("بدون حقوق محفوظ است") http://creativecommons.org/publicdomain/zero/1.0/ تا آنجایی که طبق قانون ممکن است، اینریا تمام حق نسخه‌برداری و یا مربوط به آن را لغو کرده است. حقوق همسایگی OSCAR این اثر از: فرانسه منتشر شده است.

  اگر فکر می کنید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا بازتولید شود، لطفاً:

  • با اطلاعات تماس دقیق مانند آدرس، شماره تلفن یا آدرس ایمیلی که می توان با شما تماس گرفت، به وضوح خود را شناسایی کنید.
  • اثر دارای حق نسخه برداری که ادعا می شود نقض شده است را به وضوح شناسایی کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	360

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bar

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bar')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	4

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bh

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bh')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	82

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_br

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_br')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	14724

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplated_cbk

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_cbk')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_da

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_da')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	4771098

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplated_dv

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_dv')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	17024

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_eo

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_eo')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	84752

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplated_fa

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_fa')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	8203495

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_fy

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_fy')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	20661

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_gn

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_gn')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	68

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_cs

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_cs')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	12308039

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_hi

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_hi')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1909387

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplated_hu

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_hu')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	6582908

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ie

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ie')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	11

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_fr

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_fr')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	59448891

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_gd

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_gd')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	3883

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_gu

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_gu')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	169834

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplated_hsb

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_hsb')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	3084

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ia

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ia')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	529

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_io

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_io')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	617

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplated_jbo

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_jbo')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	617

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_km

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_km')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	108346

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ku

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ku')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	29054

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplated_la

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_la')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	18808

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplated_lmo

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_lmo')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1374

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_lv

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_lv')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	843195

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_min

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_min')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	166

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_mr

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mr')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	212556

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplated_mwl

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mwl')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  اگر در نظر بگیرید که داده های ما حاوی مطالبی است که متعلق به شما است و بنابراین نباید در اینجا تکثیر شود ، لطفا:

  • به طور واضح خود را با داده های تماس دقیق مانند آدرس ، شماره تلفن یا آدرس ایمیل که در آن می توانید با شما تماس بگیرید ، شناسایی کنید.
  • به وضوح کار دارای حق چاپ را که ادعا می شود نقض شده است ، مشخص کنید.
  • به روشنی مطالبی را که ادعا می شود نقض و اطلاعات کافی است ، مشخص کنید تا به ما اجازه دهد تا مواد را پیدا کنیم.

  ما با از بین بردن منابع آسیب دیده از انتشار بعدی Corpus ، درخواست های قانونی را رعایت خواهیم کرد.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	7

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplated_nah

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_nah')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• مجوز : این داده ها تحت این طرح صدور مجوز منتشر می شوند ، ما هیچ یک از متنی را که این داده ها از آن استخراج شده است ، نداریم. ما بسته بندی واقعی این داده ها را تحت مجوز Creative Commons CC0 ("هیچ حقوقی محفوظ") مجوز می دهیم. حقوق همسایه اسکار این اثر از: فرانسه منتشر شده است.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	58

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_new

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_new')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	2126

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_oc

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_oc')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	6485

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_pam

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_pam')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ps

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ps')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	67921

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_it

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_it')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	28522082

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ka

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ka')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	372158

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ro

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ro')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	5044757

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_scn

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_scn')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	17

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ko

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ko')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	3675420

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_kw

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_kw')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	68

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_lez

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_lez')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1381

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_lrc

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_lrc')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	72

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_mg

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mg')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	13343

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ml

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ml')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	453904

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ms

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ms')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	183443

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_myv

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_myv')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	5

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_nds

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_nds')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	8714

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_nn

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_nn')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	109118

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_os

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_os')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	2559

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_pms

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_pms')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	2859

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_qu

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_qu')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	411

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sa

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sa')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	7121

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sk

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sk')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	2820821

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sh

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sh')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	17610

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_so

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_so')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	42

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sr

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sr')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	645747

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ta

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ta')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	833101

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_tk

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_tk')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	4694

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_tyv

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_tyv')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	24

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_uz

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_uz')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	15074

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_wa

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_wa')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	677

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_xmf

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_xmf')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	2418

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sv

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sv')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	11014487

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_tg

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_tg')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	56259

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_de

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_de')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	62398034

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_tr

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_tr')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	11596446

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_el

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_el')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	6521169

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_uk

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_uk')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	7782375

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_vi

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_vi')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	9897709

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_wuu

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_wuu')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	64

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_yo

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_yo')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	49

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_als

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_als')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	7324

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_arz

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_arz')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	158113

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_az

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_az')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	912330

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bcl

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_bcl')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bn

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_bn')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1675515

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bs

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_bs')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	2143

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ce

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ce')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	4042

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_cv

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_cv')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	20281

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_diq

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_diq')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_eml

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_eml')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	84

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_et

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_et')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	2093621

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_zh

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_zh')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	41708901

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_an

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_an')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	2449

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ast

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ast')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	6999

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ba

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ba')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	42551

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bg

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_bg')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	5869686

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bpy

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_bpy')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	6046

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ca

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ca')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	4390754

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ckb

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ckb')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	103639

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_es

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_es')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	56326016

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_da

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_da')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	7664010

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_dv

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_dv')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	21018

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_eo

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_eo')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	121168

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_fi

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_fi')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	5326443

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ga

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ga')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	46493

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_gom

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_gom')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	484

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_hr

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_hr')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	321484

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_hy

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_hy')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	396093

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ilo

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ilo')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1578

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_fa

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_fa')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	13704702

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_fy

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_fy')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	33053

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_gn

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_gn')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	106

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_hi

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_hi')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	3264660

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_hu

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_hu')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	11197780

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ie

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ie')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	101

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ja

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ja')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	39496439

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_kk

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_kk')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	338073

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_krc

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_krc')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1377

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ky

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ky')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	86561

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_li

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_li')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	118

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_lt

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_lt')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1737411

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_mhr

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mhr')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	2515

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_mn

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mn')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	197878

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_mt

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mt')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	16383

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_mzn

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mzn')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	917

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ne

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ne')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	219334

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_no

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_no')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	3229940

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_pa

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_pa')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	87235

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_pnb

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_pnb')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	3463

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_rm

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_rm')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	34

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sah

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sah')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	8555

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_si

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_si')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	120684

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sq

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sq')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	461598

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sw

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sw')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	24803

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_th

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_th')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	3749826

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_tt

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_tt')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	82738

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ur

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ur')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	428674

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_vo

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_vo')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	3317

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_xal

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_xal')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	36

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_yue

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_yue')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	7

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_am

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_am')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	83663

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_as

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_as')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	14985

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_azb

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_azb')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	15446

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_be

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_be')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	586031

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bo

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_bo')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	26795

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bxr

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_bxr')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	42

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ceb

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ceb')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	56248

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_cy

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_cy')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	157698

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_dsb

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_dsb')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	65

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_fr

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_fr')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	96742378

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_gd

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_gd')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	5799

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_gu

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_gu')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	240691

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_hsb

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_hsb')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	7959

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ia

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ia')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1040

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_io

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_io')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	694

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_jbo

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_jbo')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	832

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_km

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_km')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	159363

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ku

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ku')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	46535

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_la

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_la')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	94588

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_lmo

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_lmo')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1401

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_lv

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_lv')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1593820

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_min

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_min')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	220

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_mr

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_mr')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	326804

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_mwl

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_mwl')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	8

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_nah

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_nah')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	61

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_new

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_new')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	4696

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_oc

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_oc')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	10709

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_pam

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_pam')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	3

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ps

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ps')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	98216

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ro

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ro')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	9387265

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_scn

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_scn')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	21

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_sk

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_sk')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	5492194

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_sr

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_sr')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1013619

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ta

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ta')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1263280

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_tk

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_tk')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	6456

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_tyv

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_tyv')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	34

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_uz

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_uz')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	27537

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_wa

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_wa')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1001

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_xmf

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_xmf')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	3783

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_it

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_it')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	46981781

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ka

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ka')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	563916

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ko

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ko')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	7345075

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_kw

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_kw')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	203

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_lez

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_lez')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1485

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_lrc

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_lrc')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	88

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_mg

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_mg')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	17957

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ml

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ml')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	603937

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ms

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ms')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	534016

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_myv

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_myv')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	6

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_nds

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_nds')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	18174

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_nn

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_nn')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	185884

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_os

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_os')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	5213

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_pms

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_pms')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	3225

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_qu

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_qu')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	452

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_sa

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_sa')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	14291

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_sh

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_sh')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	36700

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_so

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_so')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	156

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_sv

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_sv')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	17395625

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_tg

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_tg')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	89002

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_tr

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_tr')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	18535253

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_uk

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_uk')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	12973467

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_vi

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_vi')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	14898250

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_wuu

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_wuu')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	214

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_yo

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_yo')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	214

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_zh

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_zh')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	60137667

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_en

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_en')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	304230423

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_eu

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_eu')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	256513

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_frr

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_frr')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	7

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_gl

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_gl')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	284320

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_he

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_he')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	2375030

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ht

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ht')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	9

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_id

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_id')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	9948521

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_is

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_is')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	389515

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_jv

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_jv')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1163

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_kn

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_kn')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	251064

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_kv

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_kv')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	924

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_lb

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_lb')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	21735

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_lo

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_lo')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	32652

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_mai

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mai')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	25

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_mk

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mk')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	299457

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_mrj

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mrj')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	669

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_my

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_my')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	136639

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_nap

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_nap')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	55

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_nl

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_nl')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	20812149

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_or

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_or')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	44230

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_pl

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_pl')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	20682611

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_pt

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_pt')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	26920397

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ru

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ru')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	115954598

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sd

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sd')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	33925

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sl

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sl')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	886223

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_su

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_su')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	511

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_te

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_te')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	312644

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_tl

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_tl')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	294132

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ug

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ug')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	15503

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_vec

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_vec')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	64

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_war

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_war')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	9161

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_yi

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_yi')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	32919

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_af

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_af')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	201117

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ar

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ar')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	16365602

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_av

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_av')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	456

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bar

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_bar')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	4

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bh

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_bh')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	336

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_br

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_br')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	37085

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_cbk

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_cbk')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_cs

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_cs')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	21001388

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_de

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_de')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	104913504

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_el

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_el')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	10425596

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_es

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_es')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	88199221

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_fi

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_fi')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	8557453

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ga

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ga')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	83223

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_gom

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_gom')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	640

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_hr

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_hr')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	582219

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_hy

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_hy')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	659430

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ilo

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ilo')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	2638

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ja

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ja')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	62721527

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_kk

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_kk')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	524591

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_krc

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_krc')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1581

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ky

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ky')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	146993

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_li

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_li')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	137

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_lt

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_lt')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	2977757

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_mhr

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_mhr')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	3212

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_mn

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_mn')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	395605

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_mt

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_mt')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	26598

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_mzn

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_mzn')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1055

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ne

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ne')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	299938

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_no

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_no')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	5546211

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_pa

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_pa')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	127467

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_pnb

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_pnb')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	4599

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_rm

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_rm')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	41

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_sah

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_sah')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	22301

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_si

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_si')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	203082

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_sq

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_sq')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	672077

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_sw

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_sw')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	41986

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_th

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_th')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	6064129

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_tt

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_tt')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	135923

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ur

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ur')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	638596

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_vo

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_vo')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	3366

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_xal

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_xal')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	39

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_yue

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_yue')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	11

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_en

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_en')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	455994980

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_eu

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_eu')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	506883

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_frr

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_frr')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	7

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_gl

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_gl')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	544388

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_he

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_he')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	3808397

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ht

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ht')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	13

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_id

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_id')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	16236463

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_is

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_is')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	625673

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_jv

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_jv')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1445

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_kn

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_kn')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	350363

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_kv

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_kv')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1549

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_lb

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_lb')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	34807

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_lo

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_lo')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	52910

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_mai

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_mai')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	123

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_mk

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_mk')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	437871

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_mrj

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_mrj')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	757

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_my

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_my')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	232329

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_nap

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_nap')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	73

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_nl

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_nl')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	34682142

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_or

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_or')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	59463

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_pl

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_pl')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	35440972

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_pt

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_pt')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	42114520

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ru

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ru')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	161836003

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_sd

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_sd')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	44280

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_sl

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_sl')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	1746604

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_su

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_su')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	805

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_te

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_te')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	475703

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_tl

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_tl')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	458206

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ug

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_ug')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	22255

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_vec

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_vec')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	73

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_war

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_war')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	9760

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_yi

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:oscar/unshuffled_original_yi')

• شرح :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• نسخه : 1.0.0

• تقسیم ها :

شکاف	مثال ها
'train'	59364

• امکانات :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}