thai_toxicity_tweet

مراجع:

• شفرة
• معانقة

thai_تسممية_تغريدة

استخدم الأمر التالي لتحميل مجموعة البيانات هذه في TFDS:

ds = tfds.load('huggingface:thai_toxicity_tweet/thai_toxicity_tweet')

• وصف :

Thai Toxicity Tweet Corpus contains 3,300 tweets annotated by humans with guidelines including a 44-word dictionary.
The author obtained 2,027 and 1,273 toxic and non-toxic tweets, respectively; these were labeled by three annotators. The result of corpus
analysis indicates that tweets that include toxic words are not always toxic. Further, it is more likely that a tweet is toxic, if it contains
toxic words indicating their original meaning. Moreover, disagreements in annotation are primarily because of sarcasm, unclear existing
target, and word sense ambiguity.

Notes from data cleaner: The data is included into [huggingface/datasets](https://www.github.com/huggingface/datasets) in Dec 2020.
By this time, 506 of the tweets are not available publicly anymore. We denote these by `TWEET_NOT_FOUND` in `tweet_text`. 
Processing can be found at [this PR](https://github.com/tmu-nlp/ThaiToxicityTweetCorpus/pull/1).

• الترخيص : لا يوجد ترخيص معروف
• الإصدار : 1.0.0
• الإنشقاقات :

ينقسم	أمثلة
'train'	3300

• سمات :

{
    "tweet_id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "tweet_text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "toxic_votes": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    },
    "nontoxic_votes": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    },
    "is_toxic": {
        "num_classes": 2,
        "names": [
            "neg",
            "pos"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}