참고자료:
일반 텍스트
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:hatexplain/plain_text')
- 설명 :
Hatexplain is the first benchmark hate speech dataset covering multiple aspects of the issue. Each post in the dataset is annotated from three different perspectives: the basic, commonly used 3-class classification (i.e., hate, offensive or normal), the target community (i.e., the community that has been the victim of hate speech/offensive speech in the post), and the rationales, i.e., the portions of the post on which their labelling decision (as hate, offensive or normal) is based.
- 라이센스 : cc-by-4.0
- 버전 : 1.0.0
- 분할 :
| 나뉘다 | 예 |
|---|---|
'test' | 1924년 |
'train' | 15383 |
'validation' | 1922년 |
- 특징 :
{
"id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"annotators": {
"feature": {
"label": {
"num_classes": 3,
"names": [
"hatespeech",
"normal",
"offensive"
],
"names_file": null,
"id": null,
"_type": "ClassLabel"
},
"annotator_id": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"target": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"rationales": {
"feature": {
"feature": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"post_tokens": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}