Referências:
tâmil
Use o seguinte comando para carregar este conjunto de dados no TFDS:
ds = tfds.load('huggingface:offenseval_dravidian/tamil')
- Descrição :
Offensive language identification in dravidian lanaguages dataset. The goal of this task is to identify offensive language content of the code-mixed dataset of comments/posts in Dravidian Languages ( (Tamil-English, Malayalam-English, and Kannada-English)) collected from social media.
- Licença : Licença Creative Commons Atribuição 4.0 Internacional
- Versão : 1.0.0
- Divisões :
| Dividir | Exemplos |
|---|---|
'train' | 35139 |
'validation' | 4388 |
- Características :
{
"text": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"label": {
"num_classes": 6,
"names": [
"Not_offensive",
"Offensive_Untargetede",
"Offensive_Targeted_Insult_Individual",
"Offensive_Targeted_Insult_Group",
"Offensive_Targeted_Insult_Other",
"not-Tamil"
],
"names_file": null,
"id": null,
"_type": "ClassLabel"
}
}
malaiala
Use o seguinte comando para carregar este conjunto de dados no TFDS:
ds = tfds.load('huggingface:offenseval_dravidian/malayalam')
- Descrição :
Offensive language identification in dravidian lanaguages dataset. The goal of this task is to identify offensive language content of the code-mixed dataset of comments/posts in Dravidian Languages ( (Tamil-English, Malayalam-English, and Kannada-English)) collected from social media.
- Licença : Licença Creative Commons Atribuição 4.0 Internacional
- Versão : 1.0.0
- Divisões :
| Dividir | Exemplos |
|---|---|
'train' | 16010 |
'validation' | 1999 |
- Características :
{
"text": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"label": {
"num_classes": 6,
"names": [
"Not_offensive",
"Offensive_Untargetede",
"Offensive_Targeted_Insult_Individual",
"Offensive_Targeted_Insult_Group",
"Offensive_Targeted_Insult_Other",
"not-malayalam"
],
"names_file": null,
"id": null,
"_type": "ClassLabel"
}
}
Kannada
Use o seguinte comando para carregar este conjunto de dados no TFDS:
ds = tfds.load('huggingface:offenseval_dravidian/kannada')
- Descrição :
Offensive language identification in dravidian lanaguages dataset. The goal of this task is to identify offensive language content of the code-mixed dataset of comments/posts in Dravidian Languages ( (Tamil-English, Malayalam-English, and Kannada-English)) collected from social media.
- Licença : Licença Creative Commons Atribuição 4.0 Internacional
- Versão : 1.0.0
- Divisões :
| Dividir | Exemplos |
|---|---|
'train' | 6217 |
'validation' | 777 |
- Características :
{
"text": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"label": {
"num_classes": 6,
"names": [
"Not_offensive",
"Offensive_Untargetede",
"Offensive_Targeted_Insult_Individual",
"Offensive_Targeted_Insult_Group",
"Offensive_Targeted_Insult_Other",
"not-Kannada"
],
"names_file": null,
"id": null,
"_type": "ClassLabel"
}
}