参考:
dutch_social
使用以下命令在 TFDS 中加载此数据集:
ds = tfds.load('huggingface:dutch_social/dutch_social')
- 说明:
The dataset contains around 271,342 tweets. The tweets are filtered via the official Twitter API to
contain tweets in Dutch language or by users who have specified their location information within Netherlands
geographical boundaries. Using natural language processing we have classified the tweets for their HISCO codes.
If the user has provided their location within Dutch boundaries, we have also classified them to their respective
provinces The objective of this dataset is to make research data available publicly in a FAIR (Findable, Accessible,
Interoperable, Reusable) way. Twitter's Terms of Service Licensed under Attribution-NonCommercial 4.0 International
(CC BY-NC 4.0) (2020-10-27)
- 许可:CC BY-NC 4.0
- 版本:1.0.0
- 拆分:
拆分 | 样本 |
---|---|
'test' |
54268 |
'train' |
162805 |
'validation' |
54269 |
- 特征:
{
"full_text": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"text_translation": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"screen_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"description": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"desc_translation": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"location": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"weekofyear": {
"dtype": "int64",
"id": null,
"_type": "Value"
},
"weekday": {
"dtype": "int64",
"id": null,
"_type": "Value"
},
"month": {
"dtype": "int64",
"id": null,
"_type": "Value"
},
"year": {
"dtype": "int64",
"id": null,
"_type": "Value"
},
"day": {
"dtype": "int64",
"id": null,
"_type": "Value"
},
"point_info": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"point": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"latitude": {
"dtype": "float64",
"id": null,
"_type": "Value"
},
"longitude": {
"dtype": "float64",
"id": null,
"_type": "Value"
},
"altitude": {
"dtype": "float64",
"id": null,
"_type": "Value"
},
"province": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"hisco_standard": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"hisco_code": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"industry": {
"dtype": "bool_",
"id": null,
"_type": "Value"
},
"sentiment_pattern": {
"dtype": "float64",
"id": null,
"_type": "Value"
},
"subjective_pattern": {
"dtype": "float64",
"id": null,
"_type": "Value"
},
"label": {
"num_classes": 3,
"names": [
"neg",
"neu",
"pos"
],
"names_file": null,
"id": null,
"_type": "ClassLabel"
}
}