参考文献:
ラジコン
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:trivia_qa/rc')
- 説明：
TriviaqQA is a reading comprehension dataset containing over 650K
question-answer-evidence triples. TriviaqQA includes 95K question-answer
pairs authored by trivia enthusiasts and independently gathered evidence
documents, six per question on average, that provide high quality distant
supervision for answering the questions.
- ライセンス: 不明なライセンス
- バージョン: 1.2.0
- 分割:
| スプリット | 例 |
|---|---|
'test' | 17210 |
'train' | 138384 |
'validation' | 17944 |
- 特徴：
{
"question": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"entity_pages": {
"feature": {
"doc_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"wiki_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"search_results": {
"feature": {
"description": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"rank": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"search_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"answer": {
"aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"normalized_aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_value": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"type": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"value": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}
}
rc.nocontext
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:trivia_qa/rc.nocontext')
- 説明：
TriviaqQA is a reading comprehension dataset containing over 650K
question-answer-evidence triples. TriviaqQA includes 95K question-answer
pairs authored by trivia enthusiasts and independently gathered evidence
documents, six per question on average, that provide high quality distant
supervision for answering the questions.
- ライセンス: 不明なライセンス
- バージョン: 1.2.0
- 分割:
| スプリット | 例 |
|---|---|
'test' | 17210 |
'train' | 138384 |
'validation' | 17944 |
- 特徴：
{
"question": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"entity_pages": {
"feature": {
"doc_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"wiki_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"search_results": {
"feature": {
"description": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"rank": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"search_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"answer": {
"aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"normalized_aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_value": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"type": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"value": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}
}
フィルタされていない
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:trivia_qa/unfiltered')
- 説明：
TriviaqQA is a reading comprehension dataset containing over 650K
question-answer-evidence triples. TriviaqQA includes 95K question-answer
pairs authored by trivia enthusiasts and independently gathered evidence
documents, six per question on average, that provide high quality distant
supervision for answering the questions.
- ライセンス: 不明なライセンス
- バージョン: 1.2.0
- 分割:
| スプリット | 例 |
|---|---|
'test' | 10832 |
'train' | 87622 |
'validation' | 11313 |
- 特徴：
{
"question": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"entity_pages": {
"feature": {
"doc_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"wiki_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"search_results": {
"feature": {
"description": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"rank": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"search_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"answer": {
"aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"normalized_aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_value": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"type": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"value": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}
}
フィルターなし.nocontext
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:trivia_qa/unfiltered.nocontext')
- 説明：
TriviaqQA is a reading comprehension dataset containing over 650K
question-answer-evidence triples. TriviaqQA includes 95K question-answer
pairs authored by trivia enthusiasts and independently gathered evidence
documents, six per question on average, that provide high quality distant
supervision for answering the questions.
- ライセンス: 不明なライセンス
- バージョン: 1.2.0
- 分割:
| スプリット | 例 |
|---|---|
'test' | 10832 |
'train' | 87622 |
'validation' | 11313 |
- 特徴：
{
"question": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"entity_pages": {
"feature": {
"doc_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"wiki_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"search_results": {
"feature": {
"description": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"rank": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"search_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"answer": {
"aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"normalized_aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_value": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"type": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"value": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}
}
rc.web
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:trivia_qa/rc.web')
- 説明：
TriviaqQA is a reading comprehension dataset containing over 650K
question-answer-evidence triples. TriviaqQA includes 95K question-answer
pairs authored by trivia enthusiasts and independently gathered evidence
documents, six per question on average, that provide high quality distant
supervision for answering the questions.
- ライセンス: 不明なライセンス
- バージョン: 1.2.0
- 分割:
| スプリット | 例 |
|---|---|
'test' | 9509 |
'train' | 76496 |
'validation' | 9951 |
- 特徴：
{
"question": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"entity_pages": {
"feature": {
"doc_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"wiki_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"search_results": {
"feature": {
"description": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"rank": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"search_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"answer": {
"aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"normalized_aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_value": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"type": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"value": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}
}
rc.web.nocontext
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:trivia_qa/rc.web.nocontext')
- 説明：
TriviaqQA is a reading comprehension dataset containing over 650K
question-answer-evidence triples. TriviaqQA includes 95K question-answer
pairs authored by trivia enthusiasts and independently gathered evidence
documents, six per question on average, that provide high quality distant
supervision for answering the questions.
- ライセンス: 不明なライセンス
- バージョン: 1.2.0
- 分割:
| スプリット | 例 |
|---|---|
'test' | 9509 |
'train' | 76496 |
'validation' | 9951 |
- 特徴：
{
"question": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"entity_pages": {
"feature": {
"doc_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"wiki_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"search_results": {
"feature": {
"description": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"rank": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"search_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"answer": {
"aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"normalized_aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_value": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"type": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"value": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}
}
フィルタリングされていないウェブ
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:trivia_qa/unfiltered.web')
- 説明：
TriviaqQA is a reading comprehension dataset containing over 650K
question-answer-evidence triples. TriviaqQA includes 95K question-answer
pairs authored by trivia enthusiasts and independently gathered evidence
documents, six per question on average, that provide high quality distant
supervision for answering the questions.
- ライセンス: 不明なライセンス
- バージョン: 1.2.0
- 分割:
| スプリット | 例 |
|---|---|
'test' | 0 |
'train' | 0 |
'validation' | 0 |
- 特徴：
{
"question": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"entity_pages": {
"feature": {
"doc_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"wiki_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"search_results": {
"feature": {
"description": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"rank": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"search_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"answer": {
"aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"normalized_aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_value": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"type": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"value": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}
}
unfiltered.web.nocontext
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:trivia_qa/unfiltered.web.nocontext')
- 説明：
TriviaqQA is a reading comprehension dataset containing over 650K
question-answer-evidence triples. TriviaqQA includes 95K question-answer
pairs authored by trivia enthusiasts and independently gathered evidence
documents, six per question on average, that provide high quality distant
supervision for answering the questions.
- ライセンス: 不明なライセンス
- バージョン: 1.2.0
- 分割:
| スプリット | 例 |
|---|---|
'test' | 0 |
'train' | 0 |
'validation' | 0 |
- 特徴：
{
"question": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"entity_pages": {
"feature": {
"doc_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"wiki_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"search_results": {
"feature": {
"description": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"rank": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"search_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"answer": {
"aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"normalized_aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_value": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"type": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"value": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}
}
rc.wikipedia
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:trivia_qa/rc.wikipedia')
- 説明：
TriviaqQA is a reading comprehension dataset containing over 650K
question-answer-evidence triples. TriviaqQA includes 95K question-answer
pairs authored by trivia enthusiasts and independently gathered evidence
documents, six per question on average, that provide high quality distant
supervision for answering the questions.
- ライセンス: 不明なライセンス
- バージョン: 1.2.0
- 分割:
| スプリット | 例 |
|---|---|
'test' | 7701 |
'train' | 61888 |
'validation' | 7993 |
- 特徴：
{
"question": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"entity_pages": {
"feature": {
"doc_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"wiki_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"search_results": {
"feature": {
"description": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"rank": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"search_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"answer": {
"aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"normalized_aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_value": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"type": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"value": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}
}
rc.wikipedia.nocontext
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:trivia_qa/rc.wikipedia.nocontext')
- 説明：
TriviaqQA is a reading comprehension dataset containing over 650K
question-answer-evidence triples. TriviaqQA includes 95K question-answer
pairs authored by trivia enthusiasts and independently gathered evidence
documents, six per question on average, that provide high quality distant
supervision for answering the questions.
- ライセンス: 不明なライセンス
- バージョン: 1.2.0
- 分割:
| スプリット | 例 |
|---|---|
'test' | 7701 |
'train' | 61888 |
'validation' | 7993 |
- 特徴：
{
"question": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"entity_pages": {
"feature": {
"doc_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"wiki_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"search_results": {
"feature": {
"description": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"rank": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"search_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"answer": {
"aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"normalized_aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_value": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"type": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"value": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}
}
フィルタなし.wikipedia
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:trivia_qa/unfiltered.wikipedia')
- 説明：
TriviaqQA is a reading comprehension dataset containing over 650K
question-answer-evidence triples. TriviaqQA includes 95K question-answer
pairs authored by trivia enthusiasts and independently gathered evidence
documents, six per question on average, that provide high quality distant
supervision for answering the questions.
- ライセンス: 不明なライセンス
- バージョン: 1.2.0
- 分割:
| スプリット | 例 |
|---|---|
'test' | 0 |
'train' | 0 |
'validation' | 0 |
- 特徴：
{
"question": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"entity_pages": {
"feature": {
"doc_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"wiki_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"search_results": {
"feature": {
"description": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"rank": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"search_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"answer": {
"aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"normalized_aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_value": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"type": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"value": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}
}
unfiltered.wikipedia.nocontext
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:trivia_qa/unfiltered.wikipedia.nocontext')
- 説明：
TriviaqQA is a reading comprehension dataset containing over 650K
question-answer-evidence triples. TriviaqQA includes 95K question-answer
pairs authored by trivia enthusiasts and independently gathered evidence
documents, six per question on average, that provide high quality distant
supervision for answering the questions.
- ライセンス: 不明なライセンス
- バージョン: 1.2.0
- 分割:
| スプリット | 例 |
|---|---|
'test' | 0 |
'train' | 0 |
'validation' | 0 |
- 特徴：
{
"question": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"entity_pages": {
"feature": {
"doc_source": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"wiki_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"search_results": {
"feature": {
"description": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"filename": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"rank": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"title": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"search_context": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"answer": {
"aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"normalized_aliases": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_matched_wiki_entity_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"normalized_value": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"type": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"value": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}
}