として

参考文献:

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:asnq')
  • 説明
ASNQ is a dataset for answer sentence selection derived from
Google's Natural Questions (NQ) dataset (Kwiatkowski et al. 2019).

Each example contains a question, candidate sentence, label indicating whether or not
the sentence answers the question, and two additional features -- 
sentence_in_long_answer and short_answer_in_sentence indicating whether ot not the 
candidate sentence is contained in the long_answer and if the short_answer is in the candidate sentence.

For more details please see 
https://arxiv.org/pdf/1911.04118.pdf

and 

https://research.google/pubs/pub47761/
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'train' 20377568
'validation' 930062
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "label": {
        "num_classes": 2,
        "names": [
            "neg",
            "pos"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    },
    "sentence_in_long_answer": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "short_answer_in_sentence": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    }
}