kilt_tasks

Tài liệu tham khảo:

triviaqa_support_only

Sử dụng lệnh sau để tải tập dữ liệu này trong TFDS:

ds = tfds.load('huggingface:kilt_tasks/triviaqa_support_only')
  • Sự miêu tả :
KILT tasks training and evaluation data.
- [FEVER](https://fever.ai) | Fact Checking | fever
- [AIDA CoNLL-YAGO](https://www.mpi-inf.mpg.de/departments/databases-and-information-systems/research/ambiverse-nlu/aida/downloads) | Entity Linking | aidayago2
- [WNED-WIKI](https://github.com/U-Alberta/wned) | Entity Linking | wned
- [WNED-CWEB](https://github.com/U-Alberta/wned) | Entity Linking | cweb
- [T-REx](https://hadyelsahar.github.io/t-rex) | Slot Filling | trex
- [Zero-Shot RE](http://nlp.cs.washington.edu/zeroshot) | Slot Filling | structured_zeroshot
- [Natural Questions](https://ai.google.com/research/NaturalQuestions) | Open Domain QA  | nq
- [HotpotQA](https://hotpotqa.github.io) | Open Domain QA | hotpotqa
- [TriviaQA](http://nlp.cs.washington.edu/triviaqa) | Open Domain QA | triviaqa
- [ELI5](https://facebookresearch.github.io/ELI5/explore.html) | Open Domain QA | eli5
- [Wizard of Wikipedia](https://parl.ai/projects/wizard_of_wikipedia) | Dialogue | wow

To finish linking TriviaQA questions to the IDs provided, follow the instructions [here](http://github.com/huggingface/datasets/datasets/kilt_tasks/README.md).
  • Giấy phép : Không có giấy phép được biết đến
  • Phiên bản : 1.0.0
  • Chia tách :
Tách ra Ví dụ
'test' 6586
'train' 61844
'validation' 5359
  • Đặc trưng :
{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "input": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "meta": {
        "left_context": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "mention": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "right_context": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "partial_evidence": [
            {
                "start_paragraph_id": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "end_paragraph_id": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "title": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "section": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "wikipedia_id": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "meta": {
                    "evidence_span": [
                        {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        }
                    ]
                }
            }
        ],
        "obj_surface": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "sub_surface": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "subj_aliases": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "template_questions": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ]
    },
    "output": [
        {
            "answer": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            },
            "meta": {
                "score": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                }
            },
            "provenance": [
                {
                    "bleu_score": {
                        "dtype": "float32",
                        "id": null,
                        "_type": "Value"
                    },
                    "start_character": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "start_paragraph_id": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "end_character": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "end_paragraph_id": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "meta": {
                        "fever_page_id": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "fever_sentence_id": {
                            "dtype": "int32",
                            "id": null,
                            "_type": "Value"
                        },
                        "annotation_id": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "yes_no_answer": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "evidence_span": [
                            {
                                "dtype": "string",
                                "id": null,
                                "_type": "Value"
                            }
                        ]
                    },
                    "section": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    },
                    "title": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    },
                    "wikipedia_id": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    }
                }
            ]
        }
    ]
}

sốt

Sử dụng lệnh sau để tải tập dữ liệu này trong TFDS:

ds = tfds.load('huggingface:kilt_tasks/fever')
  • Sự miêu tả :
KILT tasks training and evaluation data.
- [FEVER](https://fever.ai) | Fact Checking | fever
- [AIDA CoNLL-YAGO](https://www.mpi-inf.mpg.de/departments/databases-and-information-systems/research/ambiverse-nlu/aida/downloads) | Entity Linking | aidayago2
- [WNED-WIKI](https://github.com/U-Alberta/wned) | Entity Linking | wned
- [WNED-CWEB](https://github.com/U-Alberta/wned) | Entity Linking | cweb
- [T-REx](https://hadyelsahar.github.io/t-rex) | Slot Filling | trex
- [Zero-Shot RE](http://nlp.cs.washington.edu/zeroshot) | Slot Filling | structured_zeroshot
- [Natural Questions](https://ai.google.com/research/NaturalQuestions) | Open Domain QA  | nq
- [HotpotQA](https://hotpotqa.github.io) | Open Domain QA | hotpotqa
- [TriviaQA](http://nlp.cs.washington.edu/triviaqa) | Open Domain QA | triviaqa
- [ELI5](https://facebookresearch.github.io/ELI5/explore.html) | Open Domain QA | eli5
- [Wizard of Wikipedia](https://parl.ai/projects/wizard_of_wikipedia) | Dialogue | wow

To finish linking TriviaQA questions to the IDs provided, follow the instructions [here](http://github.com/huggingface/datasets/datasets/kilt_tasks/README.md).
  • Giấy phép : Không có giấy phép được biết đến
  • Phiên bản : 1.0.0
  • Chia tách :
Tách ra Ví dụ
'test' 10100
'train' 104966
'validation' 10444
  • Đặc trưng :
{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "input": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "meta": {
        "left_context": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "mention": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "right_context": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "partial_evidence": [
            {
                "start_paragraph_id": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "end_paragraph_id": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "title": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "section": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "wikipedia_id": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "meta": {
                    "evidence_span": [
                        {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        }
                    ]
                }
            }
        ],
        "obj_surface": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "sub_surface": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "subj_aliases": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "template_questions": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ]
    },
    "output": [
        {
            "answer": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            },
            "meta": {
                "score": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                }
            },
            "provenance": [
                {
                    "bleu_score": {
                        "dtype": "float32",
                        "id": null,
                        "_type": "Value"
                    },
                    "start_character": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "start_paragraph_id": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "end_character": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "end_paragraph_id": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "meta": {
                        "fever_page_id": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "fever_sentence_id": {
                            "dtype": "int32",
                            "id": null,
                            "_type": "Value"
                        },
                        "annotation_id": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "yes_no_answer": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "evidence_span": [
                            {
                                "dtype": "string",
                                "id": null,
                                "_type": "Value"
                            }
                        ]
                    },
                    "section": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    },
                    "title": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    },
                    "wikipedia_id": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    }
                }
            ]
        }
    ]
}

aidayago2

Sử dụng lệnh sau để tải tập dữ liệu này trong TFDS:

ds = tfds.load('huggingface:kilt_tasks/aidayago2')
  • Sự miêu tả :
KILT tasks training and evaluation data.
- [FEVER](https://fever.ai) | Fact Checking | fever
- [AIDA CoNLL-YAGO](https://www.mpi-inf.mpg.de/departments/databases-and-information-systems/research/ambiverse-nlu/aida/downloads) | Entity Linking | aidayago2
- [WNED-WIKI](https://github.com/U-Alberta/wned) | Entity Linking | wned
- [WNED-CWEB](https://github.com/U-Alberta/wned) | Entity Linking | cweb
- [T-REx](https://hadyelsahar.github.io/t-rex) | Slot Filling | trex
- [Zero-Shot RE](http://nlp.cs.washington.edu/zeroshot) | Slot Filling | structured_zeroshot
- [Natural Questions](https://ai.google.com/research/NaturalQuestions) | Open Domain QA  | nq
- [HotpotQA](https://hotpotqa.github.io) | Open Domain QA | hotpotqa
- [TriviaQA](http://nlp.cs.washington.edu/triviaqa) | Open Domain QA | triviaqa
- [ELI5](https://facebookresearch.github.io/ELI5/explore.html) | Open Domain QA | eli5
- [Wizard of Wikipedia](https://parl.ai/projects/wizard_of_wikipedia) | Dialogue | wow

To finish linking TriviaQA questions to the IDs provided, follow the instructions [here](http://github.com/huggingface/datasets/datasets/kilt_tasks/README.md).
  • Giấy phép : Không có giấy phép được biết đến
  • Phiên bản : 1.0.0
  • Chia tách :
Tách ra Ví dụ
'test' 4463
'train' 18395
'validation' 4784
  • Đặc trưng :
{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "input": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "meta": {
        "left_context": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "mention": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "right_context": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "partial_evidence": [
            {
                "start_paragraph_id": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "end_paragraph_id": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "title": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "section": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "wikipedia_id": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "meta": {
                    "evidence_span": [
                        {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        }
                    ]
                }
            }
        ],
        "obj_surface": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "sub_surface": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "subj_aliases": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "template_questions": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ]
    },
    "output": [
        {
            "answer": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            },
            "meta": {
                "score": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                }
            },
            "provenance": [
                {
                    "bleu_score": {
                        "dtype": "float32",
                        "id": null,
                        "_type": "Value"
                    },
                    "start_character": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "start_paragraph_id": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "end_character": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "end_paragraph_id": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "meta": {
                        "fever_page_id": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "fever_sentence_id": {
                            "dtype": "int32",
                            "id": null,
                            "_type": "Value"
                        },
                        "annotation_id": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "yes_no_answer": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "evidence_span": [
                            {
                                "dtype": "string",
                                "id": null,
                                "_type": "Value"
                            }
                        ]
                    },
                    "section": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    },
                    "title": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    },
                    "wikipedia_id": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    }
                }
            ]
        }
    ]
}

thắng

Sử dụng lệnh sau để tải tập dữ liệu này trong TFDS:

ds = tfds.load('huggingface:kilt_tasks/wned')
  • Sự miêu tả :
KILT tasks training and evaluation data.
- [FEVER](https://fever.ai) | Fact Checking | fever
- [AIDA CoNLL-YAGO](https://www.mpi-inf.mpg.de/departments/databases-and-information-systems/research/ambiverse-nlu/aida/downloads) | Entity Linking | aidayago2
- [WNED-WIKI](https://github.com/U-Alberta/wned) | Entity Linking | wned
- [WNED-CWEB](https://github.com/U-Alberta/wned) | Entity Linking | cweb
- [T-REx](https://hadyelsahar.github.io/t-rex) | Slot Filling | trex
- [Zero-Shot RE](http://nlp.cs.washington.edu/zeroshot) | Slot Filling | structured_zeroshot
- [Natural Questions](https://ai.google.com/research/NaturalQuestions) | Open Domain QA  | nq
- [HotpotQA](https://hotpotqa.github.io) | Open Domain QA | hotpotqa
- [TriviaQA](http://nlp.cs.washington.edu/triviaqa) | Open Domain QA | triviaqa
- [ELI5](https://facebookresearch.github.io/ELI5/explore.html) | Open Domain QA | eli5
- [Wizard of Wikipedia](https://parl.ai/projects/wizard_of_wikipedia) | Dialogue | wow

To finish linking TriviaQA questions to the IDs provided, follow the instructions [here](http://github.com/huggingface/datasets/datasets/kilt_tasks/README.md).
  • Giấy phép : Không có giấy phép được biết đến
  • Phiên bản : 1.0.0
  • Chia tách :
Tách ra Ví dụ
'test' 3376
'validation' 3396
  • Đặc trưng :
{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "input": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "meta": {
        "left_context": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "mention": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "right_context": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "partial_evidence": [
            {
                "start_paragraph_id": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "end_paragraph_id": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "title": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "section": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "wikipedia_id": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "meta": {
                    "evidence_span": [
                        {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        }
                    ]
                }
            }
        ],
        "obj_surface": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "sub_surface": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "subj_aliases": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "template_questions": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ]
    },
    "output": [
        {
            "answer": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            },
            "meta": {
                "score": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                }
            },
            "provenance": [
                {
                    "bleu_score": {
                        "dtype": "float32",
                        "id": null,
                        "_type": "Value"
                    },
                    "start_character": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "start_paragraph_id": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "end_character": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "end_paragraph_id": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "meta": {
                        "fever_page_id": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "fever_sentence_id": {
                            "dtype": "int32",
                            "id": null,
                            "_type": "Value"
                        },
                        "annotation_id": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "yes_no_answer": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "evidence_span": [
                            {
                                "dtype": "string",
                                "id": null,
                                "_type": "Value"
                            }
                        ]
                    },
                    "section": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    },
                    "title": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    },
                    "wikipedia_id": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    }
                }
            ]
        }
    ]
}

mạng

Sử dụng lệnh sau để tải tập dữ liệu này trong TFDS:

ds = tfds.load('huggingface:kilt_tasks/cweb')
  • Sự miêu tả :
KILT tasks training and evaluation data.
- [FEVER](https://fever.ai) | Fact Checking | fever
- [AIDA CoNLL-YAGO](https://www.mpi-inf.mpg.de/departments/databases-and-information-systems/research/ambiverse-nlu/aida/downloads) | Entity Linking | aidayago2
- [WNED-WIKI](https://github.com/U-Alberta/wned) | Entity Linking | wned
- [WNED-CWEB](https://github.com/U-Alberta/wned) | Entity Linking | cweb
- [T-REx](https://hadyelsahar.github.io/t-rex) | Slot Filling | trex
- [Zero-Shot RE](http://nlp.cs.washington.edu/zeroshot) | Slot Filling | structured_zeroshot
- [Natural Questions](https://ai.google.com/research/NaturalQuestions) | Open Domain QA  | nq
- [HotpotQA](https://hotpotqa.github.io) | Open Domain QA | hotpotqa
- [TriviaQA](http://nlp.cs.washington.edu/triviaqa) | Open Domain QA | triviaqa
- [ELI5](https://facebookresearch.github.io/ELI5/explore.html) | Open Domain QA | eli5
- [Wizard of Wikipedia](https://parl.ai/projects/wizard_of_wikipedia) | Dialogue | wow

To finish linking TriviaQA questions to the IDs provided, follow the instructions [here](http://github.com/huggingface/datasets/datasets/kilt_tasks/README.md).
  • Giấy phép : Không có giấy phép được biết đến
  • Phiên bản : 1.0.0
  • Chia tách :
Tách ra Ví dụ
'test' 5543
'validation' 5599
  • Đặc trưng :
{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "input": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "meta": {
        "left_context": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "mention": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "right_context": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "partial_evidence": [
            {
                "start_paragraph_id": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "end_paragraph_id": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "title": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "section": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "wikipedia_id": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "meta": {
                    "evidence_span": [
                        {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        }
                    ]
                }
            }
        ],
        "obj_surface": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "sub_surface": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "subj_aliases": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "template_questions": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ]
    },
    "output": [
        {
            "answer": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            },
            "meta": {
                "score": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                }
            },
            "provenance": [
                {
                    "bleu_score": {
                        "dtype": "float32",
                        "id": null,
                        "_type": "Value"
                    },
                    "start_character": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "start_paragraph_id": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "end_character": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "end_paragraph_id": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "meta": {
                        "fever_page_id": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "fever_sentence_id": {
                            "dtype": "int32",
                            "id": null,
                            "_type": "Value"
                        },
                        "annotation_id": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "yes_no_answer": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "evidence_span": [
                            {
                                "dtype": "string",
                                "id": null,
                                "_type": "Value"
                            }
                        ]
                    },
                    "section": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    },
                    "title": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    },
                    "wikipedia_id": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    }
                }
            ]
        }
    ]
}

trex

Sử dụng lệnh sau để tải tập dữ liệu này trong TFDS:

ds = tfds.load('huggingface:kilt_tasks/trex')
  • Sự miêu tả :
KILT tasks training and evaluation data.
- [FEVER](https://fever.ai) | Fact Checking | fever
- [AIDA CoNLL-YAGO](https://www.mpi-inf.mpg.de/departments/databases-and-information-systems/research/ambiverse-nlu/aida/downloads) | Entity Linking | aidayago2
- [WNED-WIKI](https://github.com/U-Alberta/wned) | Entity Linking | wned
- [WNED-CWEB](https://github.com/U-Alberta/wned) | Entity Linking | cweb
- [T-REx](https://hadyelsahar.github.io/t-rex) | Slot Filling | trex
- [Zero-Shot RE](http://nlp.cs.washington.edu/zeroshot) | Slot Filling | structured_zeroshot
- [Natural Questions](https://ai.google.com/research/NaturalQuestions) | Open Domain QA  | nq
- [HotpotQA](https://hotpotqa.github.io) | Open Domain QA | hotpotqa
- [TriviaQA](http://nlp.cs.washington.edu/triviaqa) | Open Domain QA | triviaqa
- [ELI5](https://facebookresearch.github.io/ELI5/explore.html) | Open Domain QA | eli5
- [Wizard of Wikipedia](https://parl.ai/projects/wizard_of_wikipedia) | Dialogue | wow

To finish linking TriviaQA questions to the IDs provided, follow the instructions [here](http://github.com/huggingface/datasets/datasets/kilt_tasks/README.md).
  • Giấy phép : Không có giấy phép được biết đến
  • Phiên bản : 1.0.0
  • Chia tách :
Tách ra Ví dụ
'test' 5000
'train' 2284168
'validation' 5000
  • Đặc trưng :
{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "input": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "meta": {
        "left_context": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "mention": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "right_context": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "partial_evidence": [
            {
                "start_paragraph_id": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "end_paragraph_id": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "title": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "section": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "wikipedia_id": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "meta": {
                    "evidence_span": [
                        {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        }
                    ]
                }
            }
        ],
        "obj_surface": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "sub_surface": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "subj_aliases": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "template_questions": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ]
    },
    "output": [
        {
            "answer": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            },
            "meta": {
                "score": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                }
            },
            "provenance": [
                {
                    "bleu_score": {
                        "dtype": "float32",
                        "id": null,
                        "_type": "Value"
                    },
                    "start_character": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "start_paragraph_id": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "end_character": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "end_paragraph_id": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "meta": {
                        "fever_page_id": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "fever_sentence_id": {
                            "dtype": "int32",
                            "id": null,
                            "_type": "Value"
                        },
                        "annotation_id": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "yes_no_answer": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "evidence_span": [
                            {
                                "dtype": "string",
                                "id": null,
                                "_type": "Value"
                            }
                        ]
                    },
                    "section": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    },
                    "title": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    },
                    "wikipedia_id": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    }
                }
            ]
        }
    ]
}

có cấu trúc_zeroshot

Sử dụng lệnh sau để tải tập dữ liệu này trong TFDS:

ds = tfds.load('huggingface:kilt_tasks/structured_zeroshot')
  • Sự miêu tả :
KILT tasks training and evaluation data.
- [FEVER](https://fever.ai) | Fact Checking | fever
- [AIDA CoNLL-YAGO](https://www.mpi-inf.mpg.de/departments/databases-and-information-systems/research/ambiverse-nlu/aida/downloads) | Entity Linking | aidayago2
- [WNED-WIKI](https://github.com/U-Alberta/wned) | Entity Linking | wned
- [WNED-CWEB](https://github.com/U-Alberta/wned) | Entity Linking | cweb
- [T-REx](https://hadyelsahar.github.io/t-rex) | Slot Filling | trex
- [Zero-Shot RE](http://nlp.cs.washington.edu/zeroshot) | Slot Filling | structured_zeroshot
- [Natural Questions](https://ai.google.com/research/NaturalQuestions) | Open Domain QA  | nq
- [HotpotQA](https://hotpotqa.github.io) | Open Domain QA | hotpotqa
- [TriviaQA](http://nlp.cs.washington.edu/triviaqa) | Open Domain QA | triviaqa
- [ELI5](https://facebookresearch.github.io/ELI5/explore.html) | Open Domain QA | eli5
- [Wizard of Wikipedia](https://parl.ai/projects/wizard_of_wikipedia) | Dialogue | wow

To finish linking TriviaQA questions to the IDs provided, follow the instructions [here](http://github.com/huggingface/datasets/datasets/kilt_tasks/README.md).
  • Giấy phép : Không có giấy phép được biết đến
  • Phiên bản : 1.0.0
  • Chia tách :
Tách ra Ví dụ
'test' 4966
'train' 147909
'validation' 3724
  • Đặc trưng :
{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "input": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "meta": {
        "left_context": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "mention": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "right_context": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "partial_evidence": [
            {
                "start_paragraph_id": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "end_paragraph_id": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "title": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "section": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "wikipedia_id": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "meta": {
                    "evidence_span": [
                        {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        }
                    ]
                }
            }
        ],
        "obj_surface": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "sub_surface": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "subj_aliases": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "template_questions": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ]
    },
    "output": [
        {
            "answer": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            },
            "meta": {
                "score": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                }
            },
            "provenance": [
                {
                    "bleu_score": {
                        "dtype": "float32",
                        "id": null,
                        "_type": "Value"
                    },
                    "start_character": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "start_paragraph_id": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "end_character": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "end_paragraph_id": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "meta": {
                        "fever_page_id": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "fever_sentence_id": {
                            "dtype": "int32",
                            "id": null,
                            "_type": "Value"
                        },
                        "annotation_id": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "yes_no_answer": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "evidence_span": [
                            {
                                "dtype": "string",
                                "id": null,
                                "_type": "Value"
                            }
                        ]
                    },
                    "section": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    },
                    "title": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    },
                    "wikipedia_id": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    }
                }
            ]
        }
    ]
}

nq

Sử dụng lệnh sau để tải tập dữ liệu này trong TFDS:

ds = tfds.load('huggingface:kilt_tasks/nq')
  • Sự miêu tả :
KILT tasks training and evaluation data.
- [FEVER](https://fever.ai) | Fact Checking | fever
- [AIDA CoNLL-YAGO](https://www.mpi-inf.mpg.de/departments/databases-and-information-systems/research/ambiverse-nlu/aida/downloads) | Entity Linking | aidayago2
- [WNED-WIKI](https://github.com/U-Alberta/wned) | Entity Linking | wned
- [WNED-CWEB](https://github.com/U-Alberta/wned) | Entity Linking | cweb
- [T-REx](https://hadyelsahar.github.io/t-rex) | Slot Filling | trex
- [Zero-Shot RE](http://nlp.cs.washington.edu/zeroshot) | Slot Filling | structured_zeroshot
- [Natural Questions](https://ai.google.com/research/NaturalQuestions) | Open Domain QA  | nq
- [HotpotQA](https://hotpotqa.github.io) | Open Domain QA | hotpotqa
- [TriviaQA](http://nlp.cs.washington.edu/triviaqa) | Open Domain QA | triviaqa
- [ELI5](https://facebookresearch.github.io/ELI5/explore.html) | Open Domain QA | eli5
- [Wizard of Wikipedia](https://parl.ai/projects/wizard_of_wikipedia) | Dialogue | wow

To finish linking TriviaQA questions to the IDs provided, follow the instructions [here](http://github.com/huggingface/datasets/datasets/kilt_tasks/README.md).
  • Giấy phép : Không có giấy phép được biết đến
  • Phiên bản : 1.0.0
  • Chia tách :
Tách ra Ví dụ
'test' 1444
'train' 87372
'validation' 2837
  • Đặc trưng :
{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "input": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "meta": {
        "left_context": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "mention": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "right_context": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "partial_evidence": [
            {
                "start_paragraph_id": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "end_paragraph_id": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "title": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "section": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "wikipedia_id": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "meta": {
                    "evidence_span": [
                        {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        }
                    ]
                }
            }
        ],
        "obj_surface": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "sub_surface": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "subj_aliases": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "template_questions": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ]
    },
    "output": [
        {
            "answer": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            },
            "meta": {
                "score": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                }
            },
            "provenance": [
                {
                    "bleu_score": {
                        "dtype": "float32",
                        "id": null,
                        "_type": "Value"
                    },
                    "start_character": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "start_paragraph_id": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "end_character": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "end_paragraph_id": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "meta": {
                        "fever_page_id": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "fever_sentence_id": {
                            "dtype": "int32",
                            "id": null,
                            "_type": "Value"
                        },
                        "annotation_id": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "yes_no_answer": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "evidence_span": [
                            {
                                "dtype": "string",
                                "id": null,
                                "_type": "Value"
                            }
                        ]
                    },
                    "section": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    },
                    "title": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    },
                    "wikipedia_id": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    }
                }
            ]
        }
    ]
}

món lẩu

Sử dụng lệnh sau để tải tập dữ liệu này trong TFDS:

ds = tfds.load('huggingface:kilt_tasks/hotpotqa')
  • Sự miêu tả :
KILT tasks training and evaluation data.
- [FEVER](https://fever.ai) | Fact Checking | fever
- [AIDA CoNLL-YAGO](https://www.mpi-inf.mpg.de/departments/databases-and-information-systems/research/ambiverse-nlu/aida/downloads) | Entity Linking | aidayago2
- [WNED-WIKI](https://github.com/U-Alberta/wned) | Entity Linking | wned
- [WNED-CWEB](https://github.com/U-Alberta/wned) | Entity Linking | cweb
- [T-REx](https://hadyelsahar.github.io/t-rex) | Slot Filling | trex
- [Zero-Shot RE](http://nlp.cs.washington.edu/zeroshot) | Slot Filling | structured_zeroshot
- [Natural Questions](https://ai.google.com/research/NaturalQuestions) | Open Domain QA  | nq
- [HotpotQA](https://hotpotqa.github.io) | Open Domain QA | hotpotqa
- [TriviaQA](http://nlp.cs.washington.edu/triviaqa) | Open Domain QA | triviaqa
- [ELI5](https://facebookresearch.github.io/ELI5/explore.html) | Open Domain QA | eli5
- [Wizard of Wikipedia](https://parl.ai/projects/wizard_of_wikipedia) | Dialogue | wow

To finish linking TriviaQA questions to the IDs provided, follow the instructions [here](http://github.com/huggingface/datasets/datasets/kilt_tasks/README.md).
  • Giấy phép : Không có giấy phép được biết đến
  • Phiên bản : 1.0.0
  • Chia tách :
Tách ra Ví dụ
'test' 5569
'train' 88869
'validation' 5600
  • Đặc trưng :
{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "input": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "meta": {
        "left_context": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "mention": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "right_context": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "partial_evidence": [
            {
                "start_paragraph_id": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "end_paragraph_id": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "title": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "section": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "wikipedia_id": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "meta": {
                    "evidence_span": [
                        {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        }
                    ]
                }
            }
        ],
        "obj_surface": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "sub_surface": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "subj_aliases": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "template_questions": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ]
    },
    "output": [
        {
            "answer": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            },
            "meta": {
                "score": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                }
            },
            "provenance": [
                {
                    "bleu_score": {
                        "dtype": "float32",
                        "id": null,
                        "_type": "Value"
                    },
                    "start_character": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "start_paragraph_id": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "end_character": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "end_paragraph_id": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "meta": {
                        "fever_page_id": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "fever_sentence_id": {
                            "dtype": "int32",
                            "id": null,
                            "_type": "Value"
                        },
                        "annotation_id": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "yes_no_answer": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "evidence_span": [
                            {
                                "dtype": "string",
                                "id": null,
                                "_type": "Value"
                            }
                        ]
                    },
                    "section": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    },
                    "title": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    },
                    "wikipedia_id": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    }
                }
            ]
        }
    ]
}

eli5

Sử dụng lệnh sau để tải tập dữ liệu này trong TFDS:

ds = tfds.load('huggingface:kilt_tasks/eli5')
  • Sự miêu tả :
KILT tasks training and evaluation data.
- [FEVER](https://fever.ai) | Fact Checking | fever
- [AIDA CoNLL-YAGO](https://www.mpi-inf.mpg.de/departments/databases-and-information-systems/research/ambiverse-nlu/aida/downloads) | Entity Linking | aidayago2
- [WNED-WIKI](https://github.com/U-Alberta/wned) | Entity Linking | wned
- [WNED-CWEB](https://github.com/U-Alberta/wned) | Entity Linking | cweb
- [T-REx](https://hadyelsahar.github.io/t-rex) | Slot Filling | trex
- [Zero-Shot RE](http://nlp.cs.washington.edu/zeroshot) | Slot Filling | structured_zeroshot
- [Natural Questions](https://ai.google.com/research/NaturalQuestions) | Open Domain QA  | nq
- [HotpotQA](https://hotpotqa.github.io) | Open Domain QA | hotpotqa
- [TriviaQA](http://nlp.cs.washington.edu/triviaqa) | Open Domain QA | triviaqa
- [ELI5](https://facebookresearch.github.io/ELI5/explore.html) | Open Domain QA | eli5
- [Wizard of Wikipedia](https://parl.ai/projects/wizard_of_wikipedia) | Dialogue | wow

To finish linking TriviaQA questions to the IDs provided, follow the instructions [here](http://github.com/huggingface/datasets/datasets/kilt_tasks/README.md).
  • Giấy phép : Không có giấy phép được biết đến
  • Phiên bản : 1.0.0
  • Chia tách :
Tách ra Ví dụ
'test' 600
'train' 272634
'validation' 1507
  • Đặc trưng :
{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "input": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "meta": {
        "left_context": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "mention": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "right_context": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "partial_evidence": [
            {
                "start_paragraph_id": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "end_paragraph_id": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "title": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "section": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "wikipedia_id": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "meta": {
                    "evidence_span": [
                        {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        }
                    ]
                }
            }
        ],
        "obj_surface": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "sub_surface": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "subj_aliases": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "template_questions": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ]
    },
    "output": [
        {
            "answer": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            },
            "meta": {
                "score": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                }
            },
            "provenance": [
                {
                    "bleu_score": {
                        "dtype": "float32",
                        "id": null,
                        "_type": "Value"
                    },
                    "start_character": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "start_paragraph_id": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "end_character": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "end_paragraph_id": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "meta": {
                        "fever_page_id": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "fever_sentence_id": {
                            "dtype": "int32",
                            "id": null,
                            "_type": "Value"
                        },
                        "annotation_id": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "yes_no_answer": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "evidence_span": [
                            {
                                "dtype": "string",
                                "id": null,
                                "_type": "Value"
                            }
                        ]
                    },
                    "section": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    },
                    "title": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    },
                    "wikipedia_id": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    }
                }
            ]
        }
    ]
}

Sử dụng lệnh sau để tải tập dữ liệu này trong TFDS:

ds = tfds.load('huggingface:kilt_tasks/wow')
  • Sự miêu tả :
KILT tasks training and evaluation data.
- [FEVER](https://fever.ai) | Fact Checking | fever
- [AIDA CoNLL-YAGO](https://www.mpi-inf.mpg.de/departments/databases-and-information-systems/research/ambiverse-nlu/aida/downloads) | Entity Linking | aidayago2
- [WNED-WIKI](https://github.com/U-Alberta/wned) | Entity Linking | wned
- [WNED-CWEB](https://github.com/U-Alberta/wned) | Entity Linking | cweb
- [T-REx](https://hadyelsahar.github.io/t-rex) | Slot Filling | trex
- [Zero-Shot RE](http://nlp.cs.washington.edu/zeroshot) | Slot Filling | structured_zeroshot
- [Natural Questions](https://ai.google.com/research/NaturalQuestions) | Open Domain QA  | nq
- [HotpotQA](https://hotpotqa.github.io) | Open Domain QA | hotpotqa
- [TriviaQA](http://nlp.cs.washington.edu/triviaqa) | Open Domain QA | triviaqa
- [ELI5](https://facebookresearch.github.io/ELI5/explore.html) | Open Domain QA | eli5
- [Wizard of Wikipedia](https://parl.ai/projects/wizard_of_wikipedia) | Dialogue | wow

To finish linking TriviaQA questions to the IDs provided, follow the instructions [here](http://github.com/huggingface/datasets/datasets/kilt_tasks/README.md).
  • Giấy phép : Không có giấy phép được biết đến
  • Phiên bản : 1.0.0
  • Chia tách :
Tách ra Ví dụ
'test' 2944
'train' 63734
'validation' 3054
  • Đặc trưng :
{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "input": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "meta": {
        "left_context": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "mention": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "right_context": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "partial_evidence": [
            {
                "start_paragraph_id": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "end_paragraph_id": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "title": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "section": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "wikipedia_id": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "meta": {
                    "evidence_span": [
                        {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        }
                    ]
                }
            }
        ],
        "obj_surface": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "sub_surface": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "subj_aliases": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ],
        "template_questions": [
            {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        ]
    },
    "output": [
        {
            "answer": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            },
            "meta": {
                "score": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                }
            },
            "provenance": [
                {
                    "bleu_score": {
                        "dtype": "float32",
                        "id": null,
                        "_type": "Value"
                    },
                    "start_character": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "start_paragraph_id": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "end_character": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "end_paragraph_id": {
                        "dtype": "int32",
                        "id": null,
                        "_type": "Value"
                    },
                    "meta": {
                        "fever_page_id": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "fever_sentence_id": {
                            "dtype": "int32",
                            "id": null,
                            "_type": "Value"
                        },
                        "annotation_id": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "yes_no_answer": {
                            "dtype": "string",
                            "id": null,
                            "_type": "Value"
                        },
                        "evidence_span": [
                            {
                                "dtype": "string",
                                "id": null,
                                "_type": "Value"
                            }
                        ]
                    },
                    "section": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    },
                    "title": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    },
                    "wikipedia_id": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    }
                }
            ]
        }
    ]
}