참고자료:
아라비아 말
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:wiki_lingua/arabic')
- 설명 :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- 라이센스 : CC BY-NC-SA 3.0
- 버전 : 1.1.1
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 9995 |
- 특징 :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
중국인
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:wiki_lingua/chinese')
- 설명 :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- 라이센스 : CC BY-NC-SA 3.0
- 버전 : 1.1.1
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 6541 |
- 특징 :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
체코 사람
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:wiki_lingua/czech')
- 설명 :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- 라이센스 : CC BY-NC-SA 3.0
- 버전 : 1.1.1
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 2520 |
- 특징 :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
네덜란드 사람
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:wiki_lingua/dutch')
- 설명 :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- 라이센스 : CC BY-NC-SA 3.0
- 버전 : 1.1.1
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 10862 |
- 특징 :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
영어
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:wiki_lingua/english')
- 설명 :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- 라이센스 : CC BY-NC-SA 3.0
- 버전 : 1.1.1
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 57945 |
- 특징 :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
프랑스 국민
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:wiki_lingua/french')
- 설명 :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- 라이센스 : CC BY-NC-SA 3.0
- 버전 : 1.1.1
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 21690 |
- 특징 :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
독일 사람
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:wiki_lingua/german')
- 설명 :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- 라이센스 : CC BY-NC-SA 3.0
- 버전 : 1.1.1
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 20103 |
- 특징 :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
힌디 어
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:wiki_lingua/hindi')
- 설명 :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- 라이센스 : CC BY-NC-SA 3.0
- 버전 : 1.1.1
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 3402 |
- 특징 :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
인도네시아 인
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:wiki_lingua/indonesian')
- 설명 :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- 라이센스 : CC BY-NC-SA 3.0
- 버전 : 1.1.1
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 16308 |
- 특징 :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
이탈리아 사람
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:wiki_lingua/italian')
- 설명 :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- 라이센스 : CC BY-NC-SA 3.0
- 버전 : 1.1.1
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 17673 |
- 특징 :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
일본어
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:wiki_lingua/japanese')
- 설명 :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- 라이센스 : CC BY-NC-SA 3.0
- 버전 : 1.1.1
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 4372 |
- 특징 :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
한국인
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:wiki_lingua/korean')
- 설명 :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- 라이센스 : CC BY-NC-SA 3.0
- 버전 : 1.1.1
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 4111 |
- 특징 :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
포르투갈 인
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:wiki_lingua/portuguese')
- 설명 :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- 라이센스 : CC BY-NC-SA 3.0
- 버전 : 1.1.1
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 28143 |
- 특징 :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
러시아인
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:wiki_lingua/russian')
- 설명 :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- 라이센스 : CC BY-NC-SA 3.0
- 버전 : 1.1.1
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 18143 |
- 특징 :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
스페인 사람
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:wiki_lingua/spanish')
- 설명 :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- 라이센스 : CC BY-NC-SA 3.0
- 버전 : 1.1.1
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 38795 |
- 특징 :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
태국어
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:wiki_lingua/thai')
- 설명 :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- 라이센스 : CC BY-NC-SA 3.0
- 버전 : 1.1.1
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 5093 |
- 특징 :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
터키 사람
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:wiki_lingua/turkish')
- 설명 :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- 라이센스 : CC BY-NC-SA 3.0
- 버전 : 1.1.1
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 1512 |
- 특징 :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
베트남 사람
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:wiki_lingua/vietnamese')
- 설명 :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- 라이센스 : CC BY-NC-SA 3.0
- 버전 : 1.1.1
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 6616 |
- 특징 :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}