참고자료:
bg-el
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:emea/bg-el')
- 설명 :
This is a parallel corpus made out of PDF documents from the European Medicines Agency. All files are automatically converted from PDF to plain text using pdftotext with the command line arguments -layout -nopgbrk -eol unix. There are some known problems with tables and multi-column layouts - some of them are fixed in the current version.
source: http://www.emea.europa.eu/
22 languages, 231 bitexts
total number of files: 41,957
total number of tokens: 311.65M
total number of sentence fragments: 26.51M
- 라이센스 : 알려진 라이센스 없음
- 버전 : 3.0.0
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 1044065 |
- 특징 :
{
"id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"translation": {
"languages": [
"bg",
"el"
],
"id": null,
"_type": "Translation"
}
}
CS-ET
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:emea/cs-et')
- 설명 :
This is a parallel corpus made out of PDF documents from the European Medicines Agency. All files are automatically converted from PDF to plain text using pdftotext with the command line arguments -layout -nopgbrk -eol unix. There are some known problems with tables and multi-column layouts - some of them are fixed in the current version.
source: http://www.emea.europa.eu/
22 languages, 231 bitexts
total number of files: 41,957
total number of tokens: 311.65M
total number of sentence fragments: 26.51M
- 라이센스 : 알려진 라이센스 없음
- 버전 : 3.0.0
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 1053164 |
- 특징 :
{
"id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"translation": {
"languages": [
"cs",
"et"
],
"id": null,
"_type": "Translation"
}
}
디산
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:emea/de-mt')
- 설명 :
This is a parallel corpus made out of PDF documents from the European Medicines Agency. All files are automatically converted from PDF to plain text using pdftotext with the command line arguments -layout -nopgbrk -eol unix. There are some known problems with tables and multi-column layouts - some of them are fixed in the current version.
source: http://www.emea.europa.eu/
22 languages, 231 bitexts
total number of files: 41,957
total number of tokens: 311.65M
total number of sentence fragments: 26.51M
- 라이센스 : 알려진 라이센스 없음
- 버전 : 3.0.0
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 1000532 |
- 특징 :
{
"id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"translation": {
"languages": [
"de",
"mt"
],
"id": null,
"_type": "Translation"
}
}
fr-sk
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:emea/fr-sk')
- 설명 :
This is a parallel corpus made out of PDF documents from the European Medicines Agency. All files are automatically converted from PDF to plain text using pdftotext with the command line arguments -layout -nopgbrk -eol unix. There are some known problems with tables and multi-column layouts - some of them are fixed in the current version.
source: http://www.emea.europa.eu/
22 languages, 231 bitexts
total number of files: 41,957
total number of tokens: 311.65M
total number of sentence fragments: 26.51M
- 라이센스 : 알려진 라이센스 없음
- 버전 : 3.0.0
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 1062753 |
- 특징 :
{
"id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"translation": {
"languages": [
"fr",
"sk"
],
"id": null,
"_type": "Translation"
}
}
es-lt
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:emea/es-lt')
- 설명 :
This is a parallel corpus made out of PDF documents from the European Medicines Agency. All files are automatically converted from PDF to plain text using pdftotext with the command line arguments -layout -nopgbrk -eol unix. There are some known problems with tables and multi-column layouts - some of them are fixed in the current version.
source: http://www.emea.europa.eu/
22 languages, 231 bitexts
total number of files: 41,957
total number of tokens: 311.65M
total number of sentence fragments: 26.51M
- 라이센스 : 알려진 라이센스 없음
- 버전 : 3.0.0
- 분할 :
| 나뉘다 | 예 |
|---|---|
'train' | 1051370 |
- 특징 :
{
"id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"translation": {
"languages": [
"es",
"lt"
],
"id": null,
"_type": "Translation"
}
}