참고자료:
penn_treebank
TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.
ds = tfds.load('huggingface:ptb_text_only/penn_treebank')
- 설명 :
This is the Penn Treebank Project: Release 2 CDROM, featuring a million words of 1989 Wall Street Journal material. This corpus has been annotated for part-of-speech (POS) information. In addition, over half of it has been annotated for skeletal syntactic structure.
- 라이선스 : 비회원 LDC 이용약관
- 버전 : 1.1.0
- 분할 :
나뉘다 | 예 |
---|---|
'test' | 3761 |
'train' | 42068 |
'validation' | 3370 |
- 특징 :
{
"sentence": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}