c4_wsrs

• Description:

A medical abbreviation expansion dataset which applies web-scale reverse substitution (wsrs) to the C4 dataset, which is a colossal, cleaned version of Common Crawl's web crawl corpus.

The original source is the Common Crawl dataset: https://commoncrawl.org

• Config description: Default C4-WSRS dataset.

• Homepage: https://github.com/google-research/google-research/tree/master/deciphering_clinical_abbreviations

• Source code: tfds.text.c4_wsrs.C4WSRS

• Versions:

  • 1.0.0 (default): Initial release.

• Download size: 143.01 KiB

• Dataset size: 5.84 GiB

• Auto-cached (documentation): No

• Splits:

Split	Examples
'train'	9,575,852
'validation'	991,422

• Feature structure:

FeaturesDict({
    'abbreviated_snippet': Text(shape=(), dtype=string),
    'original_snippet': Text(shape=(), dtype=string),
})

• Feature documentation:

Feature	Class	Shape	Dtype	Description
	FeaturesDict
abbreviated_snippet	Text		string
original_snippet	Text		string

• Supervised keys (See as_supervised doc): None

• Figure (tfds.show_examples): Not supported.

• Examples (tfds.as_dataframe):

• Citation:

c4_wsrs/default (default config)