スタイル変更検出

参考文献:

狭い

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:style_change_detection/narrow')
  • 説明
The goal of the style change detection task is to identify text positions within a given multi-author document at which the author switches. Detecting these positions is a crucial part of the authorship identification process, and for multi-author document analysis in general.

Access to the dataset needs to be requested from zenodo.
  • ライセンス: 既知のライセンスはありません
  • バージョン: 1.0.0
  • 分割:
スプリット
'train' 3418
'validation' 1713
  • 特徴
{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "authors": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    },
    "structure": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "site": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "multi-author": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "changes": {
        "feature": {
            "dtype": "bool",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}

広い

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:style_change_detection/wide')
  • 説明
The goal of the style change detection task is to identify text positions within a given multi-author document at which the author switches. Detecting these positions is a crucial part of the authorship identification process, and for multi-author document analysis in general.

Access to the dataset needs to be requested from zenodo.
  • ライセンス: 既知のライセンスはありません
  • バージョン: 1.0.0
  • 分割:
スプリット
'train' 8030
'validation' 4019
  • 特徴
{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "authors": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    },
    "structure": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "site": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "multi-author": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "changes": {
        "feature": {
            "dtype": "bool",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}