tfdv.generate_statistics_from_dataframe
Stay organized with collections
Save and categorize content based on your preferences.
Compute data statistics for the input pandas DataFrame.
tfdv.generate_statistics_from_dataframe(
dataframe: DataFrame,
stats_options: tfdv.StatsOptions = options.StatsOptions(),
n_jobs: int = 1
) -> statistics_pb2.DatasetFeatureStatisticsList
This is a utility function for users with in-memory data represented
as a pandas DataFrame.
This function supports only DataFrames with columns of primitive string or
numeric types. DataFrames with multivalent features or holding non-string
object types are not supported.
Args |
|---|
dataframe
|
Input pandas DataFrame.
|
stats_options
|
tfdv.StatsOptions for generating data statistics.
|
n_jobs
|
Number of processes to run (defaults to 1). If -1 is provided,
uses the same number of processes as the number of CPU cores.
|
Returns |
|---|
|
A DatasetFeatureStatisticsList proto.
|
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2024-10-18 UTC.
[null,null,["Last updated 2024-10-18 UTC."],[],[],null,["# tfdv.generate_statistics_from_dataframe\n\n\u003cbr /\u003e\n\n|-------------------------------------------------------------------------------------------------------------------------------------------------|\n| [View source on GitHub](https://github.com/tensorflow/data-validation/blob/v1.16.1/tensorflow_data_validation/utils/stats_gen_lib.py#L191-L243) |\n\nCompute data statistics for the input pandas DataFrame. \n\n tfdv.generate_statistics_from_dataframe(\n dataframe: DataFrame,\n stats_options: ../tfdv/StatsOptions = ../tfdv/StatsOptions,\n n_jobs: int = 1\n ) -\u003e statistics_pb2.DatasetFeatureStatisticsList\n\nThis is a utility function for users with in-memory data represented\nas a pandas DataFrame.\n\nThis function supports only DataFrames with columns of primitive string or\nnumeric types. DataFrames with multivalent features or holding non-string\nobject types are not supported.\n\n\u003cbr /\u003e\n\n\u003cbr /\u003e\n\n\u003cbr /\u003e\n\n| Args ---- ||\n|-----------------|------------------------------------------------------------------------------------------------------------------------------|\n| `dataframe` | Input pandas DataFrame. |\n| `stats_options` | [`tfdv.StatsOptions`](../tfdv/StatsOptions) for generating data statistics. |\n| `n_jobs` | Number of processes to run (defaults to 1). If -1 is provided, uses the same number of processes as the number of CPU cores. |\n\n\u003cbr /\u003e\n\n\u003cbr /\u003e\n\n\u003cbr /\u003e\n\n\u003cbr /\u003e\n\n| Returns ------- ||\n|---|---|\n| A DatasetFeatureStatisticsList proto. ||\n\n\u003cbr /\u003e"]]
View source on GitHub