transform_result
transform_result
¶
Classes:
| Name | Description |
|---|---|
ColumnStatistics |
Metadata and statistics for transformations and detected entities in a column. |
TransformResult |
Result of PII replacement: transformed data and per-column statistics. |
ColumnStatistics
pydantic-model
¶
Bases: BaseModel
Metadata and statistics for transformations and detected entities in a column.
Tracks assigned type and entity from classification, NER-detected counts and values per entity, and which transform functions were applied.
Fields:
-
assigned_type(str | None) -
assigned_entity(str | None) -
detected_entity_counts(dict[str, int]) -
detected_entity_values(dict[str, set]) -
is_transformed(bool) -
transform_functions(set[str])
assigned_type
pydantic-field
¶
Type assigned to the column, usually from column classification.
assigned_entity
pydantic-field
¶
Entity assigned to the column, usually from column classification.
detected_entity_counts
pydantic-field
¶
Entity name to count of times NER detected it in the column.
detected_entity_values
pydantic-field
¶
Entity name to set of detected values.
is_transformed = False
pydantic-field
¶
Whether the column was transformed.
transform_functions
pydantic-field
¶
Names of transform functions applied to the column.
TransformResult
pydantic-model
¶
Bases: BaseModel
Result of PII replacement: transformed data and per-column statistics.
Produced by NemoPII.transform_df and exposed as NemoPII.result.
Config:
arbitrary_types_allowed:True
Fields:
-
transformed_df(DataFrame) -
column_statistics(dict[str, ColumnStatistics])