🕵️ Rewriting Legal Documents¶

Rewriting legal text (TAB dataset) with a domain-specific privacy goal and custom entity labels tailored for legal proceedings.

📚 What you'll learn¶

• Define domain-specific entity labels for legal text (case numbers, court names, etc.)
• Configure rewrite mode with legal-specific privacy goals
• Preview and run on court decision documents
• Triage flagged records with needs_human_review

Tip: First time running notebooks? Start with setup instructions.

⚙️ Setup¶

• Check if your NVIDIA_API_KEY from build.nvidia.com is registered for model access.
  • The default build.nvidia.com (NVIDIA Build) setup is a convenient way to try Anonymizer and iterate on previews. Use of NVIDIA Build is subject to NVIDIA Build's own terms of service and privacy practices, which are separate from and independent of the NeMo Framework library. NVIDIA Build is intended for evaluation and testing purposes only and may not be used in production environments. Do not upload any confidential information or personal data when using NVIDIA Build. Your use of NVIDIA Build is logged for security purposes and to improve NVIDIA products and services.
  • Request and token rate limits on build.nvidia.com vary by account and model access, and lower-volume development access can be slow for full-dataset runs. Start with preview() on a small sample, then move to your own endpoint for production data and usage.
• Import Detect (for custom entity labels), Rewrite, and its config classes.
• Anonymizer() initializes with the default model provider -- no extra config needed.
• configure_logging(LoggingConfig.default()) keeps logs at INFO. Switch to LoggingConfig.debug() when troubleshooting.

In [2]:

import getpass
import os

if not os.getenv("NVIDIA_API_KEY"):
    key = getpass.getpass("Enter NVIDIA_API_KEY from build.nvidia.com: ").strip()
    if not key:
        raise RuntimeError("NVIDIA_API_KEY is required to run these notebooks.")
    os.environ["NVIDIA_API_KEY"] = key

import getpass import os if not os.getenv("NVIDIA_API_KEY"): key = getpass.getpass("Enter NVIDIA_API_KEY from build.nvidia.com: ").strip() if not key: raise RuntimeError("NVIDIA_API_KEY is required to run these notebooks.") os.environ["NVIDIA_API_KEY"] = key

In [3]:

from anonymizer import (
    Anonymizer,
    AnonymizerConfig,
    AnonymizerInput,
    Detect,
    LoggingConfig,
    PrivacyGoal,
    Rewrite,
    configure_logging,
)

configure_logging(LoggingConfig.default())

from anonymizer import ( Anonymizer, AnonymizerConfig, AnonymizerInput, Detect, LoggingConfig, PrivacyGoal, Rewrite, configure_logging, ) configure_logging(LoggingConfig.default())

In [4]:

anonymizer = Anonymizer()

anonymizer = Anonymizer()

[11:36:11] [INFO] 🔧 Anonymizer initialized with 3 model configs

[11:36:11] [INFO]   |-- 🔎 detector:  gliner-pii-detector

[11:36:11] [INFO]   |-- ✅ validator: gpt-oss-120b

[11:36:11] [INFO]   |-- 🧩 augmenter: gpt-oss-120b

📦 Input data¶

• TAB (Text Anonymization Benchmark) legal documents -- court decisions containing names, dates, case numbers, and other legal identifiers.
• LEGAL_ENTITY_LABELS defines the domain-specific entity types to detect. This replaces the default label set with one tailored to legal text.

In [5]:

LEGAL_ENTITY_LABELS = [
    "first_name",
    "last_name",
    "court_name",
    "organization_name",
    "company_name",
    "prison_detention_facility",
    "street_address",
    "city",
    "state",
    "country",
    "date",
    "date_time",
    "time",
    "date_of_birth",
    "age",
    "email",
    "phone_number",
    "ssn",
    "unique_id",
    "legal_role",
    "case_number",
    "application_number",
    "monetary_amount",
    "sentence_duration",
    "nationality",
]

input_data = AnonymizerInput(
    source="https://raw.githubusercontent.com/NVIDIA-NeMo/Anonymizer/refs/heads/main/docs/data/TAB_legal_sample25.csv",
    text_column="text",
    data_summary="Legal court decisions containing personal identifiers, case numbers, and institutional references",
)

LEGAL_ENTITY_LABELS = [ "first_name", "last_name", "court_name", "organization_name", "company_name", "prison_detention_facility", "street_address", "city", "state", "country", "date", "date_time", "time", "date_of_birth", "age", "email", "phone_number", "ssn", "unique_id", "legal_role", "case_number", "application_number", "monetary_amount", "sentence_duration", "nationality", ] input_data = AnonymizerInput( source="https://raw.githubusercontent.com/NVIDIA-NeMo/Anonymizer/refs/heads/main/docs/data/TAB_legal_sample25.csv", text_column="text", data_summary="Legal court decisions containing personal identifiers, case numbers, and institutional references", )

🎛️ Configure¶

• Detect(entity_labels=...) overrides the default entity set with legal-specific labels. The explicit list is a strict allowlist for both detection and LLM augmentation: labels not included here are filtered out, so include every entity type you need.
• PrivacyGoal tells the rewriter what to protect (identifiers, case numbers, institutional references) and what to preserve (legal reasoning, statutory references, ruling structure).

In [6]:

config = AnonymizerConfig(
    detect=Detect(
        entity_labels=LEGAL_ENTITY_LABELS,
    ),
    rewrite=Rewrite(
        privacy_goal=PrivacyGoal(
            protect="All personal identifiers, case numbers, court names, and institutional references that could identify parties",
            preserve="Legal reasoning, procedural facts, statutory references, and the structure of the ruling",
        ),
        risk_tolerance="minimal",
        max_repair_iterations=3,
    ),
)

config = AnonymizerConfig( detect=Detect( entity_labels=LEGAL_ENTITY_LABELS, ), rewrite=Rewrite( privacy_goal=PrivacyGoal( protect="All personal identifiers, case numbers, court names, and institutional references that could identify parties", preserve="Legal reasoning, procedural facts, statutory references, and the structure of the ruling", ), risk_tolerance="minimal", max_repair_iterations=3, ), )

👁️ Preview¶

• Preview on a few records to check that legal entities are detected and the rewrite preserves the ruling's structure.

In [7]:

preview = anonymizer.preview(
    config=config,
    data=input_data,
    num_records=3,
)

preview.display_record(0)

preview = anonymizer.preview( config=config, data=input_data, num_records=3, ) preview.display_record(0)

[11:36:12] [INFO] 👀 Preview mode: 📂 Loaded 3 records from https://raw.githubusercontent.com/NVIDIA-NeMo/Anonymizer/refs/heads/main/docs/data/TAB_legal_sample25.csv (column: 'text')

[11:36:12] [INFO] 🔍 Running entity detection on 3 records

[11:36:12] [INFO] detection labels in scope: ['age', 'application_number', 'case_number', 'city', 'company_name', 'country', 'court_name', 'date', 'date_of_birth', 'date_time', 'email', 'first_name', 'last_name', 'legal_role', 'monetary_amount', 'nationality', 'organization_name', 'phone_number', 'prison_detention_facility', 'sentence_duration', 'ssn', 'state', 'street_address', 'time', 'unique_id']

[11:37:24] [INFO]   |-- 📋 Detection complete — 141 entities found across 3 records (0 failed) [71.9s]

[11:37:24] [INFO]   |-- labels: date=52, court_name=35, legal_role=10, organization_name=7, nationality=7, last_name=7, country=5, first_name=5, city=5, application_number=3, date_of_birth=2, monetary_amount=1, case_number=1, sentence_duration=1

[11:37:24] [INFO] ✏️ Running rewrite pipeline

[11:40:33] [INFO] Evaluate-repair loop iteration 0: 1/3 rows need repair

[11:41:14] [INFO] Evaluate-repair loop: all rows pass at iteration 1

[11:41:14] [INFO]   |-- 📋 Rewrite complete (0 failed) [229.9s]

[11:41:14] [INFO] 🎉 Pipeline complete — 3 records processed, 0 total failures

Anonymizer Rewrite Preview (record 0)

Original

PROCEDURE The case originated in an application (no. 74463/01| application_number) against the Republic of Turkey| country lodged with the Court under Article 34 of the Convention for the Protection of Human Rights and Fundamental Freedoms| organization_name (“the Convention”) by a Turkish| nationality national, Ms Feriştah| first_name Bahçeyaka| last_name, on 8 June 2001| date. The applicant was represented by Mr E. Kuloğlu| last_name, a lawyer| legal_role practising in Aydın| city. The Turkish| nationality Government (“the Government”) did not designate an Agent for the purposes of the proceedings before the Court. On 14 June 2005| date the Court decided to communicate the application. Applying Article 29 § 3 of the Convention, it decided to rule on the admissibility and merits of the applications at the same time. The applicant and the Government each filed observations on the admissibility and the merits. THE FACTS The applicant was born in 1958| date_of_birth and lives in Wesel| city, Germany| country. On 12 February 1980| date the applicant and her husband established a joint bank account with a German| nationality bank. On an unspecified date, the applicant’s husband withdrew all of the money from their joint account without the applicant’s consent and placed it into another account in a Turkish| nationality bank. On 23 October 1992| date the applicant filed an action with the Aydın Civil Court of first-instance| court_name to recover half the money that her husband had withdrawn from their joint bank account. On 14 September 1999| date the Aydın Civil Court of first-instance| court_name dismissed the applicant’s case on the ground that she had failed to substantiate her claims. The court reasoned that the applicant had not furnished any bank document, such as receipts indicating withdrawal of money, capable of supporting her allegations. It also noted that the documents kept by the bank had been destroyed at the end of six years’ retention period and that therefore there was no document available on which to conclude that the applicant was right in her assertions. On 27 December 1999| date the applicant appealed. On 5 April 2000| date the Court of Cassation| court_name dismissed the applicant’s request for appeal. It opined that the applicant had failed to prove that her husband had withdrawn all the money from their joint bank account and placed it into another bank account. On 16 November 2000| date the Court of Cassation| court_name dismissed the applicant’s request for rectification. On 15 December 2000| date the Court of Cassation| court_name’s decision was served on the applicant.

Rewritten

PROCEDURE The case originated in an application (no. 86214/02) against the Republic of Turkey lodged with the Court under Article 34 of the Convention for the Protection of Human Rights and Fundamental Freedoms (“the Convention”) by a Turkish national, Ms Elif Yıldırım, on 8 June 2001. The applicant was represented by Mr E. Demir, a lawyer practising in Aydın. The Turkish Government (“the Government”) did not designate an Agent for the purposes of the proceedings before the Court. On 14 June 2005 the Court decided to communicate the application. Applying Article 29 § 3 of the Convention, it decided to rule on the admissibility and merits of the applications at the same time. The applicant and the Government each filed observations on the admissibility and the merits. THE FACTS The applicant was born in 1958 and lives in Wesel, Germany. On 12 February 1980 the applicant and her husband established a joint bank account with a German bank. On an unspecified date, the applicant’s husband withdrew all of the money from their joint account without the applicant’s consent and placed it into another account in a Turkish bank. On 23 October 1992 the applicant filed an action with a civil court of first instance to recover half the money that her husband had withdrawn from their joint bank account. On 14 September 1999 the civil court of first instance dismissed the applicant’s case on the ground that she had failed to substantiate her claims. The court reasoned that the applicant had not furnished any bank document, such as receipts indicating withdrawal of money, capable of supporting her allegations. It also noted that the documents kept by the bank had been destroyed at the end of six years’ retention period and that therefore there was no document available on which to conclude that the applicant was right in her assertions. On 27 December 1999 the applicant appealed. On 5 April 2000 the highest appellate court dismissed the applicant’s request for appeal. It opined that the applicant had failed to prove that her husband had withdrawn all the money from their joint bank account and placed it into another bank account. On 16 November 2000 the highest appellate court dismissed the applicant’s request for rectification. On 15 December 2000 the highest appellate court’s decision was served on the applicant.

Scores

Utility: 1.00Leakage: 0.00Weighted Leakage Rate: 0.00Rewrite Needs Review: No

Entity Disposition

Entity	Label	Sensitivity	Protection
74463/01	application_number	high	replace
Feriştah	first_name	high	replace
Bahçeyaka	last_name	high	replace
8 June 2001	date	medium	leave_as_is
Republic of Turkey	country	low	leave_as_is
Turkish	nationality	low	leave_as_is
Convention for the Protection of Human Rights and Fundamental Freedoms	organization_name	low	leave_as_is
lawyer	legal_role	low	leave_as_is
Kuloğlu	last_name	high	replace
Aydın	city	low	leave_as_is
14 June 2005	date	medium	leave_as_is
12 February 1980	date	medium	leave_as_is
1958	date_of_birth	low	leave_as_is
Wesel	city	low	leave_as_is
Germany	country	low	leave_as_is
German	nationality	low	leave_as_is
23 October 1992	date	medium	leave_as_is
Aydın Civil Court of first-instance	court_name	high	generalize
14 September 1999	date	medium	leave_as_is
27 December 1999	date	medium	leave_as_is
5 April 2000	date	medium	leave_as_is
Court of Cassation	court_name	high	generalize
16 November 2000	date	medium	leave_as_is
15 December 2000	date	medium	leave_as_is
female	gender	low	leave_as_is
married	marital_status	low	leave_as_is

In [8]:

preview.display_record(1)

preview.display_record(1)

Anonymizer Rewrite Preview (record 1)

Original

PROCEDURE The case originated in an application (no. 29360/06| application_number) against the Republic of Poland| country lodged with the Court under Article 34 of the Convention for the Protection of Human Rights and Fundamental Freedoms (“the Convention”) by a Polish| nationality national, Ms Teresa| first_name Jerzak| last_name (“the applicant”), on 3 July 2006| date. The Polish| nationality Government (“the Government”) were represented by their Agent| legal_role, Mr J. Wołąsiewicz| last_name of the Ministry of Foreign Affairs| organization_name. On 25 September 2007| date the President of the Fourth Section| legal_role decided to give notice of the application to the Government. Applying Article 29 § 3 of the Convention, it was decided to rule on the admissibility and merits of the application at the same time. THE FACTS I. THE CIRCUMSTANCES OF THE CASE The applicant was born in 1940| date and lives in Sulejówek| city. A. Civil proceedings for division of inheritance On 8 March 1994| date the applicant lodged an application for division of an inheritance with the Warsaw District Court (Sąd Rejonowy)| court_name. On 7 November 1997| date the Warsaw District Court| court_name stayed the proceedings. It referred to the fact that related criminal proceedings concerning fraudulent acquisition of land, which could affect the outcome of the case, had first to be terminated. On 9 February 1998| date the applicant asked for the proceedings to be resumed. On 3 July 1998| date the court refused that request. On 3 July 1998| date the applicant complained to the Warsaw District Court| court_name about the delays in the proceedings. On 14 July 1998| date the court informed her that the proceedings would be resumed after the criminal proceedings had been terminated. On 3 August 2000| date the court refused to resume the proceedings. The applicant lodged an interlocutory appeal against that decision. The applicant referred to the fact that the prosecution had discontinued the investigation. On 15 January 2001| date the applicant asked once more for the proceedings to be resumed, to no avail. The proceedings were resumed on 14 February 2002| date. On 30 June 2004| date the Warsaw District Court| court_name ruled that some of the issues raised in the application, concerning the acquisition of property, should be examined in separate proceedings. Consequently, part of the claim, concerning the expropriation of property, was referred to the Warsaw District Court| court_name as a separate case. The applicant appealed. On 26 July 2004| date the Warsaw Regional Court (Sąd Okręgowy)| court_name dismissed the appeal. On 25 October 2004| date the court stayed the proceedings pending the outcome of the parallel proceedings for the expropriation of property. The applicant appealed. On 24 October 2006| date the Regional Court| court_name quashed that decision and resumed the examination of the case. It referred to the fact that the District Court| court_name had erroneously referred part of the claim to other proceedings. It relied on the need to examine both cases simultaneously within the scope of the same proceedings. On 9 May 2007| date the court stayed the proceedings because the parallel proceedings for the expropriation of property were pending before the appellate court. The case is still pending before the District Court| court_name. B. Proceedings under the 2004 Act| date On 2 January 2006| date the applicant lodged a complaint with the Warsaw Regional Court| court_name, alleging a breach of her right to a hearing within a reasonable time. She relied on section 2 of the Act of 17 June 2004| date on complaints about a breach of the right to a trial within a reasonable time (Ustawa o skardze na naruszenie prawa strony do rozpoznania sprawy w postępowaniu sądowym bez nieuzasadnionej zwłoki) (“the 2004 Act| date”), which entered into force on 17 September 2004| date. On 9 May 2006| date the Warsaw Regional Court| court_name acknowledged the excessive length of the proceedings before the Warsaw District Court| court_name. It awarded the applicant 200 Polish zlotys| monetary_amount (PLN – approximately 50 euros (EUR)) by way of just satisfaction. The court referred to the resolution of the Supreme Court| organization_name (Sąd Najwyższy| court_name) of 18 January 2005| date (no. III SPP 113/04| case_number) in which it ruled that while the 2004 Act| date produced legal effects as from the date of its date of entry into force, its provisions applied retroactively to all proceedings in which delays had occurred before that date and had not yet been remedied. The Regional Court| court_name held that the overall length of the proceedings before the District Court| court_name had been excessive, there had been long periods of inactivity and the hearings had not been held on a regular basis. These delays had taken place before the date of entry into force the 2004 Act| date and had not been remedied afterwards. Referring to the amount of just satisfaction, the court held that having analysed all the circumstances of the case it found this amount to be sufficient for the applicant.

Rewritten

PROCEDURE The case originated in an application (no. 47512/09) against the Republic of Poland lodged with the Court under Article 34 of the Convention for the Protection of Human Rights and Fundamental Freedoms (“the Convention”) by a Polish national, Ms Isabel Kovács (“the applicant”), on 3 July 2006. The Polish Government (“the Government”) were represented by their Agent, Mr J. Wołąsiewicz of a government ministry. On 25 September 2007 a judge of the Court decided to give notice of the application to the Government. Applying Article 29 § 3 of the Convention, it was decided to rule on the admissibility and merits of the application at the same time. THE FACTS I. THE CIRCUMSTANCES OF THE CASE The applicant was born in 1940 and lives in Sulejówek. A. Civil proceedings for division of inheritance On 8 March 1994 the applicant lodged an application for division of an inheritance with a district court. On 7 November 1997 the district court stayed the proceedings. It referred to the fact that related criminal proceedings concerning fraudulent acquisition of land, which could affect the outcome of the case, had first to be terminated. On 9 February 1998 the applicant asked for the proceedings to be resumed. On 3 July 1998 the district court refused that request. On 3 July 1998 the applicant complained to the district court about the delays in the proceedings. On 14 July 1998 the district court informed her that the proceedings would be resumed after the criminal proceedings had been terminated. On 3 August 2000 the district court refused to resume the proceedings. The applicant lodged an interlocutory appeal against that decision. The applicant referred to the fact that the prosecution had discontinued the investigation. On 15 January 2001 the applicant asked once more for the proceedings to be resumed, to no avail. The proceedings were resumed on 14 February 2002. On 30 June 2004 the district court ruled that some of the issues raised in the application, concerning the acquisition of property, should be examined in separate proceedings. Consequently, part of the claim, concerning the expropriation of property, was referred to the district court as a separate case. The applicant appealed. On 26 July 2004 a regional court dismissed the appeal. On 25 October 2004 the district court stayed the proceedings pending the outcome of the parallel proceedings for the expropriation of property. The applicant appealed. On 24 October 2006 the regional court quashed that decision and resumed the examination of the case. It referred to the fact that the district court had erroneously referred part of the claim to other proceedings. It relied on the need to examine both cases simultaneously within the scope of the same proceedings. On 9 May 2007 the district court stayed the proceedings because the parallel proceedings for the expropriation of property were pending before an appellate court. The case is still pending before the district court. B. Proceedings under the 2004 Act On 2 January 2006 the applicant lodged a complaint with a regional court, alleging a breach of her right to a hearing within a reasonable time. She relied on section 2 of the Act of 17 June 2004 on complaints about a breach of the right to a trial within a reasonable time (“the 2004 Act”), which entered into force on 17 September 2004. On 9 May 2006 a regional court acknowledged the excessive length of the proceedings before a district court. It awarded the applicant a monetary award by way of just satisfaction. The court referred to the resolution of a higher court of 18 January 2005 (no. IV SPP 219/07) in which it ruled that while the 2004 Act produced legal effects as from the date of its entry into force, its provisions applied retroactively to all proceedings in which delays had occurred before that date and had not yet been remedied. The regional court held that the overall length of the proceedings before the district court had been excessive, there had been long periods of inactivity and the hearings had not been held on a regular basis. These delays had taken place before the date of entry into force the 2004 Act and had not been remedied afterwards. Referring to the amount of just satisfaction, the court held that having analysed all the circumstances of the case it found this amount to be sufficient for the applicant.

Scores

Utility: 0.93Leakage: 0.00Weighted Leakage Rate: 0.00Rewrite Needs Review: No

Entity Disposition

Entity	Label	Sensitivity	Protection
Teresa	first_name	high	replace
Jerzak	last_name	high	replace
29360/06	application_number	high	replace
III SPP 113/04	case_number	high	replace
200 Polish zlotys	monetary_amount	high	generalize
Warsaw District Court	court_name	high	generalize
Warsaw District Court (Sąd Rejonowy)	court_name	high	generalize
Warsaw Regional Court	court_name	high	generalize
Warsaw Regional Court (Sąd Okręgowy)	court_name	high	generalize
Supreme Court	organization_name	high	generalize
Sąd Najwyższy	court_name	high	generalize
Ministry of Foreign Affairs	organization_name	high	generalize
Regional Court	court_name	low	leave_as_is
District Court	court_name	low	leave_as_is
President of the Fourth Section	legal_role	high	generalize
Agent	legal_role	low	leave_as_is
Polish	nationality	low	leave_as_is
Republic of Poland	country	low	leave_as_is
Sulejówek	city	medium	leave_as_is
Wołąsiewicz	last_name	low	leave_as_is
14 February 2002	date	low	leave_as_is
14 July 1998	date	low	leave_as_is
15 January 2001	date	low	leave_as_is
17 June 2004	date	low	leave_as_is
17 September 2004	date	low	leave_as_is
18 January 2005	date	low	leave_as_is
1940	date	low	leave_as_is
2 January 2006	date	low	leave_as_is
24 October 2006	date	low	leave_as_is
25 October 2004	date	low	leave_as_is
25 September 2007	date	low	leave_as_is
26 July 2004	date	low	leave_as_is
3 August 2000	date	low	leave_as_is
3 July 1998	date	low	leave_as_is
3 July 2006	date	low	leave_as_is
30 June 2004	date	low	leave_as_is
7 November 1997	date	low	leave_as_is
8 March 1994	date	low	leave_as_is
9 February 1998	date	low	leave_as_is
9 May 2006	date	low	leave_as_is
9 May 2007	date	low	leave_as_is
2004 Act	date	low	leave_as_is
Sulejówek	home_location	low	leave_as_is
1940	date_of_birth	low	leave_as_is
female	gender	low	leave_as_is

How to interpret leakage: Leakage is measured against the sensitivity disposition. Details marked leave_as_is may remain without increasing leakage_mass. If an output retains something you expected the privacy goal to protect, inspect the Entity Disposition table.

🚀 Full run¶

• result.dataframe has user-facing columns: rewritten text, scores, and the review flag.
• This notebook uses risk_tolerance="minimal", which applies stricter repair and review thresholds than notebook 04.

In [9]:

result = anonymizer.run(config=config, data=input_data)

result.dataframe.head()

result = anonymizer.run(config=config, data=input_data) result.dataframe.head()

[11:41:15] [INFO] 📂 Loaded 25 records from https://raw.githubusercontent.com/NVIDIA-NeMo/Anonymizer/refs/heads/main/docs/data/TAB_legal_sample25.csv (column: 'text')

[11:41:15] [INFO] 🔍 Running entity detection on 25 records

[11:41:15] [INFO] detection labels in scope: ['age', 'application_number', 'case_number', 'city', 'company_name', 'country', 'court_name', 'date', 'date_of_birth', 'date_time', 'email', 'first_name', 'last_name', 'legal_role', 'monetary_amount', 'nationality', 'organization_name', 'phone_number', 'prison_detention_facility', 'sentence_duration', 'ssn', 'state', 'street_address', 'time', 'unique_id']

[11:45:50] [INFO]   |-- 📋 Detection complete — 1277 entities found across 25 records (0 failed) [275.2s]

[11:45:50] [INFO]   |-- labels: date=416, court_name=233, legal_role=169, last_name=80, organization_name=75, first_name=62, nationality=56, city=46, country=43, application_number=26, date_of_birth=25, prison_detention_facility=15, sentence_duration=13, monetary_amount=10, state=5, case_number=1, age=1, company_name=1

[11:45:50] [INFO] ✏️ Running rewrite pipeline

[12:03:11] [INFO] Evaluate-repair loop iteration 0: 15/25 rows need repair

[12:07:13] [INFO] Evaluate-repair loop iteration 1: 9/25 rows need repair

[12:09:36] [INFO] Evaluate-repair loop iteration 2: 6/25 rows need repair

[12:10:41] [INFO]   |-- 📋 Rewrite complete (0 failed) [1491.6s]

[12:10:41] [INFO] 🎉 Pipeline complete — 25 records processed, 0 total failures

Out[9]:

	text	text_rewritten	utility_score	leakage_mass	weighted_leakage_rate	any_high_leaked	needs_human_review
0	PROCEDURE The case originated in an applicati...	PROCEDURE The case originated in an applicati...	0.957895	0.0	0.0	False	False
1	PROCEDURE The case originated in an applicati...	PROCEDURE The case originated in an applicati...	0.983333	9.7	0.485	True	True
2	PROCEDURE The case originated in an applicati...	PROCEDURE The case originated in an applicati...	0.93125	21.0	0.954545	True	True
3	PROCEDURE The case originated in an applicati...	PROCEDURE The case originated in an applicati...	0.952941	0.0	0.0	False	False
4	PROCEDURE The case originated in an applicati...	PROCEDURE The case originated in an applicati...	0.978571	4.0	0.190476	True	True

In [10]:

result.dataframe[["text_rewritten", "utility_score", "leakage_mass", "needs_human_review"]].head()

result.dataframe[["text_rewritten", "utility_score", "leakage_mass", "needs_human_review"]].head()

Out[10]:

	text_rewritten	utility_score	leakage_mass	needs_human_review
0	PROCEDURE The case originated in an applicati...	0.957895	0.0	False
1	PROCEDURE The case originated in an applicati...	0.983333	9.7	True
2	PROCEDURE The case originated in an applicati...	0.93125	21.0	True
3	PROCEDURE The case originated in an applicati...	0.952941	0.0	False
4	PROCEDURE The case originated in an applicati...	0.978571	4.0	True

🚩 Filter by review flag¶

• Records where automated metrics exceed thresholds are flagged for manual review.
• The repair loop stops after max_repair_iterations; records that still need repair remain flagged for human review but are not pipeline failures.
• Use this to prioritize human attention on the records that need it most.
• See Working with flagged records for guidance on diagnosing and resolving flagged records.

In [11]:

df = result.dataframe
flagged = df[df["needs_human_review"] == True]  # noqa: E712
print(f"{len(flagged)} of {len(df)} records flagged for human review")
flagged.head()

df = result.dataframe flagged = df[df["needs_human_review"] == True] # noqa: E712 print(f"{len(flagged)} of {len(df)} records flagged for human review") flagged.head()

6 of 25 records flagged for human review

Out[11]:

	text	text_rewritten	utility_score	leakage_mass	weighted_leakage_rate	any_high_leaked	needs_human_review
1	PROCEDURE The case originated in an applicati...	PROCEDURE The case originated in an applicati...	0.983333	9.7	0.485	True	True
2	PROCEDURE The case originated in an applicati...	PROCEDURE The case originated in an applicati...	0.93125	21.0	0.954545	True	True
4	PROCEDURE The case originated in an applicati...	PROCEDURE The case originated in an applicati...	0.978571	4.0	0.190476	True	True
17	PROCEDURE The case originated in an applicati...	PROCEDURE The case originated in an applicati...	0.963636	0.99	0.097059	True	True
20	PROCEDURE The case originated in an applicati...	PROCEDURE The case originated in an applicati...	0.992857	4.0	0.266667	True	True

🔬 Evaluate (optional)¶

Call evaluate() to run LLM-as-judge scoring on the rewrite result — detection validity and three quality rubrics (privacy, quality, style). Evaluation makes additional LLM calls per record. For larger datasets, evaluate a preview first; this tutorial evaluates all 25 rows to demonstrate the complete workflow. This holistic judge is independent of pipeline leakage scoring, so their assessments may differ. See Evaluation for details.

In [12]:

evaluated = anonymizer.evaluate(result)

evaluated = anonymizer.evaluate(result)

In [13]:

evaluated.display_record(0)

evaluated.display_record(0)

Anonymizer Rewrite Preview (record 0)

Original

PROCEDURE The case originated in an application (no. 74463/01| application_number) against the Republic of Turkey| country lodged with the Court under Article 34 of the Convention for the Protection of Human Rights and Fundamental Freedoms (“the Convention”) by a Turkish| nationality national, Ms Feriştah| first_name Bahçeyaka| last_name, on 8 June 2001| date. The applicant was represented by Mr E. Kuloğlu| last_name, a lawyer| legal_role practising in Aydın| city. The Turkish| nationality Government (“the Government”) did not designate an Agent for the purposes of the proceedings before the Court. On 14 June 2005| date the Court decided to communicate the application. Applying Article 29 § 3 of the Convention, it decided to rule on the admissibility and merits of the applications at the same time. The applicant and the Government each filed observations on the admissibility and the merits. THE FACTS The applicant was born in 1958| date_of_birth and lives in Wesel| city, Germany| country. On 12 February 1980| date the applicant and her husband established a joint bank account with a German| nationality bank. On an unspecified date, the applicant’s husband withdrew all of the money from their joint account without the applicant’s consent and placed it into another account in a Turkish| nationality bank. On 23 October 1992| date the applicant filed an action with the Aydın Civil Court of first-instance| court_name to recover half the money that her husband had withdrawn from their joint bank account. On 14 September 1999| date the Aydın Civil Court of first-instance| court_name dismissed the applicant’s case on the ground that she had failed to substantiate her claims. The court reasoned that the applicant had not furnished any bank document, such as receipts indicating withdrawal of money, capable of supporting her allegations. It also noted that the documents kept by the bank had been destroyed at the end of six years’ retention period and that therefore there was no document available on which to conclude that the applicant was right in her assertions. On 27 December 1999| date the applicant appealed. On 5 April 2000| date the Court of Cassation| court_name dismissed the applicant’s request for appeal. It opined that the applicant had failed to prove that her husband had withdrawn all the money from their joint bank account and placed it into another bank account. On 16 November 2000| date the Court of Cassation| court_name dismissed the applicant’s request for rectification. On 15 December 2000| date the Court of Cassation| court_name’s decision was served on the applicant.

Rewritten

PROCEDURE The case originated in an application (no. 86214/02) against the Republic of Turkey lodged with the Court under Article 34 of the Convention for the Protection of Human Rights and Fundamental Freedoms (“the Convention”) by a Turkish national, Ms Isabel García, on 8 June 2001. The applicant was represented by Mr E. Martínez, a lawyer practising in Aydın. The Turkish Government (“the Government”) did not designate an Agent for the purposes of the proceedings before the Court. On 14 June 2005 the Court decided to communicate the application. Applying Article 29 § 3 of the Convention, it decided to rule on the admissibility and merits of the applications at the same time. The applicant and the Government each filed observations on the admissibility and the merits. THE FACTS The applicant was born in 1958 and lives in a German city. On 12 February 1980 the applicant and her husband established a joint bank account with a German bank. On an unspecified date, the applicant’s husband withdrew all of the money from their joint account without the applicant’s consent and placed it into another account in a Turkish bank. On 23 October 1992 the applicant filed an action with a civil court of first instance to recover half the money that her husband had withdrawn from their joint bank account. On 14 September 1999 the civil court of first instance dismissed the applicant’s case on the ground that she had failed to substantiate her claims. The court reasoned that the applicant had not furnished any bank document, such as receipts indicating withdrawal of money, capable of supporting her allegations. It also noted that the documents kept by the bank had been destroyed at the end of six years’ retention period and that therefore there was no document available on which to conclude that the applicant was right in her assertions. On 27 December 1999 the applicant appealed. On 5 April 2000 the supreme appellate court dismissed the applicant’s request for appeal. It opined that the applicant had failed to prove that her husband had withdrawn all the money from their joint bank account and placed it into another bank account. On 16 November 2000 the supreme appellate court dismissed the applicant’s request for rectification. On 15 December 2000 the supreme appellate court’s decision was served on the applicant.

Scores

Utility: 0.96Leakage: 0.00Weighted Leakage Rate: 0.00Rewrite Needs Review: No

Detection Validity: 0.96

Show 1 flagged detection(s)

Value	Label	Reason
German	nationality	contextual_mismatch: 'German' describes a bank, not a person's nationality

Judge

privacy: highquality: highstyle: high

Entity Disposition

Entity	Label	Sensitivity	Protection
74463/01	application_number	high	replace
Feriştah	first_name	high	replace
Bahçeyaka	last_name	high	replace
Kuloğlu	last_name	high	replace
Aydın Civil Court of first-instance	court_name	high	generalize
Court of Cassation	court_name	high	generalize
Wesel	city	high	generalize
Aydın	city	low	leave_as_is
8 June 2001	date	low	leave_as_is
14 June 2005	date	low	leave_as_is
12 February 1980	date	low	leave_as_is
23 October 1992	date	low	leave_as_is
14 September 1999	date	low	leave_as_is
27 December 1999	date	low	leave_as_is
5 April 2000	date	low	leave_as_is
16 November 2000	date	low	leave_as_is
15 December 2000	date	low	leave_as_is
1958	date_of_birth	low	leave_as_is
Turkish	nationality	low	leave_as_is
German	nationality	low	leave_as_is
Republic of Turkey	country	low	leave_as_is
Germany	country	low	leave_as_is
lawyer	legal_role	low	leave_as_is
Wesel, Germany	home_location	high	suppress_inference
married	marital_status	low	leave_as_is
female	gender	low	leave_as_is

⏭️ Next steps¶

• 📊 Evaluation -- learn about the detection validity and rewrite quality judges in detail.
• 🔍 Inspecting Detected Entities -- debug what the detection pipeline found before rewriting.
• Try it on your own data! Swap in your CSV, define entity labels for your domain, and set a PrivacyGoal that fits -- you've got all the building blocks.