CiteClear

Check ChatGPT Legal Citations

Step-by-step workflow for validating legal citations generated by ChatGPT. Ensure AI output is accurate before relying on it.

Validation Workflow

1
Extract All Citations

Go through the ChatGPT output line by line and extract every legal citation. Include the full citation text, including pin cites and parenthetical information.

2
Run Format Validation

Use the Citation Checker to validate the format of each extracted citation. This catches obvious formatting errors.

3
Check for Obvious Red Flags

Manually review for future dates, impossible reporter volumes, and unrecognized court abbreviations. These are guaranteed to be hallucinations.

4
Database Verification

Search each citation on Google Scholar, CourtListener, or official court websites. Verify that the case actually exists with the cited reporter and page number.

5
Cross-Check Pin Cites

If a pin cite (specific page number) is included, verify that the cited proposition actually appears on that page of the case.

6
Document Results

Create a verification report showing which citations are valid, which need review, and which are confirmed hallucinations.

Quick Check Checklist

  1. Date Check: Is the citation date in the past? Future dates = hallucination.
  2. Reporter Check: Is the reporter abbreviation valid? (F., F.2d, F.3d, F.4th, U.S., S.Ct., L.Ed.)
  3. Volume Check: Is the volume number within valid range for that reporter?
  4. Court Check: Is the court abbreviation valid? (9th Cir., S.D.N.Y., D. Mass., etc.)
  5. Page Check: Is the page number reasonable? Pages above 999 are extremely rare.
  6. Existence Check: Does the case appear in Google Scholar or CourtListener?
  7. Pin Cite Check: If a pin cite is provided, does the referenced text appear on that page?

Example: Validating a ChatGPT Response

ChatGPT Output:

Based on established precedent, the court should apply the economic loss rule (see East River Steamship Corp. v. Transamerica Delaval Inc., 476 U.S. 858 (1986)). Additionally, the Restatement (Second) of Torts § 402A provides relevant guidance. More recently, the Ninth Circuit applied similar reasoning in In re: Silicon Valley Bank, 64 F.4th 1000 (9th Cir. 2023).

Validation Results:

  1. East River Steamship Corp. v. Transamerica Delaval Inc., 476 U.S. 858 (1986) - ✅ Valid - Real Supreme Court case, valid format.
  2. Restatement (Second) of Torts § 402A - ✅ Valid - Real restatement section.
  3. In re: Silicon Valley Bank, 64 F.4th 1000 (9th Cir. 2023) - ⚠️ Needs Verification - F.4th volume 64 is valid (started 2010s), but need to verify this specific case exists.

In this example, 2 out of 3 citations are clearly valid, while 1 needs manual verification to confirm the case exists with that citation.

Common ChatGPT Citation Problems

❌ Fake Case, Real Parties

ChatGPT often uses real party names (Smith, Jones, etc.) with fabricated citations that look real.

❌ Real Case, Wrong Citation

The case exists, but ChatGPT assigns it a different reporter, volume, or page number than the real citation.

❌ Off-by-One Errors

Real case, but the volume or page number is off by 1-2. Easy to miss but still incorrect.

❌ Non-Existent Pin Cites

The case and page are real, but the specific text or holding doesn't appear on the cited page.

Tools for Verification

🔍 Google Scholar

scholar.google.com

Free access to published opinions. Search by citation or party names.

🏛️ CourtListener

courtlistener.com

Free database of court opinions. Excellent for verifying citations.

⚖️ Justia

justia.com

Free access to case law, codes, and regulations with citation lookup.

📚 Cornell LII

law.cornell.edu

Legal Information Institute. Free access to statutes, regulations, and some case law.

🔍 FindLaw

findlaw.com

Commercial database with free case law search and citation verification.

🎓 Harvard Caselaw Access Project

case.law.harvard.edu

Free access to millions of published court opinions with advanced search.

Best Practices for Using ChatGPT for Legal Research

✅ Always Verify

Never rely on ChatGPT citations without verification. Treat all AI output as requiring confirmation.

✅ Use Specific Prompts

Instead of "cite cases on this topic," ask for "cases from the Ninth Circuit in the last 5 years on this issue."

✅ Request Citations in Bluebook Format

Explicitly ask for properly formatted citations to make verification easier.

✅ Cross-Check Multiple Sources

Verify each citation against at least two independent sources.

✅ Document Your Verification

Keep a record of which citations you verified and which were found to be incorrect.

✅ Know the Limits

ChatGPT's knowledge cutoff means it may not have information on very recent cases.

Related Tools & Guides