Legal Technology

Legal Research Database Coverage Test

JT

Juniorlawyer Team

Published: · Updated: · 3 min read

LLegal Technology

QUICK ANSWER

How do I test a legal research database's coverage?

Take a small sample of decisions you already possess from the courts, years and subjects you use. Run the same exact-number, party-name and phrase searches in each service, open each result and compare it with your reference copy. Record retrieval and document quality separately, and ask the provider about every failed lookup.

  • Use public decisions, not confidential client documents
  • Do not pick only famous cases
  • A failed lookup may be a search or spelling problem
  • Record your test date and account tier
  • Finding a judgment does not prove a summary is accurate

See the search steps

A research database coverage test checks whether a service contains the judgments your practice needs and whether you can retrieve and inspect them. Use a small set of decisions you already possess. Record retrieval and document quality separately: a convincing generated answer is not evidence that the underlying collection is complete.

Prepare a known-decision sample

Choose decisions across the courts, years and subject areas you actually use. Include a recent decision, an older decision, a common party name and a matter with an unusual spelling. Keep your reference copies and record where you obtained them. Use public decisions rather than confidential client documents for this exercise.

For each decision, record its court, date, case number, party names and reference source. Do not select only famous cases that almost every service is likely to retrieve. This is a sample of your requirements, not a statistical estimate of the entire database's coverage.

Run the same searches in each service

  1. Search by the exact case number or citation supplied in your reference copy.
  2. Search by party name and court, allowing for spelling variants.
  3. Try a short phrase from the judgment where full-text search is available.
  4. Open the result and compare its identity and text with your reference.
  5. Record whether you can retain a usable reference or access the original source again.

Keep a coverage worksheet

DecisionExact lookupParty lookupOriginal text availableLimitation to clarify
Sample AFoundFoundComplete PDFNone observed in this sample
Sample BNot foundFoundText onlyConfirm PDF availability
Sample CNot foundNot foundUnknownAsk about court and year coverage

These rows are fictional. A failed lookup can reflect a search problem, a spelling mismatch or a missing decision. Ask the provider which explanation applies before marking the decision absent.

Separate coverage from other checks

Finding a judgment does not establish that a summary is accurate, that it supports your argument or that later decisions have not affected it. Test those questions separately. Record your test date and account tier because source access and features may differ between plans.

For each unresolved result, retain the query, result link and the provider's response. Repeat the failed lookup after a claimed correction rather than accepting a coverage assurance alone.

Use the results in a buying decision

Set your essential courts and periods before evaluating a product. Treat a missing essential source as a specific limitation to resolve, rather than averaging it away with successful searches. For the broader shortlist, use the legal research tools comparison.

Choose your next step

Where do you need more confidence in your legal research?

Does the original judgment support the proposition I want to cite?

  1. Locate the original decision using its court and citation.
  2. Read the relevant passage in context.
  3. Check later treatment and the law applicable to your facts.
Open the Supreme Court website

Frequently Asked Questions

Share this article

Try JuniorLawyer on your next matter

Draft, translate, run OCR and research in one workspace. Free plan, no credit card required.

Explore JuniorLawyer features

Prefer a walkthrough? Book a demo