A research database coverage test checks whether a service contains the judgments your practice needs and whether you can retrieve and inspect them. Use a small set of decisions you already possess. Record retrieval and document quality separately: a convincing generated answer is not evidence that the underlying collection is complete.
Prepare a known-decision sample
Choose decisions across the courts, years and subject areas you actually use. Include a recent decision, an older decision, a common party name and a matter with an unusual spelling. Keep your reference copies and record where you obtained them. Use public decisions rather than confidential client documents for this exercise.
For each decision, record its court, date, case number, party names and reference source. Do not select only famous cases that almost every service is likely to retrieve. This is a sample of your requirements, not a statistical estimate of the entire database's coverage.
Run the same searches in each service
- Search by the exact case number or citation supplied in your reference copy.
- Search by party name and court, allowing for spelling variants.
- Try a short phrase from the judgment where full-text search is available.
- Open the result and compare its identity and text with your reference.
- Record whether you can retain a usable reference or access the original source again.
Keep a coverage worksheet
| Decision | Exact lookup | Party lookup | Original text available | Limitation to clarify |
|---|---|---|---|---|
| Sample A | Found | Found | Complete PDF | None observed in this sample |
| Sample B | Not found | Found | Text only | Confirm PDF availability |
| Sample C | Not found | Not found | Unknown | Ask about court and year coverage |
These rows are fictional. A failed lookup can reflect a search problem, a spelling mismatch or a missing decision. Ask the provider which explanation applies before marking the decision absent.
Separate coverage from other checks
Finding a judgment does not establish that a summary is accurate, that it supports your argument or that later decisions have not affected it. Test those questions separately. Record your test date and account tier because source access and features may differ between plans.
For each unresolved result, retain the query, result link and the provider's response. Repeat the failed lookup after a claimed correction rather than accepting a coverage assurance alone.
Use the results in a buying decision
Set your essential courts and periods before evaluating a product. Treat a missing essential source as a specific limitation to resolve, rather than averaging it away with successful searches. For the broader shortlist, use the legal research tools comparison.