Company
How Groundtruth Data helps teams find and address factual failures
The path from a defined task to a measured baseline, inspectable evidence, and targeted data.
Related reading: our original Medium post. This company-site edition reflects the current product scope.
Start with a question that can be checked
A useful evaluation begins with a specific capability. A financial assistant may need to retrieve the right value for a particular reporting period. A citation assistant may need to identify the publication year of a paper. Those are different tasks, and each needs its own source and grading rule.
Groundtruth Data builds source-backed evaluation cases around that scope. The aim is to make an error inspectable: what was asked, what the model answered, what the source supports, and how the grade was assigned.
Keep the evidence beside the result
An aggregate score is a starting point. Retained model outputs, reference answers, source identifiers, and grading rules let a team review individual failures. Missing evidence should remain a limitation, not become an invented answer.
A verified reference is bounded by its source and time. A historical dataset does not automatically establish the current state of a changing source, and a metadata check does not establish that a paper supports a medical conclusion.
Build a focused response to observed failures
Once a weakness is established, remediation data can target it. A period-selection mistake calls for different examples from a calculation mistake. Your team decides whether the intervention belongs in prompting, retrieval, training, or another part of the system.
Groundtruth does not silently train or change a customer model. A later evaluation on separate cases is needed before claiming improvement. The existence of a remediation dataset is not that result.
What is available now
The packaged 500-case Drug Indication Proof Evaluation includes JSONL, provenance, historical grades, a manifest, and an internal-use license. It is priced at $999 with automatic delivery after confirmed payment. Custom projects are operator-led and scoped before work begins.
Larger remediation and held-out inventories require review and packaging. We do not present them as automatic purchases, and Runtime is not offered as a live production service.