Back to All datasetsSample
Drug Indication Diagnostic Archive (retired)
4 real rows from the existing reference export, unedited. Review the schema and provenance here; confirm the specific package and delivery terms before purchasing.
338Diagnostic/eval rowsPublished product, fully model-graded
33.7%Measured hallucination rate114/338 cold answers hallucinated on the published diagnostic/eval set
500Fresh proof evalIndependent RxCUIs/questions, fully graded via browser-assisted ChatGPT run
78.4%Proof error rate392/500 incorrect or hallucinated; Wilson 95% CI 74.6%-81.8%
10,000Remediation data9,000 train / 500 dev / 500 test, validation passed
1,000Held-out evalUntouched RxNav rows reserved from remediation generation
Pricing
Historical diagnostic export — retired from salediagnostic eval
Retired from sale
338 actual rows
Existing published JSON product with model-graded diagnostic/eval rows.
Request packageDrug Indication Proof Evalproof eval
$999 once
500 actual rows
Packaged 500 unique cases, provenance, historical grades, manifest and internal-use license. Automatic delivery after confirmed payment.
View checkout — $999Drug Indication Remediation 10kremediation training
$4,900 reference price
10,000 actual rows
Validated training/remediation records with train/dev/test split and source-record leakage checks.
Request packageHeld-Out Validationheld out validation
$1,250 reference price
1,000 actual rows
Untouched held-out RxNav evaluation set reserved from remediation generation.
Request packageFull Drug-Indication Improvement Packfull improvement pack
$6,500 reference price
11,500 actual rows
Proof eval, 10k remediation data, and held-out validation packaged together. No post-training improvement result is included yet.
Request packageCustom Model Failure Studycustom dataset
Custom quote
Customer-specific diagnostic, proof, remediation, and held-out study scoped to the buyer model/domain.
Request packagePublished graded diagnostic/eval setdiagnostic
338 rows
historical archive; retired from sale
Fully model-graded; source-grounded against RxNav/RxClass MED-RT.
Fresh proof-evaluation pilotproof eval
500 rows
packaged for purchase with automatic delivery
Browser-assisted ChatGPT run: 108 correct, 392 incorrect/hallucinated, 0 refused, 0 ungraded.
Remediation/training datasetremediation
10,000 rows
validated locally; pending publication
Deterministic 9,000/500/500 train/dev/test split; factual answers derived from verified source rows.
Untouched held-out evaluationheld out
1,000 rows
validated locally; reserved from remediation
Zero RxCUI and row-ID overlap with the 10k remediation dataset.
Post-training improvement reportimprovement report
Pending
not yet run
Infrastructure exists, but no drug-indication post-training result has been measured.
Schema fields
row_id, drug_rxcui, drug_name, model_question, expected_answer_set, source_urls, verification_status, difficulty, model_verdict
Limitations
- MED-RT/RxNav may_treat is a coded source view, not a complete prescribing label.
- The 500-row proof eval uses browser-assisted ChatGPT responses labeled as chatgpt-web; it is not an OpenAI API model-version benchmark.
- The 10,000-record remediation dataset is training-oriented and must not be used as final held-out proof.
- No trained or fine-tuned model has been re-evaluated yet, so no improvement claim is published.
Row 1 of 338
- row_id
- RXI000001
- claim
- metformin hydrochloride (RxCUI 235743) is indicated to treat: Diabetes Mellitus, Type 2 (per MED-RT).
- claim_source_url
- https://rxnav.nlm.nih.gov/REST/rxclass/class/byDrugName.json?drugName=metformin&relaSource=MEDRT&relas=may_treat
- verification_method
- official_api
- drug_rxcui
- 235743
- drug_name
- metformin hydrochloride
- rela
- may_treat
- verification_source_url
- https://rxnav.nlm.nih.gov/REST/rxclass/class/byDrugName.json?drugName=metformin&relaSource=MEDRT&relas=may_treat
- source_publisher
- NLM MED-RT via RxClass API (DISEASE)
- retrieved_at
- 2026-08-24T18:10:34.692Z
- verification_status
- verified
- agreement
- match
- explanation
- Fetched live from RxClass API; metformin hydrochloride has 1 documented may_treat relationship(s).
- model_question
- Name one condition that metformin hydrochloride may be indicated to treat, according to MED-RT.
- expected_answer_set
[
"Diabetes Mellitus, Type 2"
]
- expected_answer
- Diabetes Mellitus, Type 2
- condition_count
- 1
- grading_mode
- set_match
- difficulty
- hard
- tags
[
"drug-safety",
"indication",
"rxnorm",
"med-rt"
]
- model_tested
- claude-sonnet-5
- model_response
- Type 2 diabetes
- model_verdict
- correct
- model_grading_note
- Response matches one of 1 valid documented conditions (normalized match).
Row 2 of 338
- row_id
- RXI000002
- claim
- metformin (RxCUI 6809) is indicated to treat: Diabetes Mellitus, Type 2 (per MED-RT).
- claim_source_url
- https://rxnav.nlm.nih.gov/REST/rxclass/class/byDrugName.json?drugName=metformin&relaSource=MEDRT&relas=may_treat
- verification_method
- official_api
- drug_rxcui
- 6809
- drug_name
- metformin
- rela
- may_treat
- verification_source_url
- https://rxnav.nlm.nih.gov/REST/rxclass/class/byDrugName.json?drugName=metformin&relaSource=MEDRT&relas=may_treat
- source_publisher
- NLM MED-RT via RxClass API (DISEASE)
- retrieved_at
- 2026-08-24T18:10:34.692Z
- verification_status
- verified
- agreement
- match
- explanation
- Fetched live from RxClass API; metformin has 1 documented may_treat relationship(s).
- model_question
- Name one condition that metformin may be indicated to treat, according to MED-RT.
- expected_answer_set
[
"Diabetes Mellitus, Type 2"
]
- expected_answer
- Diabetes Mellitus, Type 2
- condition_count
- 1
- grading_mode
- set_match
- difficulty
- hard
- tags
[
"drug-safety",
"indication",
"rxnorm",
"med-rt"
]
- model_tested
- claude-sonnet-5
- model_response
- Type 2 Diabetes Mellitus
- model_verdict
- correct
- model_grading_note
- Response matches one of 1 valid documented conditions (normalized match).
Row 3 of 338
- row_id
- RXI000003
- claim
- lisinopril anhydrous (RxCUI 1546022) is indicated to treat: Diabetic Nephropathies; Heart Failure; Hypertension; Myocardial Infarction; Ventricular Dysfunction, Left (per MED-RT).
- claim_source_url
- https://rxnav.nlm.nih.gov/REST/rxclass/class/byDrugName.json?drugName=lisinopril&relaSource=MEDRT&relas=may_treat
- verification_method
- official_api
- drug_rxcui
- 1546022
- drug_name
- lisinopril anhydrous
- rela
- may_treat
- verification_source_url
- https://rxnav.nlm.nih.gov/REST/rxclass/class/byDrugName.json?drugName=lisinopril&relaSource=MEDRT&relas=may_treat
- source_publisher
- NLM MED-RT via RxClass API (DISEASE)
- retrieved_at
- 2026-08-24T18:10:34.890Z
- verification_status
- verified
- agreement
- match
- explanation
- Fetched live from RxClass API; lisinopril anhydrous has 5 documented may_treat relationship(s).
- model_question
- Name one condition that lisinopril anhydrous may be indicated to treat, according to MED-RT.
- expected_answer_set
[
"Diabetic Nephropathies",
"Heart Failure",
"Hypertension",
"Myocardial Infarction",
"Ventricular Dysfunction, Left"
]
- expected_answer
- Diabetic Nephropathies
- condition_count
- 5
- grading_mode
- set_match
- difficulty
- hard
- tags
[
"drug-safety",
"indication",
"rxnorm",
"med-rt"
]
- model_tested
- claude-sonnet-5
- model_response
- Hypertension
- model_verdict
- correct
- model_grading_note
- Response matches one of 5 valid documented conditions (normalized match).
Row 4 of 338
- row_id
- RXI000004
- claim
- lisinopril (RxCUI 29046) is indicated to treat: Diabetic Nephropathies; Heart Failure; Hypertension; Myocardial Infarction; Ventricular Dysfunction, Left (per MED-RT).
- claim_source_url
- https://rxnav.nlm.nih.gov/REST/rxclass/class/byDrugName.json?drugName=lisinopril&relaSource=MEDRT&relas=may_treat
- verification_method
- official_api
- drug_rxcui
- 29046
- drug_name
- lisinopril
- rela
- may_treat
- verification_source_url
- https://rxnav.nlm.nih.gov/REST/rxclass/class/byDrugName.json?drugName=lisinopril&relaSource=MEDRT&relas=may_treat
- source_publisher
- NLM MED-RT via RxClass API (DISEASE)
- retrieved_at
- 2026-08-24T18:10:34.890Z
- verification_status
- verified
- agreement
- match
- explanation
- Fetched live from RxClass API; lisinopril has 5 documented may_treat relationship(s).
- model_question
- Name one condition that lisinopril may be indicated to treat, according to MED-RT.
- expected_answer_set
[
"Diabetic Nephropathies",
"Heart Failure",
"Hypertension",
"Myocardial Infarction",
"Ventricular Dysfunction, Left"
]
- expected_answer
- Diabetic Nephropathies
- condition_count
- 5
- grading_mode
- set_match
- difficulty
- hard
- tags
[
"drug-safety",
"indication",
"rxnorm",
"med-rt"
]
- model_tested
- claude-sonnet-5
- model_response
- Hypertension
- model_verdict
- correct
- model_grading_note
- Response matches one of 5 valid documented conditions (normalized match).