← All datasets
Sample

Cross-Source Verification Dataset

4 real rows pulled directly from the full dataset, unedited — the actual field structure and content a buyer receives. The full purchase includes all 42 rows.

Row 1 of 42
row_id
SD01
entity
OpenAI
method
wikidata_vs_live
fact_type
CEO
claimed_value
Sam Altman remains OpenAI's CEO as of June 2026 (reported meeting lawmakers/Trump officials in DC as OpenAI CEO)
claimed_value_source_url
https://www.cnbc.com/2026/06/03/open-ai-altman-congress-trump-eo.html
structured_value
Sam Altman (Q7407093) — preferred-rank statement for P169 (chief executive officer)
structured_value_source_url
https://www.wikidata.org/wiki/Q21708200
agreement
match
native_verdict
wikidata_accurate
explanation
Wikidata's preferred-rank P169 statement names Sam Altman, matching live June 2026 reporting. Note Wikidata's claim history also correctly preserves (as non-preferred, normal-rank statements) the brief Nov 2023 Emmett Shear/Mira Murati interim-CEO shuffle before Altman was reinstated — the rank system resolves cleanly to the current, accurate value here. The preferred statement itself carries no reference URL, which we record honestly.
model_tested
claude-sonnet-5
model_question
As of mid-2026, who holds the position of CEO at OpenAI?
model_response
As of mid-2026, Sam Altman is the CEO of OpenAI, a position he has held (aside from a brief ouster and reinstatement in November 2023) since co-founding leadership transitions in the company's history.
model_verdict
correct
model_grading_note
Matches ground truth that Sam Altman is OpenAI CEO as of mid-2026, correctly noting the brief 2023 ouster/reinstatement.
difficulty
easy
grading_mode
exact
tags
[
  "ceo",
  "openai",
  "leadership",
  "2020s"
]
Row 2 of 42
row_id
SD02
entity
Anthropic
method
wikidata_vs_live
fact_type
headquarters location
claimed_value
San Francisco, CA — currently spread across multiple SoMa buildings (>900,000 sq ft), consolidating into a new flagship HQ at 300 Howard St. planned for 2027
claimed_value_source_url
https://therealdeal.com/san-francisco/2026/04/07/anthropic-signs-another-san-francisco-office-lease/
structured_value
San Francisco (Q62)
structured_value_source_url
https://www.nasdaqprivatemarket.com/company/anthropic/
agreement
match
native_verdict
wikidata_accurate
explanation
Wikidata's P159 value is at city granularity (San Francisco), which still matches; Anthropic is expanding heavily within the same city rather than relocating, so the fact holds even though the exact address will change again in 2027.
model_tested
claude-sonnet-5
model_question
In which city is Anthropic's headquarters located?
model_response
Anthropic's headquarters is located in San Francisco, California.
model_verdict
correct
model_grading_note
Matches ground truth headquarters city of San Francisco.
difficulty
easy
grading_mode
exact
tags
[
  "headquarters",
  "anthropic",
  "location"
]
Row 3 of 42
row_id
SD03
entity
Stability AI
method
wikidata_vs_live
fact_type
headquarters location
claimed_value
London, UK — Companies House lists Stability AI Ltd's registered office as Fora - United House, 9 Pembridge Road, Notting Hill Gate, London W11 3JY; the cited Clay dossier lists the main office as 88 Notting Hill Gate, London W11 3HP
claimed_value_source_url
https://www.clay.com/dossier/stability-ai-headquarters-office-locations
structured_value
London (Q84)
structured_value_source_url
https://www.wikidata.org/wiki/Q123592234
agreement
match
native_verdict
wikidata_accurate
explanation
P159 statement (London) has no reference URL attached at all on Wikidata — recorded honestly — but the value itself still matches current company-data aggregators. Note Wikidata has no CEO (P169) statement whatsoever for this entity despite Stability AI's well-publicized 2024 CEO turnover (Emad Mostaque resigned, replaced by Prem Akkaraju), which we did not use as the row's fact_type specifically because Wikidata carries no statement to compare against for it. CORRECTION (2026-07-14 adversarial audit): the original claimed_value stated 'London, UK (9 Pembridge Road); ~187 employees as of May 31, 2026' with the Clay dossier as its only source — but that page actually gives 88 Notting Hill Gate as the main office and contains no employee count at all. The 9 Pembridge Road address is nonetheless real: re-derived live from the Companies House API (company 12295325, registered office 'Fora-United House 9, Pembridge Road, Notting Hill Gate, London W11 3JY'). The unsupported '~187 employees' figure was removed. The city-level fact (London) — the only granularity Wikidata's P159 asserts — holds on every source; agreement/native_verdict unchanged.
model_tested
claude-sonnet-5
model_question
Where is Stability AI headquartered, and approximately how many employees did the company have as of the end of May 2026?
model_response
I don't have reliable information about Stability AI's headquarters location or employee count as of end of May 2026, since that's beyond my knowledge and I have no way to verify current facts. Historically Stability AI was headquartered in London, but employee counts have fluctuated significantly (including major layoffs in 2023-2024), so I can't state a specific current figure with confidence.
model_verdict
hedged_correctly
model_grading_note
Model appropriately hedges on current employee count and only weakly/historically affirms London rather than confidently asserting current figures, consistent with real uncertainty about the numeric fact.
difficulty
hard
grading_mode
judge
tags
[
  "headquarters",
  "employee-count",
  "stability-ai",
  "coverage-gap"
]
Row 4 of 42
row_id
SD04
entity
Inflection AI
method
wikidata_vs_live
fact_type
corporate independence / ownership status
claimed_value
Sources disagree: Microsoft paid roughly $650M for a technology license (Reuters, cited in the source: $620M for a non-exclusive model license plus ~$30M more) and hired nearly the entirety of Inflection's ~70-person staff, including co-founder/CEO Mustafa Suleyman, in March 2024. The cited Columbia STLR analysis (March 2025) classes this as a 'pseudo-acquisition' -- licensing-plus-hiring used instead of an outright M&A, leaving Inflection formally unacquired and legally separate, and prompting the FTC to formally open an investigation into the deal in June 2024 -- while other commentators treat Inflection as functionally absorbed by Microsoft. Live 2026 coverage confirms Inflection still operates Pi as a smaller independent company under CEO Sean White, with a reported headcount around 70.
claimed_value_source_url
https://journals.library.columbia.edu/index.php/stlr/blog/view/671
structured_value
No statement present for P749 (parent organization) or P127 (owned by) — Wikidata records zero ownership/parent claims for this entity as of query date.
structured_value_source_url
https://www.wikidata.org/wiki/Q113270365
agreement
diverges
native_verdict
sources_conflict
explanation
Wikidata's silence (no P749/P127 statement) is arguably technically defensible — Inflection was never formally acquired — but real-world commentators themselves genuinely disagree on how to characterize its post-2024 status, ranging from 'still independent' to 'functionally absorbed by Microsoft.' This is the messiest row in the pilot: not a clean stale-vs-accurate case but a live definitional dispute that structured data (which only models formal corporate-legal relationships) is poorly suited to capture at all. CORRECTION (2026-07-14 adversarial audit): the original claimed_value attributed a direct quote ('did not formally purchase any assets of Inflection, which remains a separate, independent company') to 'legal/industry analyses in 2026'; the cited Columbia STLR blog post is dated March 24, 2025 and contains no such sentence. Its actual content (pseudo-acquisition framing, $650M license with staff hired away, FTC probe) fully supports the row's substance, which was also re-confirmed against live 2026 coverage (Pi still operating; ~70 employees; CEO Sean White). Wording rewritten to match the source; agreement/native_verdict unchanged.
model_tested
claude-sonnet-5
model_question
Following Microsoft's 2024 deal involving Inflection AI's technology and staff, what is Inflection AI's current corporate ownership and independence status?
model_response
Following the April 2024 deal, Inflection AI is no longer really an independent AI lab: Microsoft paid roughly $650 million (structured as a licensing deal plus hiring payout) to license Inflection's models and hire away most of its staff, including co-founders Mustafa Suleyman and Karén Simonyan, who now lead Microsoft AI. Inflection itself continues to exist as a separate company (not owned by Microsoft), now focused on selling its AI to enterprises under new CEO Sean White, but it lost its core research team and the deal effectively gutted its original mission of building frontier AI independently.
model_verdict
correct
model_grading_note
Model's description (Microsoft licensed tech/hired staff including Suleyman, Inflection remains a separate, not-Microsoft-owned company) matches the substance of the ground truth's account of the messy pseudo-acquisition/independence status.
difficulty
hard
grading_mode
judge
tags
[
  "ownership",
  "inflection-ai",
  "acquisition",
  "ambiguous"
]
Buy full dataset — $319