Sample

SEC / EDGAR Financial Grounding

4 real rows from the existing reference export, unedited. Review the schema and provenance here; confirm the specific package and delivery terms before purchasing.

CapabilitySEC financial fact grounding

Designationmixed

Version2026-08-30

Updated2026-08-30

SourcesSEC EDGAR companyfacts, SEC EDGAR companyconcept, SEC EDGAR submissions metadata, 10-K and 10-Q filing metadata

FormatsJSON, JSONL eval, JSONL remediation, JSONL SFT, JSONL observed-failure DPO

Product typeproduct family

Pricing modelcomponent pricing

500Proof rowsFresh SEC EDGAR proof evaluation.

27.2%Baseline accuracy136/500 correct on the completed chatgpt-web proof run.

72.8%Baseline error rate364/500 incorrect, 0 refusals.

68.7% to 76.5%Error 95% CIWilson interval from the 500-row proof result.

10,000Remediation rowsValidated SEC-source remediation/training records.

1,000Held-out rowsUntouched validation rows excluded from proof and remediation.

364Observed-failure DPORejected answers are real proof-run model errors.

Pricing

Legacy SEC diagnostic exportdiagnostic eval

$299 reference price

41 actual rows

Existing published JSON export with verified SEC financial-filing rows.

Request package

SEC / EDGAR Financial Proof Evalproof eval

$1,299 reference price

500 actual rows

Fresh SEC EDGAR proof set with completed chatgpt-web browser run and deterministic source-aware grading.

Request package

SEC / EDGAR Remediation 10kremediation training

$6,900 reference price

10,000 actual rows

Validated SEC companyfacts/companyconcept remediation records targeting observed numeric, temporal, and calculation failures.

Request package

SEC / EDGAR Held-Out Validationheld out validation

$1,500 reference price

1,000 actual rows

Untouched SEC EDGAR validation rows excluded from proof and remediation source records.

Request package

SEC Financial Grounding Improvement Packfull improvement pack

$8,500 reference price

11,500 actual rows

500-row proof eval, 10,000 remediation rows, and 1,000 held-out validation rows. No model improvement result is included yet.

Request package

SEC 25k+ expansioncustom dataset

Custom quote

Requires a separate source-supply and validation review before any larger package is claimed.

Request package

Legacy SEC diagnostic exportdiagnostic

41 rows

published

Historical verified SEC financial-filing export.

SEC / EDGAR proof evalproof eval

500 rows

graded_confirmed_weakness

Fresh proof set with 27.2% chatgpt-web accuracy and deterministic SEC-source grading.

SEC / EDGAR remediation 10kremediation

10,000 rows

passed

Training-oriented records targeting observed numeric, temporal, and calculation failures.

SEC / EDGAR held-out validationheld out

1,000 rows

passed

Untouched validation rows not used for remediation generation.

SEC observed-failure DPO poolremediation

364 rows

proof_derived_observed_failures

Rejected responses are real observed proof-run errors, not synthetic negatives.

Public SEC samplesample

75 rows

public_preview

Proof-derived public sample. It does not include remediation or held-out rows.

Schema fields

question, verified_answer, accepted_answers, cik, accession_number, xbrl_concept, period_end, raw_sec_value, unit, task_family, source_urls

Limitations

The proof result is specific to the completed chatgpt-web browser run and deterministic SEC-source grading.
This is not a universal claim about every financial task or every model.
No post-training improvement has been measured yet.
25k, 50k, and 100k SEC remediation assets are not claimed.

Row 1 of 41

row_id

SEF01

claim

Apple's fiscal year 2024 total revenue was $391.0 billion, per its FY2024 fourth-quarter/full-year press release.

claim_source_url

https://www.apple.com/newsroom/2024/10/apple-reports-fourth-quarter-results/

verification_method

sec_edgar_xbrl_companyconcept

verified_value

$391,035,000,000 (exact, as filed)

verification_source_url

https://www.sec.gov/Archives/edgar/data/320193/000032019324000123/0000320193-24-000123-index.htm

agreement

match

explanation

Live SEC EDGAR companyconcept lookup (CIK 0000320193, us-gaap:RevenueFromContractWithCustomerExcludingAssessedTax, fy=2024/fp=FY) returned the actual filed value $391,035,000,000 from the real 10-K filed 2024-11-01 (accession 0000320193-24-000123, period 2023-10-01 to 2024-09-28). Claimed value $391,000,000,000 differs by 0.009% from the actual filed figure, within normal press-release rounding.

grading_mode

numeric

difficulty

easy

tags

[
  "apple",
  "revenue",
  "fy2024",
  "tech"
]

model_tested

claude-sonnet-5

model_question

What was Apple's total revenue for fiscal year 2024 (the year ended September 28, 2024), as reported in its official SEC filing?

model_response

Apple reported total net sales of about $391.0 billion for fiscal year 2024 (ended September 28, 2024) in its 10-K filing, with net income of roughly $93.7 billion. I recall this with fairly high confidence but wouldn't rule out being off by a small amount on the exact figures.

model_verdict

correct

model_grading_note

Revenue figure ($391.0B) matches the filed $391,035,000,000 and is appropriately hedged as approximate/recalled.

Row 2 of 41

row_id

SEF02

claim

Apple's diluted earnings per share for fiscal year 2024 (ended September 28, 2024) was $6.08.

claim_source_url

https://www.sec.gov/Archives/edgar/data/320193/000032019324000123/0000320193-24-000123-index.htm

verification_method

sec_edgar_xbrl_companyconcept

verified_value

$6.08 (exact, as filed)

verification_source_url

https://www.sec.gov/Archives/edgar/data/320193/000032019324000123/0000320193-24-000123-index.htm

agreement

match

explanation

Live SEC EDGAR companyconcept lookup (CIK 0000320193, us-gaap:EarningsPerShareDiluted, fy=2024/fp=FY) returned the actual filed value $6.08 USD/shares from the real 10-K filed 2024-11-01 (accession 0000320193-24-000123, period 2023-10-01 to 2024-09-28). Claimed value $6.08 differs by 0.000% from the actual filed figure, within normal press-release rounding.

grading_mode

numeric

difficulty

medium

tags

[
  "apple",
  "eps",
  "fy2024",
  "tech"
]

model_tested

claude-sonnet-5

model_question

What was Apple's diluted earnings per share for fiscal year 2024 (ended September 28, 2024)?

model_response

Apple's diluted earnings per share for fiscal year 2024 (ended September 28, 2024) was $6.08.

model_verdict

correct

model_grading_note

Diluted EPS of $6.08 matches the exact filed figure.

Row 3 of 41

row_id

SEF03

claim

Apple's R&D spending kept climbing in fiscal year 2025, reaching about $34.6 billion — up from $31.4 billion in FY2024.

claim_source_url

https://www.sec.gov/Archives/edgar/data/320193/000032019325000079/

verification_method

sec_edgar_xbrl_companyconcept

verified_value

$34,550,000,000 (exact, as filed)

verification_source_url

https://www.sec.gov/Archives/edgar/data/320193/000032019325000079/0000320193-25-000079-index.htm

agreement

match

explanation

Live SEC EDGAR companyconcept lookup (CIK 0000320193, us-gaap:ResearchAndDevelopmentExpense, fy=2025/fp=FY) returned the actual filed value $34,550,000,000 from the real 10-K filed 2025-10-31 (accession 0000320193-25-000079, period 2024-09-29 to 2025-09-27). Claimed value $34,600,000,000 differs by 0.145% from the actual filed figure, within normal press-release rounding. This is already Apple's most recently filed fiscal year as of this build (2026-07-11) — the FY2025 10-K was filed 2025-10-31 — demonstrating this dataset checks against data more current than most general knowledge cutoffs, not a stale prior year.

grading_mode

numeric

difficulty

hard

tags

[
  "apple",
  "rd-spending",
  "fy2025",
  "tech"
]

model_tested

claude-sonnet-5

model_question

What was Apple's research and development expense for fiscal year 2025, and how did it compare to fiscal year 2024's R&D spending?

model_response

Apple's R&D expense for fiscal year 2025 was roughly $34–35 billion, up modestly (mid-to-high single digits percent) from about $31.4 billion in fiscal year 2024. I don't have the exact final audited figure memorized with confidence, so treat the FY2025 number as an approximate estimate rather than a precise citation.

model_verdict

hallucinated

model_grading_note

The FY2025 R&D figure ($34-35B) is correct, but the stated growth rate 'mid-to-high single digits percent' is wrong — actual growth from $31.4B to $34.55B is about 10% (low double digits), a confidently stated incorrect detail.

Row 4 of 41

row_id

SEF04

claim

Apple filed its fiscal year 2024 Form 10-K with the SEC on November 1, 2024.

claim_source_url

https://www.apple.com/newsroom/2024/10/apple-reports-fourth-quarter-results/

verification_method

sec_edgar_filing_history

verified_value

2024-11-01 (per SEC's own submissions index)

verification_source_url

https://www.sec.gov/Archives/edgar/data/320193/000032019324000123/0000320193-24-000123-index.htm

agreement

match

explanation

Live query to data.sec.gov/submissions/CIK0000320193.json (SEC's own filing-history index, distinct from the companyconcept XBRL-facts API) — found the 10-K with reportDate=2024-09-28 (Apple's FY2024 fiscal year end) at accession 0000320193-24-000123, with SEC's own recorded filingDate of 2024-11-01, exactly matching the claim.

grading_mode

exact

difficulty

medium

tags

[
  "apple",
  "filing-date",
  "10-k",
  "tech"
]

model_tested

claude-sonnet-5

model_question

On what date did Apple file its Form 10-K annual report for fiscal year 2024 with the SEC?

model_response

Apple filed its Form 10-K for fiscal year 2024 (fiscal year ended September 28, 2024) with the SEC on November 1, 2024.

model_verdict

correct

model_grading_note

Filing date November 1, 2024 matches the SEC filing history exactly.

Discuss this archived dataset