§ Journal

Engineering

9 min read

How we check that a source really says what we claim

A citation that points at the wrong page is worse than no citation. This is the checking step we run before an answer is shown.

Jonas Ekwueme

Finding the right file is the easy part. The hard part is proving a sentence in the answer is supported by a sentence in the file.

Two passes

First, Ostler writes the answer while holding on to the exact passages it read. Second, a separate check compares each claim with its passage and drops any claim it cannot match.

What we measure

We keep a set of 2,400 questions with hand-checked answers. Every release must match or beat the last on how often a claim is supported by the passage it cites.

The Ostler letter

Notes like these, once a month.

New articles, release notes and one useful link.

Create a free website with Framer, the website builder loved by startups, designers and agencies.