Carrier / Retrieval Lab R02
Carrier Retrieval Lab · Study R02
Questions first.
Answers on trial.
Explore what happens when information needs are written before the concepts are revealed—and when a better-looking result must still help someone answer the question.
The lab compares a development-selected text or dense baseline with a small contribution from typed relations. Every task has explicit answer obligations and conditions. The public explorer keeps the selected methods’ top five definitions beside the question, then lets you inspect source provenance, full relation qualifications, recorded reader answers, and their assessments.
The retrieval result did not establish an advantage for the typed method. Its final pooled nDCG@5 was 0.670678, compared with 0.674080 for the selected dense baseline. The paired difference was -0.003402, with a 95% interval of [-0.010205, 0.000000]. This is a result about one frozen experiment, not a verdict on every use of a graph.
Answers were tested separately. The separate answer endpoint also does not establish an advantage for the typed-context assignment. The recorded mean score difference was +0.013889 on the 0–1 rubric (95% interval [-0.003472, 0.031279]). Both endpoints, their jointly adjusted tests, and all recorded answers are available in the report.
Four ways to inspect the evidence
Twenty-four tasks are AI adaptations of attributed public human questions; another 24 are original AI-authored scenarios. These origins remain labeled separately. The browser filters the frozen collection locally. It does not upload your wording or call an inference service.
A typed path is a retrieval hint, not an entailed answer. The sparse overlay reaches 3.77% of the corpus and changes the ordered top five on only two of the 36 final questions. The questions, relevance judgments, readers, and graders all carry the study’s stated model-family and sampling limitations.
Technical reportFrozen protocolTasks and attributionRetrieval resultsAnswer resultsFull experiment kitReader challenge
The full experiment kit includes the pinned local model and its assets. Carrier’s 6,257 checked records remain unchanged; their existing author credits, source attribution, and terms are preserved. Public question sources retain their individual attribution and API-reported CC BY-SA licenses.