Chapter 07 of 17

Why

Concepts

Chapter 7 β€” Why (rebuilt 2026-09-19)

Source: 07-chapter.md (evidence-lineage rebuild)

What this chapter is really about

Underneath the support graph, this chapter is about the difference between finding an answer and being entitled to it. Its deepest move is forward-looking: provenance is not documentation of how a belief was formed but the instrument panel for its future revision β€” “what future evidence should attack.” That reframes justification from backward-looking explanation to forward-looking maintainability. The hidden question: what must be preserved now so that a belief can be changed later? Everything in the chapter (support vs derivation edges, raw-span termination, multi-source coverage) follows from designing beliefs to be revisable.

Rebuild thesis: provinance is maintained dependency information connecting derived claims to the evidence that licenses them. Lineage tells us where information came from; support tells us why we are entitled to believe it.

Current thesis (rebuilt)

Explicit claims

  • Four “why” traces are distinct: retrieval causality (why recalled), control causality (why this process), derivation lineage (what generated this), evidential support (what licenses this).
  • Source pointers suffice for single-source facts and fail four ways: multiple support, summary qualification-dropping, echo-as- corroboration, non-supporting sources.
  • Support is a relation between items with AND/OR group logic: conjunction inside a group, disjunction across groups (MEG semantics).
  • Echoes are derivation, never evidence; repetition counted as corroboration is echo inflation.
  • Graph connectivity is a support hypothesis, never support (the connectivity-support gap).
  • Scoring rules: right answer with wrong chain fails justification; chains must terminate in raw artifacts for inspectability.
  • Raw-source termination guarantees inspectability and historical grounding, not truth.
  • Support edges carry their own provenance (extractor, version, licensing spans, extraction confidence); extraction confidence is not claim truth.
  • Claim extraction is measured fallible infrastructure with abstention on unresolvable ambiguity.
  • Retraction propagates dependency impact (requires reevaluation) without deciding new belief (Chapter 8 boundary).

Implied claims

  • Every belief worth holding will need future revision β€” revisability is the norm.
  • Partial chains deserve partial credit only under support logic; coverage-as-fraction is wrong for conjunctive support.
  • One underlying dependency model serves four consumers (reader, verifier, auditor, revision engine) with different views.

Established by the frozen run (ch7-20260919-e7)

  • P0 pointer: support precision/coverage 0.286; P1 direct citation: 0.500/1.000; P2 explicit groups: 1.000/1.000 (E7-A).
  • Group exact match: P0 0.11, P1 0.44, P2 1.0 (E7-C).
  • Extraction coverage ties at 0.70 across C0/C1/C2; separation is in qualifier flags (C0 misses 3, C1/C2 miss 0) and abstention (E7-B).
  • Echo overlap heuristic recalls 0.40 of the paraphrase ladder; exact/near only (E7-D).
  • Connectivity-trap rejection recall 1.0 (E7-E).
  • Lineage completeness 5/9 with honest open ends (E7-F).
  • Error localisation 3/3 (E7-G).
  • Impact precision/recall 1.0 on both retractions; redundant removal preserves support (E7-H, E7-I).
  • All four answer/evidence divergence cells filled (E7-J).
  • Costs: 26 nodes, 20 edges, ~1ms, zero model calls (fixture scope).

Not yet established

  • That support/derivation edges can be extracted at usable reliability on real multi-source material (fixture extraction is ledger-given; LLM extraction reserved).
  • That LLM-as-judge verification transfers (AttributionBench/CiteEval caution; ledger-first ordering kept).
  • That echo detection works beyond near-duplicates without recorded edges.
  • That persistent lineage earns its cost on the real corpus (Type A verdict is fixture-scoped; B/C/D demotion clauses recorded).

What the chapter gives us

  • Four-way why separation as architecture: retrieval and control traces preserved as annotations, never scored as support.
  • Support groups with AND/OR logic, fixing the coverage-fraction critique from the old concepts file.
  • Edge taxonomy with enforced semantics: SUPPORTED_BY, DERIVED_FROM, ECHO_OF, REFUTES (recorded only).
  • VeriTrail-style reverse verification with first-failure error localisation.
  • Retraction/impact machinery as revision infrastructure.
  • Grounding-is-not-truth demonstrated, not just stated (lying source fixture).
  • Evaluator discipline: deterministic fixtures first, mechanical checks second, judges last or never.

Where the treatment stops (by design)

  • Source reliability as maintained state: extension point only.
  • Conflict resolution, temporal validity, current belief: Chapter 8.
  • Support strength / confidence aggregation: deferred.
  • Provenance compression and retention policy: deferred.
  • LLM-backed extraction and verification: reserved, manifest-gated.

Concepts added in the rebuild

Evidence lineage; claim decomposition; claim coverage; decontextualisation; grounding; process lineage; evidential support; retrieval causality; control causality; connectivity-support gap; error localisation; multi-stage hallucination; evidence groups; minimal evidence groups; conjunctive support; alternative sufficient support; keystone evidence; redundancy; echo versus corroboration; derived-state provenance; raw grounding; inspectability versus truth; edge provenance; support-edge extraction confidence; support graph health; dependency impact; retraction; reevaluation; evidence consumer; citation evaluation uncertainty; verification of derived memories; open lineage; find versus represent.

The deeper territory (preserved)

  • Justification versus causation. Support edges flatten causal texture into uniform “support.” Undermining a correlative leg differs from undermining the decisive one; keystone marking is the first step, causal roles remain open.
  • The ground problem. Termination is in rated-by-nothing raw spans; reliability maintenance is the named successor track.
  • Provenance of provenance. Edges carry extraction provenance; the regress cuts at inspectable spans by declaration.
  • Consumer granularity. One model, four views; rendering requirements per consumer still mostly unbuilt.

Concepts worth developing (carried forward)

Support logic: keystones, redundancies, alternatives

Implemented at group level (AND within, OR across). Leg-level keystone flags inside a group (necessary vs contributing member) remain unbuilt; fixture groups are small enough that leg removal experiments cover the need mechanically.

Source reliability as parallel maintained state

Extension point in the schema (source identity recorded on every span). Cold-start, gaming, and reliability provenance unresolved; spans Chapters 7, 8, 17, 18.

Edge provenance and the regress cut

Implemented: extractor, version, licensing spans, extraction confidence on every edge. Storage/maintenance cost at scale unmeasured.

Important distinctions

  • Support (licenses belief) versus derivation (restates prior) versus retrieval (recalls) versus control (chooses process).
  • Traceability (can find the span) versus auditability (someone checks it) versus truth (the span is right).
  • Conjunctive versus disjunctive support.
  • Claim confidence versus extraction confidence versus source reliability versus memory utility.
  • Recorded lineage versus reconstructed support hypotheses.
  • Invalidation (flag dependents, keep history) versus deletion.
  • Explanation from structure (rendering) versus explanation as structure (post-hoc prose, refused).

What mechanism makes this work?

Support-graph construction at ingest (edge extraction with span-level edge provenance), claim extraction with abstention, chain resolution at query (walk supported-by to grounds, follow derived-from past summaries), reverse verification with error localisation, chain scoring (coverage under support logic, precision against non-supporting distractors, group validity, raw-termination check), retraction propagation. Error entry: edge-extraction errors (manufactured justification β€” most dangerous), echo-miss (corroboration inflation), keystone-miss (silent incompleteness), claim-extraction errors (wrong verification target), evaluator error (judge trusted too far). Missing: audit consumer protocol, source-reliability maintenance, leg-level keystone flags, LLM-backed stages.

Connections to the rest of the book

  • Consumes Chapter 3 spans (grounding boundary), Chapter 4 derived objects (lineage adapters), Chapter 5 traces (retrieval causality annotations), Chapter 6 traces (control causality annotations).
  • Exposes Ch4-6 insufficiency: pointers, paths, and routes are not relations that license belief.
  • Prepares Chapter 8: correction propagates through these chains; expiry attacks these legs; the resolver consumes support_for, dependents_of, requires_reevaluation.
  • Echo/corroboration machinery recurs in Chapter 15 (support counting) and Chapter 16 (outcome attribution).
  • Forward-looking principle justifies uncertainty marks (Ch 8), scope bounds (Ch 15), and procedure preconditions (Ch 16).

Beyond the current book

  • Citation evaluation: ALCE, RARR, Self-RAG, GopherCite plus AttributionBench, CiteEval β€” the chapter extends them with multi-source groups and derivation typing.
  • Claim extraction: Claimify (selection/disambiguation/ decomposition; entailment/coverage/decontextualisation metrics).
  • Traceability: VeriTrail (DAG, reverse verification, error stages).
  • Minimal support: MEG (TrustNLP 2025) formalisation.
  • Graph evidence: PAGE-RAG (connectivity-support gap), LineageRAG (demand lineages, verbatim grounding, open lineages).
  • Multi-hop verification: HARIS (find half of find-vs-represent).
  • Truth maintenance systems (Doyle): dependency-directed revision as the classical “future evidence knows what to attack.”
  • Legal reasoning: holdings versus dicta, precedent chains.
  • XAI faithfulness debate: maps onto right-answer-wrong-chain.

Possible future claims

Already supportable (fixture evidence)

  • Single pointers cannot express joint support or echo structure (representational fact + measured gaps).
  • Right-answer-wrong-chain fails justification under a revisability criterion (demonstrated across all four divergence cells).
  • First-failure localisation works where stage truth is recorded.
  • Keystone vs redundant withdrawal diverges mechanically.

Plausible but needs development

  • Support/derivation edges repair multi-source and echo cases at bounded extraction cost on real corpora (the Type-A bet extended).
  • Overlap echo detection suffices where derivation is recorded at transform time (limits mapped, not solved).

Speculative

  • Derivation edges extractable across paraphrase and time at usable reliability.
  • Raw-span termination plus reliability maintenance grounds better than raw testimony alone.

Claims worth attacking

  • “Chains must terminate in raw artifacts.” Counter: rated sources with maintained reliability may ground better. The rule confuses inspectability with grounding β€” kept deliberately as inspectability-only, with reliability as the named successor.
  • “A plausible answer with an incorrect chain is a failure.” Counter: for pure QA use the chain is overhead β€” verdict is task-relative; the chapter scopes it to revision-critical tasks.

Tensions and counterarguments

  • Extraction-danger asymmetry: wrong support edges manufacture justification (read as confidence) β€” worse than missing edges.
  • Consumer vacuum partially filled: four consumers named, one model; per-consumer rendering mostly unbuilt.
  • Provenance cost at scale unmeasured; invariant scoped to behaviour-influencing derived memory.

Examples and thought experiments (all now fixtures)

  • Keystone retraction (s19 vs a07 withdrawals).
  • Lying session s33 (inspectable and false).
  • Paraphrase echo ladder (five rungs, recall mapped).
  • 14% hallucination (summary-stage injection, localised).
  • Redis-cause trap (routing pass, evidence fail).
  • Invoice-183 trap (retrieval pass, evidence fail).
  • Causal-gap case (benchmark proves speed, not the failure link).
  • Summary qualification drop (wiki performance claim).

Research questions this chapter creates

  • What methods extract evidential (not topical) relations, and at what reliability on real project history?
  • At what paraphrase distance does derivation detection fail without recorded edges?
  • What does the XAI faithfulness literature imply for right-answer-wrong-chain scoring across task stakes?
  • How much provenance is enough before compression becomes the binding constraint?

Architectural implications

  • AND/OR support logic belongs in the schema from the start (settled: groups implemented).
  • Source reliability as maintained state is a new track spanning Chapters 7, 8, 17, 18.
  • Edge provenance is a book-wide invariant candidate for all derived structure.
  • Provenance levels (L0-L4) considered, not implemented; cost/quality experiment reserved.

How we know this works

Chain-validity scores separate pointer baselines from graph systems on multi-source/echo cases with decision correctness held constant (E7-A/C), and retraction exercises succeed mechanically (E7-H/I). It fails usefully if pointer baselines chain correctly wherever decisions are right on harder material β€” meaning the fixtures, not the world, needed the graph.

The chapter at its highest level

Justification as future-revision instrumentation; four separated “why” traces; support logic over legs; grounding distinguished from truth; edge provenance with an explicit regress cut; echo limits mapped; retraction demonstrated; costs counted; verdict scoped. The current version builds the graph and grounds it in fixtures; the ideal version earns it on the real corpus.

Discussion

Start here

  • Chains terminate in raw artifacts β€” but raw artifacts can be inspectable and false. What grounds the ground?
  • Is support additive or logical β€” and does the scoring rule change the answer? (Answered for groups; open for leg strengths.)
  • Where is the regress cut for edge provenance β€” and is “trust bottoms at inspectability” honest or convenient?

Push the idea further

  • Does every later derived structure inherit edge provenance β€” and what does that cost at five years of accumulation?
  • When the keystone leg is undermined years later, does the system retract precisely or rebuild from scratch?
  • Does provenance itself need forgetting, compression, consolidation?

Decisions made in the rebuild

  • Support logic enters the schema now (groups), leg-level keystones later.
  • Source reliability stays an extension point; identity recorded.
  • Four consumers named; one model with views (rendering deferred).
  • LLM-backed extraction/verification reserved behind manifests.
  • Verdict Type A on fixture evidence with B/C/D demotions recorded.

New ideas worth exploring

  • Claim/extraction/source/utility confidence quad as the confidence-placement answer.
  • Truth-maintenance-style dependency-directed revision as classical precedent.
  • Open lineage as a first-class query (“what is ungrounded?”).
  • Minimal sufficient evidence as the reader-context policy (PAGE-RAG/MEG convergence).

Explain this chapter with AI

Copy this prompt into ChatGPT, Claude, Gemini, a local model, or another AI.

Apply this chapter with AI

Copy this prompt into ChatGPT, Claude, Gemini, a local model, or another AI.

Chapters 3 through 6 leave the system with a working pipeline and an uncomfortable surplus. Chapter 3 retrieves raw history. Chapter 4 derives a persistent graph from it. Chapter 5 propagates activation across that graph. Chapter 6 chooses between these mechanisms. A candidate memory reaches the reader, the reader writes an answer, and the answer contains claims about the project. This chapter asks the book’s third question β€” why did we decide or believe this? β€” in the form the pipeline forces:

A memory system has produced a claim. What gives it the right to believe or say that claim?

That is not the same as asking where the text came from, how the system retrieved a memory, which subsystem the Nexus chose, or whether the claim is still true. Those are three other questions plus a later chapter. This chapter is about evidential justification and traceable derivation, and its thesis is:

Provenance is not a citation attached to an answer. It is maintained dependency information connecting derived claims to the evidence that licenses them.

A second formulation runs through the whole chapter: lineage tells us where information came from, while support tells us why we are entitled to believe it. Both are tested below against an implementation and a frozen experiment suite rather than asserted.

A citation is not a reason

The old version of this chapter opened with the simplest provenance β€” a source pointer on every stored belief β€” and four ways it breaks. The four failures survive the rebuild unchanged, because they are representational facts rather than implementation details.

Multiple support. The PostgreSQL decision rested on several pieces jointly: the contention report in session-014, the benchmark in session-019, the importer incident incident-021, and the rationale in adr-007 that ties them together. No single span contains the rationale. A single pointer must either pick one leg, understating the evidence, or point at the decision record that summarises them, which moves the problem one step back.

Summaries that drop qualifications. A later wiki page restates the decision as use of PostgreSQL for performance, omitting that the advantage applied to concurrent-write workloads and that the team accepted higher operational cost. A pointer to the summary supports the simplified belief while hiding the qualification that determines its scope. The chain must reach past the summary to the evidence the summary compressed.

Repeated old decisions. The August runbook repeats that the event store runs on PostgreSQL without noting that it restates July’s outcome. A pointer to the runbook looks like independent confirmation; traced properly, it is the same belief echoed. Without derivation edges, repetition masquerades as corroboration.

Non-supporting sources. A passage can be topically relevant, correctly retrieved, and genuinely similar to the claim while not supporting it. The pre-decision note in session-033 argues the losing side β€” keep SQLite for operational simplicity. Citing it as justification for the migration is worse than citing nothing, because it lends the belief borrowed authority.

Each failure shows the same missing piece: support is a relation between items, not a property of one item. A pointer records where a belief was found. It does not record what the belief was inferred from.

Four different meanings of β€œwhy”

The rebuilt pipeline produces four traces that all sound like answers to β€œwhy”, and the chapter’s first architectural act is to refuse to conflate them.

Retrieval causality answers why a memory was recalled: the query led through Bill to Project Alpha to invoice-183. That is Chapter 5 pathway information. It does not establish that the invoice supports the answer; in the fixture it does not, because the invoice records routine renewal unrelated to the budget variance.

Control causality answers why the system used one memory process rather than another: the Nexus chose associative retrieval because direct retrieval confidence was low. That is Chapter 6 routing information. It does not establish that the resulting claim is true.

Derivation lineage answers what generated a representation: source spans led to an extracted relation, which led to a community summary, which led to retrieved context, which led to the final answer. That explains where derived information came from. It still does not establish evidential support, because any stage may have added content its inputs do not license.

Evidential support answers which evidence actually licenses the claim: the contention benchmark, the importer incident, and the decision rationale jointly support the statement that contention motivated the migration. Only this fourth relation is the chapter’s subject. The other three are preserved as annotations on the same graph, stored where they can never be mistaken for support.

    flowchart TD
    Q[query] --> NX[Nexus route]
    NX -->|control causality| AP[associative path]
    AP -->|retrieval causality| DG[derived graph object]
    DG -->|derivation lineage| SE[source evidence]
    SE -->|evidential support| CL[claim licence]
    style CL fill:#3978c5,color:#fff
  

The cost of derived memory

Chapter 6’s frozen measurements motivate everything that follows, and they are worth restating precisely because they cut against the obvious story. On eight measured routing tasks, raw evidence was extremely strong, graph modes carried substantial unsupported-source harm (0.43 to 0.79 against zero for raw evidence, associative recall, and no-memory), and the oracle router’s headroom over the best fixed policy was cost-only: quality headroom 0.000, utility headroom 0.067. The single discriminating provenance task, q3-why-postgres, split quality 1.0 for raw evidence against 0.5 for every other measured capability.

Book result. Chapter 6’s matrix (experiments/benchmark/runs/ch6-20260919-nexus/) shows derived machinery adding harm as well as structure on the fixture tasks.

The emerging problem is therefore sharp: every derived stage potentially adds useful structure and another place where unsupported information can enter. More derivation is not monotonically better. Chapter 7 makes that measurable by tracing each claim through every stage and testing each stage separately.

Claims first

Verification cannot begin until the system decides what needs verifying, and a sentence is not a claim. The sentence stating that PostgreSQL was selected because SQLite contention caused the importer failures contains at least four checkable propositions: that PostgreSQL was selected, that SQLite experienced contention, that the contention contributed to importer failures, and that those events contributed to the decision. A citation attached to the whole sentence may support only some of them.

Claim extraction is itself fallible infrastructure, so the layer treats it as a measured component rather than a preprocessing given. Three deterministic baselines are implemented. C0 splits sentences and stops. C1 applies a constrained schema: splitting on conjunctions and causal joints, and flagging negation, conditionals, and attribution. C2 reproduces the published Claimify shape β€” selection of verifiable content, disambiguation with abstention on unresolvable reference, decomposition into atomic claims β€” without any Claimify code, and is labelled Claimify-inspired throughout. A claim records its source span, its producer, and its producer version, because a support graph built with a new extractor is a different derived artifact.

Book result. On seven labelled sentences covering conjunction, causation, qualification, negation, conditionals, attribution, and ambiguity (ch7-20260919-e7, E7-B), all three extractors reach identical coverage of 0.70, while the baselines separate on exactly the axes the literature predicts: the sentence baseline misses all three qualifier flags, the structured extractors miss none, and the Claimify-inspired extractor is the only one that abstains on the unresolvable reference instead of inventing a claim for it.

The tie on coverage is reported rather than hidden: deterministic splitting does not beat sentences at finding propositions. Its value lies in flags and abstention. A verification system cannot be more trustworthy than the claims it decided to verify, and abstention on β€œIts behaviour changed” with no resolvable referent is the honest output.

Support is a relation

With claims fixed, the layer proposes candidate evidence and then decides whether each candidate actually supports the claim. The fixture plants the adversarial cases deliberately: the losing-side note, a benchmark of a different importer reached through a valid associative path, a qualification-dropping summary, and an echo of the decision. Retrieval success and evidence success diverge on purpose.

Book result. The evidence filter rejects every planted non-supporting candidate while keeping every genuine leg (E7-E, rejection recall 1.0 on both the migration case and the invoice trap). A valid Chapter 5 path through a benchmark of the wrong importer is retrieval working and evidence failing at once.

Provenance precision penalises the specific sin this invites: citing genuine but non-supporting evidence. A citation should not borrow authority merely by looking relevant. The instrument therefore scores answer correctness and evidence correctness as separate axes. The fixture’s four reader outputs fill all four cells β€” right answer with right evidence, right answer with wrong evidence, wrong answer with right evidence for a subclaim, wrong answer with wrong evidence β€” and the layer’s verdict is that a correct answer carried by an invalid chain fails justification even where it passes question answering (E7-J). For revision-critical tasks that failure verdict is the whole point; for trivial lookups the layer’s own cost accounting says the machinery may not be worth running, and the chapter keeps that task-sensitivity explicit.

One source is rarely enough, and evidence has logic

The migration rationale needs three legs at once: the benchmark establishes contention, the incident establishes operational consequence, and the decision record connects those observations to the choice. No single source fully licenses the claim. Worse, legs do not add up the way coverage fractions pretend. If the benchmark is the keystone, losing it invalidates the rationale even while four weak supporting artifacts remain; conversely, an independent benchmark rerun can carry the same leg, so that losing one of two sufficient routes changes nothing.

The representation answers with support groups: conjunction inside each group, disjunction across groups. The main claim carries two alternative groups β€” benchmark plus incident plus rationale, and independent rerun plus incident plus rationale β€” which is the minimal-evidence-group semantics of Li and colleagues: sufficient, non-redundant, minimal sets, with alternatives allowed. Minimality is checked group-relatively, because a pair licensed inside one group says nothing about its role in another.

Book result. Group exact-match rates separate the representations completely (E7-C): single pointers 0.11, direct citation of everything retrieved 0.44, explicit support groups 1.0. The pointer cannot express conjunction; direct citation cannot express minimality, and counts echoes as legs.

Repetition is not corroboration

The decision record, the runbook, and the wiki page all say the event store runs on PostgreSQL. Counted as citations that is threefold support. Traced as derivation it is one observation plus two echoes, and the layer stores ECHO_OF edges to say so. Twenty echo documents must never outweigh one independent benchmark, and the experiment maps exactly where the cheap detection stops working.

Book result. A token-overlap echo heuristic at threshold 0.55 recalls 0.40 of a five-rung paraphrase ladder (E7-D): exact copy and near paraphrase are caught, heavy paraphrase, summary, and changed terminology are not. Beyond near-duplicates the system relies on recorded derivation edges, not on resemblance.

That boundary is stated as a limit rather than a roadmap promise. If derivation edges cannot be recorded through a transformation, the echo distinction for that transformation is scorer fiction, and the chapter refuses to claim general paraphrase-robust echo detection.

A graph connection is not evidence

Chapters 4 and 5 connect relevant-looking information: Bill to Project Alpha to budget to invoice. The connection is real and the retrieval is valid. The invoice still supports nothing about the budget claim. Deng and colleagues give this failure its sharpest published form as the connectivity-support gap: graph edges are support hypotheses, not support, and a fixed-budget reader needs the hypotheses tested before promotion. The layer implements the testing side of that split. Association proposes; only the support relation disposes, and the retrieval trace is kept alongside the verdict so that debugging can see both.

Follow the lineage backward

For claims that pass through derived GraphRAG state β€” source chunk to entity extraction to relationship to community summary to retrieved context to answer β€” the layer walks the chain in reverse, asking at each stage whether the stage output is supported by its inputs. The design follows VeriTrail directly: a DAG model of the multi-step workflow, reverse-order verification, per-stage verdicts of fully supported, not fully supported, or inconclusive, and an evidence trail of selected spans with node identities for supported claims. What is borrowed is the shape and the verdict discipline, not the model judgements: on fixtures, ledger truth drives every verdict, and any LLM-backed verifier would be a new run with its own manifest, never a silent substitution.

Demands stay explicit through the walk in the LineageRAG spirit: each stage output must establish something specifiable, grounding completes in verbatim source spans, and lineages that never reach a span stay visibly open rather than being rounded up to supported.

Book result. Five of nine fixture claims trace completely to raw spans with no open ends; four remain honestly open β€” two with no support structure at all, one grounded only in a harmful derived relation with no raw path, and the hallucinated figure discussed next (E7-F). Open lineage is an incompleteness signal, not a failure to be smoothed over.

Where did the error enter?

The most useful new capability is localisation. A community summary adds an invented figure β€” SQLite lost 14% of writes β€” and the reader repeats it fluently. Scoring the final answer as hallucinated is true and unhelpful. The reverse walk finds source, extraction, and graph stages valid, the summary unsupported by its inputs, and context and reader merely propagating: first likely failure, the summary stage. A second fixture, where a graph-local relation invents a Redis cause for the importer failures, localises to the graph stage while routing and retrieval both pass β€” the Nexus-routing trap, reported as routing pass, retrieval pass, evidence fail, so the router is never blamed for a downstream invention.

Book result. Error-stage localisation matches the injected stage in all three fixture traces, including the fully supported control (E7-G, 3 of 3).

Ground in the original source β€” but the source can be wrong

Chains terminate in raw artifacts because termination buys inspectability: any auditor, human or mechanical, can open the span and read what was actually said. What termination does not buy is truth, and the fixture plants the case that proves it. A session note confidently reports the 14% write-loss figure; the ledger records it as fabricated. The layer reports the claim as traceable to that span and unsupported by anything, which is exactly the honest pair of verdicts:

Raw-source termination guarantees inspectability and historical grounding, not truth.

A raw source may be mistaken, stale, deceptive, incomplete, or itself a report of another source. Source reliability β€” track records per source, maintained over time β€” is designed as an extension point and deliberately not built: the chapter establishes traceability as distinct from truth and records source identity so later reliability work has something to attach to.

Provenance of provenance

Support edges are themselves proposed by fallible machinery, so every edge carries what licensed it: the extractor, its version, the spans behind the proposal, and an extraction confidence. That confidence means confidence the relation was correctly extracted β€” never the probability the claim is true. Claim confidence, source reliability, extraction confidence, and memory utility are kept as four separate quantities that must not be collapsed, because each answers a different consumer: the verification system needs claim-level evidence, the human auditor needs inspectable spans, the reader needs compact context, and the future revision engine needs machine-readable dependencies. Generated prose may render the dependency structure for any of them. It must never invent the structure, which rules out satisfying this chapter by asking a model to explain why it believes something and filing the fluent answer as provenance.

Build it

The implementation lives in solution/evidence_lineage/ beside Chapters 3 to 6 rather than above them, and layers over the existing systems: raw spans feed retrieval, graph, association, and Nexus paths; answer claims feed the evidence layer; the evidence layer resolves support, lineage, and verification back against the original spans. Upstream provenance is preserved where the pipeline records it; where it does not, the layer reconstructs support hypotheses and marks them as reconstructed, never as recorded.

The edge taxonomy is strict and small:

  • SUPPORTED_BY β€” evidential: this evidence contributes to licensing the claim.
  • DERIVED_FROM β€” lineage: this object was generated from the parent, which says nothing about whether the parent proves the child.
  • ECHO_OF β€” restatement: this content propagates earlier information and contributes no independent evidence.
  • REFUTES β€” evidence against a claim, recorded without resolution; conflicts belong to Chapter 8.

DERIVED_FROM is never converted into SUPPORTED_BY, Chapter 5 paths and Chapter 6 routes are stored as trace annotations rather than edges, derivation cycles are rejected, and every echo must resolve to a non-echo source. Using the layer follows the repository’s CLI conventions:

claims = extract_claims_c2(answer)
support = graph.support_for(claim_id)
trail = graph.trace_to_sources(claim_id)
affected = graph.dependents_of("s19-benchmark")
verification = verify_backward(claim_id, stage_support)
cd solution && python -m evidence_lineage.cli explain claim-main
cd solution && python -m evidence_lineage.cli trace claim-14pct
cd solution && python -m evidence_lineage.cli verify claim-14pct
cd solution && python -m evidence_lineage.cli impact a07-rationale
cd solution && python -m evidence_lineage.cli evaluate --run-id ch7-<date>
    flowchart LR
    B[s19-benchmark] --> G1{g1: AND}
    I[i21-incident] --> G1
    A[a07-rationale] --> G1
    R[s44-replicate] --> G2{g2: AND}
    I --> G2
    A --> G2
    G1 -->|OR| C[claim-main]
    G2 -->|OR| C
    style C fill:#3978c5,color:#fff
  

Measure it

The suite extends the Chapter 2 instrument only where the chapter earns the measurement: claim extraction coverage with qualifier tracking, support precision and coverage, provenance precision against borrowed authority, group exact and soft match, lineage completeness, raw-grounding rate, echo precision and recall with echo inflation rate, error-localisation accuracy, and dependency impact precision and recall. No aggregate provenance score is produced; the dimensions stay separate because they fail separately.

The evaluation order is deliberate. Controlled fixtures with ground-truth groups come first, mechanical checks second (valid source identifiers, existing raw spans, terminated chains, rejected cycles, complete groups), and model judges last or never. The literature insists on this ordering: AttributionBench finds even fine-tuned judges reaching only around 80% macro-F1 on attribution decisions, and CiteEval shows binary support judgements missing much of what makes a citation good or bad. A support layer whose own evaluator cannot be trusted further than its fixtures is a layer that manufactures justification, which the concepts file correctly names as the most dangerous error in the book β€” worse than missing support, because it reads as confidence.

Pull one support leg out

The chapter’s strongest demonstration is mechanical. With the support graph built and the main claim verified, withdraw one evidence leg and recompute. Withdrawing the 19 June benchmark breaks the narrow throughput claim, which depended on it alone β€” and leaves the migration claim standing, because the independent rerun group still holds. That pair is the keystone-versus-redundancy distinction made operational: the same withdrawal is fatal to one belief and harmless to another, and the graph says which before any re-reasoning happens. Withdrawing the decision rationale instead affects both the migration claim and the atomic selection claim, while withdrawing the rerun alone changes nothing at all.

Book result. Dependency impact matches fixture truth exactly on both retractions (E7-H, precision and recall 1.0), and redundant-group removal preserves support (E7-I).

The response to withdrawal is flagging, not rewriting. Affected claims are marked as requiring reevaluation, with the historical evidence preserved rather than deleted. Deciding what is now true given the remaining evidence is Chapter 8’s resolver; Chapter 7 hands it the dependency structure it needs through support_for, sources_for, dependents_of, lineage_of, evidence_groups, and requires_reevaluation queries.

What it cost, and whether the layer earns its place

Provenance is not free. The fixture graph holds 26 nodes and 20 edges for nine claims; the full suite runs in about a millisecond with zero model calls because every judgement is ledger-driven. Those numbers describe the fixture, not production: real extraction and verification cost model calls, storage grows with every derived object that must keep its path home, stale lineage needs maintenance, and false support edges manufacture the most dangerous kind of error. The invariant therefore scopes itself β€” any derived memory that may influence future behaviour should retain a path back to the evidence it came from β€” while transient computation owes the layer nothing.

Against the pre-registered outcome types, the fixture evidence maps to Type A: pointer and direct-citation systems produce correct-looking answers with broken support, while explicit groups and lineage repair evidence correctness, localisation, and impact analysis. The scope limits are stated plainly. Extraction and verification are deterministic over fixtures; LLM-backed variants are unmeasured, real-corpus validation is pending, and the echo results already show one place where the machinery degrades honestly. If real-corpus measurement shows direct raw-source grounding sufficing wherever decisions are right, the persistent layer shrinks to a query-time justification (Type B). If lineage helps debugging and revision without moving answer quality, it earns itself as an audit layer (Type C). If AI-generated support edges manufacture justification faster than verification catches it, the layer stays experimental and raw grounding stands alone (Type D). The experiment decides; the chapter records the current score.

What remains unsolved

Chapter 7 answers why a claim was supported. It does not answer whether the claim still holds β€” whether sources are trustworthy, whether intervals expired, whether a successor superseded the belief, how conflicts resolve, or what the authoritative current state is. That is Chapter 8’s machinery, and the boundary is load-bearing: this layer marks what must be reconsidered, never what should now be believed. Beyond that handoff sit the harder problems this chapter exposes without solving: source reliability as maintained state, support strength and confidence aggregation, how much provenance to retain forever, and whether five years of accumulated chains stay traversable or need their own forgetting. The layer’s answer to all of them is the same dependency structure, offered upward.

Research foundations

Citation and revision research supplies the scoring discipline: RARR retrofits attribution and revises output against evidence, keeping answer and support correctness apart; ALCE benchmarks citation recall and precision over multi-passage answers and finds completeness wanting even in strong systems; Self-RAG gates retrieval and critique on learned support signals; the original RAG formulation grounds generation in retrieved documents. GopherCite contributes verbatim-quote grounding with abstention, and the finding that supported claims can still be untrue. Evaluator caution comes from AttributionBench, which shows automatic attribution judgement stalling near 80% macro-F1, and CiteEval, which replaces bare support labels with principle-driven assessment in full retrieval context. Claimify provides the extraction shape and its evaluation metrics; VeriTrail provides reverse verification with error-stage localisation through multi-step workflows including GraphRAG. Minimal evidence groups give the AND/OR group semantics; PAGE-RAG names the connectivity-support gap and pairs it with minimal sufficient selection; LineageRAG carries per-demand lineages through to verbatim spans with open lineages as honest incompleteness; HARIS represents the search half of multi-hop verification, finding evidence the persistent layer must then represent. The chapter adopts the mechanisms and reserves the model training behind every one of them.

References