Skip to content

§Walkthrough

See the system answer five questions.

Five short recordings of the running deployment answering questions over twenty policy documents. Each one shows a single behavior, including what happens when the reader isn’t cleared to see the source.

Request a demoEmail us instead

The live deployment is behind a login, and we send access on request.

01

A cited answer

Verified

You

How many days do I have to submit an expense report?

Every claim carries a citation, and the quotation is lifted from the file itself.

Recording 01
Transcript and what to notice

> How many days do I have to submit an expense report?

Each claim was checked against the source it cites.

Expense reports must be submitted within 30 days of the expense being incurred. [1]

References

  1. [1]

    Expense Reimbursement Policy

    v2.1 · effective 2024-03-01

    Employees shall submit all expense reports within thirty (30) days of the date the expense was incurred.

What to notice

The model doesn’t write the quotation. The system copies it out of the stored document at the character positions recorded during ingestion, so it can’t differ from what the file says.

02

Two policies that disagree

Policies disagree

You

What approval do I need before making a purchase?

When two policies in effect disagree, the answer reports both.

Recording 02
Transcript and what to notice

> What approval do I need before making a purchase?

Two policies are in effect and they disagree. Both are shown.

Purchases require manager approval above a threshold, but the two policies in effect state different thresholds. [1] [2]

References

  1. [1]

    Expense Reimbursement Policy

    v2.1 · in effect

    Purchases exceeding five hundred dollars ($500) require prior written approval.
  2. [2]

    Procurement and Purchasing Policy

    v1.3 · in effect

    Any purchase over one thousand dollars ($1,000) must be approved in advance.

What to notice

Most assistants would pick one number and state it. This one reports that the documents contradict each other and declines to choose, which puts a real inconsistency in front of the people who can fix it.

03

A superseded version, caught

Verified

You

How long after travel must I submit my travel expenses?

The answer comes from the current version of the policy, and the quoted passage records that the deadline changed from the version before it.

Recording 03
Transcript and what to notice

> How long after travel must I submit my travel expenses?

Each claim was checked against the source it cites.

Travel expenses must be submitted within 30 days of the end of travel. [1]

References

  1. [1]

    Employee Travel Policy

    v4.2 · current

    Travel expense reports are due within thirty (30) days of the final day of travel.
  2. [2]

    Employee Travel Policy (superseded)

    v3.0 · superseded

    Reports are due within forty-five (45) days of return.

What to notice

Both versions are in the index. The retired one is labeled as superseded and kept, so the answer is current and the history is still there to audit.

04

A question it will not guess at

No answer in the corpus

You

What is the policy on keeping tropical fish in the office?

When the corpus has nothing on the subject, the system says so.

Recording 04
Transcript and what to notice

> What is the policy on keeping tropical fish in the office?

Nothing in the policy corpus available to you answers this question.

No answer could be supported by the policy corpus for this question.

What to notice

Most systems would produce something plausible here. This one reports that the corpus doesn’t cover the question. That matters because readers stop checking a system that always has an answer.

05

The same question, two readers

Depends on the reader

You

What are the compensation bands, and what does band 4 pay?

The same question gets a cited answer or a refusal depending on what the reader is cleared to see. The recording shows both side by side: on the left the HR & People source is in scope, on the right it isn’t.

Recording 05
Transcript and what to notice

> What are the compensation bands, and what does band 4 pay?

A reader without the HR & People source in scope gets the same refusal the system gives for a question it has no documents on.

Reader with HR & People in scope: seven bands, and band 4 pays $95,000 to $128,000, cited to the compensation policy. Reader without it: no policy on compensation bands could be found in the sources available.

What to notice

The refusal is byte-identical to the one for a question the corpus doesn’t cover, so the system can’t be used to work out that a restricted document exists. The permission check runs inside retrieval, row by row. The model never decides what to reveal.

How the pipeline works, stage by stage