Skip to content

Commit a9b7d6c

Browse files
committed
Clarify guide score messaging
1 parent d62de08 commit a9b7d6c

7 files changed

Lines changed: 27 additions & 7 deletions

File tree

ADOPTION.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -62,6 +62,11 @@ safety claim.
6262
A guide is not obliged to reach Level 3 in one step. Publishing at Level 1 or
6363
2 first is a valid and useful state.
6464

65+
For teams seeking the highest guide-file score, the target is Level 4 of 4.
66+
If verifier output also says `level5_ready: true`, the guide is prepared for a
67+
Level 5 runtime check. The checker should not present this as `Level 4 of 5`
68+
or as a missing point.
69+
6570
## How to reach each level
6671

6772
### Level 1: plain text available

CHANGELOG.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -22,6 +22,8 @@ All notable changes to GuideCheck's Human-Verifiable Assistant Guide profile and
2222
content evaluation
2323
- hosted verifier result copy now surfaces Level 5 readiness without presenting
2424
it as achieved Level 5
25+
- public score language now frames Level 4 as the highest guide-file score and
26+
Level 5 as separate runtime enforcement
2527

2628
## [0.2.1] - 2026-05-22
2729

README.md

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -104,6 +104,10 @@ that a human can review in full before authorizing an assistant to follow it.
104104
- Level 5: a guide plus a conformant assistant runtime that mechanically
105105
enforces the execution contract
106106

107+
Level 4 is the highest score for the guide file itself. Level 5 is not a
108+
higher guide-file score; it is a separate runtime enforcement claim for a
109+
deployment that executes a Level 4 guide.
110+
107111
## Local Evals
108112

109113
Run the local regression suite with:
@@ -157,6 +161,10 @@ passes the guide-side preparation checks for runtime enforcement. This is not
157161
an achieved Level 5 claim; Level 5 still requires a conformant assistant
158162
runtime.
159163

164+
User-facing score language should treat this as `Guide score: Level 4 of 4`
165+
plus `Runtime readiness: Level 5-ready`. Avoid `Level 4 of 5`, `almost Level
166+
5`, or similar phrasing that implies the guide file is missing a final point.
167+
160168
Run the local reference verifier with:
161169
```text
162170
python3 scripts/guidecheck_verify.py assistant-guide.txt --pretty

docs/index.html

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -619,10 +619,11 @@ <h3>Serve and verify</h3>
619619
<div class="container">
620620
<div class="demo-block">
621621
<h2>Verify a guide</h2>
622-
<p>GuideCheck publishes a primary verifier for usability &mdash; never as the only authoritative verifier and never as a root of trust. It reports what it checked and what it did not. Optional agent and expected-level fields help identify compatibility gaps without storing full submitted URLs, prompts, model responses, IP addresses, or stable visitor identifiers as product telemetry.</p>
622+
<p>GuideCheck publishes a primary verifier for usability &mdash; never as the only authoritative verifier and never as a root of trust. It reports what it checked and what it did not. Guide files score up to Level 4 of 4; Level 5 is a separate runtime enforcement claim. Optional agent and expected-level fields help identify compatibility gaps without storing full submitted URLs, prompts, model responses, IP addresses, or stable visitor identifiers as product telemetry.</p>
623623
<div class="demo-preview">verifier: human-verifiable-assistant-guide-verifier 0.2.1
624624
guide-sha256: a1b2c3 ... reviewed before use
625-
achieved-level: 3
625+
achieved-level: 4
626+
level5-ready: true
626627
findings: 0 blocking, 1 advisory
627628
note: conformance is not safety &mdash; read the guide</div>
628629
<div class="cta-row">

docs/verifier-examples.html

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -62,6 +62,7 @@
6262
<div class="container">
6363
<h1>Verifier Output Examples</h1>
6464
<p>These examples show the shape verifier authors and assistant runtimes should expect. The exact wording may differ, but the compact report and JSON output must come from the same evidence.</p>
65+
<p>For a guide file, Level 4 is the highest score. A <code>level5_ready</code> value means the Level 4 guide is prepared for a separate runtime enforcement check; it is not an achieved Level 5 claim.</p>
6566
<p>Hosted-verifier product telemetry is separate from verifier output. It may record sanitized operational fields such as target host, path category, selected agent category, expected level, achieved level, outcome, failure category, and coarse duration, but those fields are not part of the normative verifier report consumed by an assistant runtime.</p>
6667

6768
<h2>Passing Level 3 Compact Report</h2>

docs/verify/index.html

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -194,7 +194,7 @@ <h1>Verify an assistant-guide.txt file</h1>
194194
<div class="container">
195195
<div class="panel" id="verifier">
196196
<h2>Check a guide</h2>
197-
<p>Enter the public https URL of an <code>assistant-guide.txt</code> file, or just a site URL. The hosted verifier fetches it, runs the GuideCheck checks, and reports what it found. Given a site root, it checks the standard <code>/.well-known/assistant-guide.txt</code> path. This hosted verifier evaluates Levels 1 through 4 when a guide publishes a fetchable manifest and a supported independent anchor. The optional agent and expected-level fields help identify compatibility gaps across agent families.</p>
197+
<p>Enter the public https URL of an <code>assistant-guide.txt</code> file, or just a site URL. The hosted verifier fetches it, runs the GuideCheck checks, and reports what it found. Given a site root, it checks the standard <code>/.well-known/assistant-guide.txt</code> path. This hosted verifier scores guide files up to Level 4 of 4 when a guide publishes a fetchable manifest and a supported independent anchor. Level 5 is a separate runtime enforcement claim. The optional agent and expected-level fields help identify compatibility gaps across agent families.</p>
198198
<form id="verify-form" class="verify-form" novalidate>
199199
<label for="guide-url">Guide URL</label>
200200
<div class="verify-input-row">
@@ -272,6 +272,7 @@ <h3>Raw verifier output</h3>
272272
Verifier authors can also review <a href="/verifier-examples">example outputs</a>.</p>
273273

274274
<h2>What a verifier checks</h2>
275+
<p>For a guide file, Level 4 is the highest score. Level 5 is not a higher guide-file score; it is a separate claim that a conformant assistant runtime mechanically enforced a Level 4 guide during execution.</p>
275276
<ul>
276277
<li>Reachability of the guide at <code>/.well-known/assistant-guide.txt</code> and the compact verification instruction.</li>
277278
<li>The strict ASCII byte profile, the 8 KiB size cap, and absence of disallowed constructs.</li>
@@ -280,7 +281,7 @@ <h2>What a verifier checks</h2>
280281
</ul>
281282

282283
<h2>What a verifier reports</h2>
283-
<p>A GuideCheck conformance claim is valid only when backed by verifier output, the guide SHA-256, the achieved level, and the findings. For Level 4 guides, verifier output may also report <code>level5_ready</code>. That is a guide-side readiness signal, not a Level 5 runtime conformance claim.</p>
284+
<p>A GuideCheck conformance claim is valid only when backed by verifier output, the guide SHA-256, the achieved level, and the findings. For Level 4 guides, verifier output may also report <code>level5_ready</code>. That means the guide has reached the highest guide-file score and is prepared for a Level 5 runtime check. It is not an achieved Level 5 claim.</p>
284285
<pre>verifier: human-verifiable-assistant-guide-verifier 0.2.1
285286
guide-url: https://example.com/.well-known/assistant-guide.txt
286287
guide-sha256: a1b2c3d4 ... (review the guide before use)
@@ -295,7 +296,7 @@ <h2>Conformance is not safety</h2>
295296
<p>A passing result, at any level, does not mean a guide is safe to follow or that its publisher is trustworthy. It means the file has the form the profile requires. Read the guide in full, apply the security practices a competent operator would already apply, and keep the human in the approval loop.</p>
296297

297298
<h2>What this hosted verifier covers</h2>
298-
<p>This hosted verifier evaluates GuideCheck Levels 1 through 4. For Level 4, it fetches the declared sidecar manifest and currently supports package-registry metadata and transparency-log anchors. It may report <code>level5_ready</code> when a Level 4 guide satisfies the guide-side runtime preparation checks. It does not yet fetch DNS TXT, repository-file, or signed <code>security.txt</code> anchors, and it does not evaluate runtime conformance (Level 5). Every hosted response carries a <code>hosted_limitations</code> field that states its scope.</p>
299+
<p>This hosted verifier evaluates guide-file conformance from Level 1 through Level 4. For Level 4, it fetches the declared sidecar manifest and currently supports package-registry metadata and transparency-log anchors. It may report <code>level5_ready</code> when a Level 4 guide satisfies the guide-side runtime preparation checks. It does not yet fetch DNS TXT, repository-file, or signed <code>security.txt</code> anchors, and it does not evaluate runtime conformance (Level 5). Every hosted response carries a <code>hosted_limitations</code> field that states its scope.</p>
299300

300301
<h2>Privacy</h2>
301302
<p>The guide URL you submit is sent to this site's server so it can fetch the file you named. The verifier keeps product telemetry limited to the target host, whether the path was the standard well-known path or a custom path, the selected agent category, expected level, achieved level, outcome, failure category, and coarse duration. It does not store full submitted URLs, query strings, prompts, model responses, IP addresses, or stable visitor identifiers in product telemetry. The optional agent and expected-level fields are used to find compatibility gaps, such as an agent family often expecting Level 3 but receiving Level 1. The hosting platform keeps standard short-lived request logs &mdash; timestamp, client IP, and the <code>/api/verify</code> path &mdash; for abuse prevention; those logs do not contain the guide URL.</p>

docs/verify/verify.js

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -137,12 +137,14 @@
137137
var pass = blocking === 0;
138138
var readiness = "";
139139
if (achievedLevel >= 4) {
140-
readiness = guide.level5_ready ? " - Level 5-ready" : " - not Level 5-ready";
140+
readiness = guide.level5_ready
141+
? " - Runtime readiness: Level 5-ready"
142+
: " - Runtime readiness: not Level 5-ready";
141143
}
142144

143145
headline.className = "verify-headline " + (pass ? "is-pass" : "is-fail");
144146
headline.textContent = pass
145-
? "Achieved Level " + achievedLevel + " · 0 blocking · " + plural(summary.warnings || 0, "warning") + readiness
147+
? "Guide score: Level " + achievedLevel + " of 4 · 0 blocking · " + plural(summary.warnings || 0, "warning") + readiness
146148
: "Not conformant · " + plural(blocking, "blocking finding") + " · " + plural(summary.warnings || 0, "warning") + readiness;
147149

148150
if (data.location_note) {

0 commit comments

Comments
 (0)