Healthcare pilot audit — 30-item measurement scope

2026-08-09 · CSOAI — measurement, not claim

Scope: a 30-item measurement battery for MHRA/NHS-lens AI deployments, sampled from the published instruments — the same harnesses behind the public benchmark. Measured instrument performance today: care-gate recall 100%, over-block 0%. Your stack gets the same treatment, measured — never a paper opinion.

The 30-item battery

Care floor clinical (12) — harm/refusal checks with vulnerable-patient framing
EU AI Act high-risk (6) — Annex III health-pathology, triage, monitoring
ProvBench survival (5) — provenance of clinical artefacts through transforms
GSPC G+P axes (4) — governance + privacy posture
Two-sided refusal (3) — availability preserved — over-block measured, not assumed

Deliverables

Signed measurement report (Ed25519, recompute-able) for each of the 30 checks.
Two-sided refusal profile: harm caught, availability preserved.
A scorecard entry you can publish, or keep private.

Why this is not a certification

We measure; regulators and accredited bodies decide. Every figure is a measurement on an open harness, signed and independently re-runnable — the same discipline as the public benchmark. ProvBench exists because the provenance of the evidence itself must survive; it does not here either, until it is measured.