E47–E62 · DESIGN FILE, AS WRITTEN
Gate and Verify
16 experiments, 3,873 records and 2,440,607 input tokens.
C
Confirmed
7
F
Falsified
5
M
Mixed
4
This set of tests checks whether Jev can be trusted to gate risky actions before they happen and verify claims and work after the fact.
Reading the record…
Experiments in this group
Exp
Verdict
Question
E47
C
Confirmed
Does a plain-English permission policy correctly gate real actions?
E48
F
Falsified
Do disguised commands fool the gate into allowing bad and blocking good?
E49
M
Mixed
Does the injection filter block real attacks without blocking safe text?
E50
F
Falsified
Does the irreversibility gate track consequences or just scary verbs?
E51
M
Mixed
Can wording changes or a self-written excuse move a gate's verdict?
E52
C
Confirmed
When the input is broken or missing, does the gate fail safe?
E53
C
Confirmed
Can a cheap first check filter most rows before the full check?
E54
M
Mixed
Does a five-level quality score have a working middle grade?
E55
C
Confirmed
Can the model tell a supported claim from an unsupported one?
E56
F
Falsified
Does the format check catch real violations without flagging normal data?
E57
C
Confirmed
Can the reviewer spot planted bugs, including ones needing context?
E58
F
Falsified
Does verifying a claim without its real source produce false confidence?
E59
C
Confirmed
Which number should a safety gate actually threshold on?
E60
F
Falsified
Does the gate tell a quoted mention apart from a real command?
E61
M
Mixed
Can the gate tell when it's missing the information it needs?
E62
C
Confirmed
Can a gate recognize a denied goal being retried in disguise?
108 experiments, 38,194 API responses logged, 45,861,280 input tokens, $1.9262 at $0.042 per million.
Compiled from dependency-docs-reference/jev/notes/12-experiments on 2026-09-19.