F711-N3 — Natural Lexicalization Blind
F711-N3 covers “Natural Lexicalization Blind”. The canonical record classifies it as failed/revert, based on 7 source artifacts and 0 original source figures. The highlighted measurements are Decision = BENCHMARK_INVALID_BEFORE_MODEL_RUN, Decision Basis = The frozen gold is structurally malformed, so model metrics are inadmissible., and Procedural Status Initial Preflight Result = PASS_INCORRECTLY.
Purpose and research question
The objective is to document the recorded outcome for “Natural Lexicalization Blind”. The research question is whether the phase-specific checks support the canonical failed/revert classification. The recorded measurements include Decision = BENCHMARK_INVALID_BEFORE_MODEL_RUN, Decision Basis = The frozen gold is structurally malformed, so model metrics are inadmissible., and Procedural Status Initial Preflight Result = PASS_INCORRECTLY.
Method
F711-N3 is documented by 5 structured JSON records and 2 Markdown reports and 0 original source figures. The reported table retains safe scalar measurements found in that phase package.
Documentation basis
7 source artifacts and 0 phase-specific figures are recorded for this phase.
Evidence highlights
- Decision: BENCHMARK_INVALID_BEFORE_MODEL_RUN
- Decision Basis: The frozen gold is structurally malformed, so model metrics are inadmissible.
- Procedural Status Initial Preflight Result: PASS_INCORRECTLY
- Procedural Status Smoke Results Quarantined: Yes
- Gold Invalidation Affected Case Rate: 0.8416666666666667
- Gold Invalidation Smoke Affected Case Rate: 0.815
- Raw Metrics Not Valid For Model Decision Semantic Preservation: 0.34
- Raw Metrics Not Valid For Model Decision Finite Verb Accuracy: 0.5475
Recorded evidence
| Decision | BENCHMARK_INVALID_BEFORE_MODEL_RUN |
|---|---|
| Decision Basis | The frozen gold is structurally malformed, so model metrics are inadmissible. |
| Procedural Status Initial Preflight Result | PASS_INCORRECTLY |
| Procedural Status Smoke Results Quarantined | Yes |
| Gold Invalidation Affected Case Rate | 0.8416666666666667 |
| Gold Invalidation Smoke Affected Case Rate | 0.815 |
| Raw Metrics Not Valid For Model Decision Semantic Preservation | 0.34 |
| Raw Metrics Not Valid For Model Decision Finite Verb Accuracy | 0.5475 |
Public evidence and source figures
The current public archive does not attach a benchmark image to this phase. The source artifacts and recorded measurements remain listed below.
Result and interpretation
F711-N3 remains failed under the recorded decision REVERT_NATURAL_LEXICALIZATION. The recorded measurements include Decision = BENCHMARK_INVALID_BEFORE_MODEL_RUN, Decision Basis = The frozen gold is structurally malformed, so model metrics are inadmissible., Procedural Status Initial Preflight Result = PASS_INCORRECTLY, and Procedural Status Smoke Results Quarantined = Yes. These values define the negative phase result.
Key results
- Decision
- BENCHMARK_INVALID_BEFORE_MODEL_RUN
- Decision Basis
- The frozen gold is structurally malformed, so model metrics are inadmissible.
- Procedural Status Initial Preflight Result
- PASS_INCORRECTLY
- Procedural Status Smoke Results Quarantined
- Yes
- Gold Invalidation Affected Case Rate
- 0.8416666666666667
- Gold Invalidation Smoke Affected Case Rate
- 0.815
- Raw Metrics Not Valid For Model Decision Semantic Preservation
- 0.34
- Raw Metrics Not Valid For Model Decision Finite Verb Accuracy
- 0.5475
Evidence sources
Values on this page are reproduced from the archived phase record and the source artifacts below. No new benchmark was run to create this page.
- NATURAL LEXICALIZATION BLIND 711N3 (JSON)
- NATURAL LEXICALIZATION BLIND 711N3 (MD)
- NATURAL LEXICALIZATION FREEZE 711N3 (JSON)
- NATURAL LEXICALIZATION PREFLIGHT 711N3 (JSON)
- NATURAL LEXICALIZATION SMOKE 711N3 Outputs (JSON)
- NATURAL LEXICALIZATION SMOKE 711N3 Outputs (MD)
- NATURAL LEXICALIZATION SMOKE 711N3 (JSON)