AnachronautandClaude Opus 5
8fbbeb6ec9
The Test Manual said an xfail test records the assembler's refusal message and so catches both an error that stops being detected and a message that changes without anybody meaning it to. It did not. run.sh checked only that the assembler exited non zero, printed the first line for a person to read, and compared nothing; --bless recorded nothing for these sixteen tests at all. So an xfail passed four different ways that look identical from outside: the intended error fired, an unrelated error fired, the message changed, or the assembler fell over on its way to the point. That is the documentation describing behaviour the code does not have, which is the exact failure Tests/docs.sh exists to prevent, in the manual that argues for knowing what your evidence is worth. The diagnostic is now stripped of colour, given the same [exit N] line every other recorded result carries, and compared through check() like anything else. Sixteen results recorded; every existing one is byte for byte unchanged. Verified the way the manual asks: one diagnostic was broken on purpose, its test failed with the changed line in the diff, and its neighbour passed. Found by ChatGPT reviewing the manual. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01E2JrLzFvuFX9fgi1LDRjrW
7 lines
284 B
Plaintext
7 lines
284 B
Plaintext
Error: 100 is not a vector number that can be given.
|
|
Numbers below 16 belong to the machine, and 64 and up are
|
|
handed out by the assembler. A vector two programs have to
|
|
agree about takes one from 16 to 63.
|
|
File: testPrograms/diagnostics/pinnedVectorRange.asm at line 19.
|
|
[exit 1]
|