expected.tsv 11 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212
  1. # Expected results for tests/fixtures/*.pas - one line per fixture:
  2. #
  3. # <fixture-basename> OK <code> <data>
  4. # <fixture-basename> ERR <tp3-error-no> <relative-pos>
  5. #
  6. # Both the verdict AND the numbers are asserted by run_compile_tests.sh, so a
  7. # regression in the *reported error position* fails the suite just like a
  8. # regression in the generated code. That matters: error positions were once
  9. # silently wrong (a multi-character string literal swallowed the rest of the
  10. # source, so every later error pointed at end-of-file), and nothing caught it
  11. # because the old harness only printed the position for a human to squint at.
  12. #
  13. # Re-baseline deliberately, never to make a red test go green: if a fixture's
  14. # expectation has to change because the compiler legitimately improved, change
  15. # it in the same commit as the fix and say why in the message.
  16. #
  17. # ERR 102 = ENoLib, the original's "not implemented" path. The remaining ERR
  18. # rows are unimplemented features, not parser bugs:
  19. # t14 'array [..] of <type>' at its point of use
  20. # t25 a string literal used where a 16-bit word is wanted
  21. # uierror deliberate syntax error, pinned by the editor UI test
  22. #
  23. # The nine control-flow fixtures (t08 t09 t10 t11 t12 t13 t15 t27 t28) were
  24. # re-baselined upward when they were rewritten to PRINT their result, so each
  25. # has a .out file and is executed under qemu (run_com_exec.py) as well as
  26. # compiled here. Before that they assigned to a variable and fell off the end:
  27. # they asserted that the compiler produced bytes, and nothing about behaviour.
  28. # t13 also gained a second procedure, which is why it is bigger than the sum of
  29. # its parts. t08's data went 6 -> 7 because a CHAR variable joined the INTEGER.
  30. #
  31. # t02 t03 t05 t17 used to be ERR 102 as well: a multi-character literal was
  32. # rejected because writeln had no string support. They compile now, via the
  33. # inline-string path (CALL wrtinl, then <length><chars> in the code stream -
  34. # TPSRC8 pwrinlin / TPSRC4 xwrtinl), so their rows changed from ERR to OK and
  35. # their code sizes went up by the literal's own bytes.
  36. #
  37. # RE-BASELINED for v-TP3-8086-LOWERING, when conditional branches and SETcc
  38. # stopped being 386-only. Nine rows moved, every one of them UPWARD, and every
  39. # one of them by exactly the number of conditional sites in that fixture:
  40. #
  41. # +1 per site. A branch was 4 bytes (0F 8x rel16) and is now 5 (7x 03,
  42. # then the 3-byte EJMP). A comparison VALUE was 5 bytes (0F 9x rel8, then
  43. # MOV AH,0) and is now 6 (B8 01 00, 7x 01, DEC AX). So the deltas are
  44. # t09 +6 = 3 values + 3 branches, t10 +4 = 2+2, t11 +2 = 0+2,
  45. # t12 +4 = 2+2, t15 +2 = 1+1, t22 +2 = 0+2, t30 +1 = 0+1, t32 +3 = 1+2,
  46. # t33 +13 = 13 values.
  47. #
  48. # That arithmetic was CHECKED, not assumed: the site counts were counted out of
  49. # the linked images (the same CMP AX,CX and CMP AX,0000 anchors and the same
  50. # 7x 03 E9 shape that check_8086.py uses) and each row was only written after
  51. # its delta matched its count. Data sizes did not move at all. The bytes
  52. # themselves are pinned by check_8086.py, and the BEHAVIOUR is pinned by
  53. # run_com_exec.py -- this row only says how big the code is.
  54. #
  55. # RE-BASELINED when the runtime was wired into the code buffer. Every OK row
  56. # changed by exactly +3 code and -256 data, and both numbers are correct:
  57. #
  58. # +3 code the prologue now emits MOV AX,<header offset> before
  59. # CALL TU_InitMem, because InitMem takes the header offset in a
  60. # register (B8 lo hi) rather than on the stack. Previously the
  61. # prologue called offset 8, which is the hdrMax word - it only
  62. # "worked" because the runtime was not in the image at all.
  63. #
  64. # -256 data DataBytes() used to return dc, the ABSOLUTE end of the data
  65. # area, not a size. dc started at 100H, so every program reported
  66. # 256 more than it allocated - 260 for a program whose only data is
  67. # the two @@T1/@@T2 scratch words. The field is documented as
  68. # "emitted data size in bytes", so 4 is the true size and 260 was
  69. # the bug. It is a real correction, not a fit-to-the-test change:
  70. # the 6-byte rows are the fixtures that declare one global.
  71. #
  72. # ADDED for the BP displacement fix. These two fixtures are the first with
  73. # any frame access at all -- every earlier fixture put its variables in the
  74. # DATA segment, addressed absolutely, so the whole [BP+off] path had zero
  75. # coverage and a truncation there was invisible.
  76. #
  77. # t27_localvar five LOCAL variables, assigned and read back. Locals are
  78. # allocated downward from 0FFFEh and each access now costs 4
  79. # bytes (mod=10 + disp16) where it cost 3 (disp8), so its code
  80. # size reflects the fix rather than predating it. Both
  81. # encodings address the same place; only the rule for choosing
  82. # between them changed.
  83. # t28_farparam 70 declared parameters; the call passes 16, which is the
  84. # argument cap at the call site. p63 lands at BP+128 and p70
  85. # at BP+142 - the first offsets a disp8 cannot represent,
  86. # since 80h is -128 and not +128. Under the old code these
  87. # two reads came from the wrong side of BP. This fixture
  88. # tests the ENCODING and is never executed; do not read it as
  89. # a claim that a 70-argument call works. Its 123 bytes are
  90. # 1 more than t27's because the body is one ADD and one
  91. # store rather than five of each.
  92. #
  93. # RE-BASELINED for the case-label fix, and this is the one re-baseline in this
  94. # file that is a CORRECTION rather than a new feature. EmMovAxSp used to emit
  95. #
  96. # 8B 44 24 00 MOV AX,[SP] <- 386 encoding, SIB byte
  97. #
  98. # which is 4 bytes. [SP] is not encodable on the 8086 at all: mod=00/rm=100
  99. # is [SI], and the SIB byte that 8B 44 needs did not exist until the 386. The
  100. # bytes were well formed, so every byte-level check passed, and fcml and qemu
  101. # both DECODED it - as MOV AX,[SI+0x24h], because that is what it is. Every
  102. # CASE label test therefore loaded a garbage address, every comparison failed,
  103. # and a case statement fell straight past its body. It now emits
  104. #
  105. # 58 50 POP AX ; PUSH AX <- 2 bytes
  106. #
  107. # which is observationally a peek. t22 has two labels, so its code is exactly
  108. # 4 bytes smaller: 96 -> 92. The number moving is the point - the old size was
  109. # the size of a wrong encoding, and a case fixture that is not executed cannot
  110. # tell you that from its size alone. t22 is executed (tests/run_com_exec.py).
  111. #
  112. # ADDED t29_readln: the first fixture that reads. It needs the CHAR class to
  113. # exist at all - see the note on TChar in Compiler.mod - so 7 data bytes where
  114. # t19 has 4 (n is 2, c is 1, and the two are 2-byte aligned, so 4 + 2 + 1
  115. # rounds up to 7) and 82 code bytes for the four runtime calls plus a literal
  116. # char argument. Its .out is compared byte for byte against qemu.
  117. #
  118. # RE-BASELINED for the procedure-skip jump. t13, t27 and t28 gained exactly
  119. # +3 code bytes: `E9 rel16`. These are the only three fixtures that declare a
  120. # PROCEDURE, and they are the only three rows that moved.
  121. #
  122. # The reason is a bug that only execution could find. The declaration part is
  123. # compiled BEFORE the main statement part, so a procedure's code lands between
  124. # the program prologue and the main body - and nothing jumped over it. A
  125. # program with a procedure ran off the end of the prologue straight into the
  126. # first procedure, which read its argument out of an uninitialised frame and
  127. # returned to address 0000h. t13_proc compiled, produced a plausible 53 bytes,
  128. # and was never run, so the suite was green over a program that could not
  129. # execute at all.
  130. #
  131. # The jump is emitted ONLY when a procedure or function is declared, which is
  132. # why the other 27 OK rows did not move. That condition is a lookahead over
  133. # the source buffer, because the jump must be emitted before the declaration
  134. # part but whether one is needed is only known after - see DeclaresProc in
  135. # Compiler.mod for why the alternative (always emit it) was rejected.
  136. #
  137. # t13_proc 53 -> 56
  138. # t27_localvar 122 -> 125
  139. # t28_farparam 123 -> 126
  140. # t31_procparam 66 -> 69
  141. #
  142. # t31_procparam is the fixture that proves the fix by running: it declares a
  143. # procedure, calls it, and prints what the procedure wrote. Before the fix it
  144. # never halted at all.
  145. #
  146. # ADDED t30/t31/t32, all three now EXECUTED (not just compiled):
  147. #
  148. # t30_forloop `for i := 1 to 5 do s := s + i` printed 21, not 15. The loop
  149. # test was emitted AFTER the body, making it a post-test loop:
  150. # the body ran a sixth time with i = 6. The code size and the
  151. # instruction bytes were both already correct - only the ORDER
  152. # was wrong, and no byte-level check can observe an order. The
  153. # test now precedes the body, so 96 bytes both before and after
  154. # this fix, which is the whole point: the number never moved and
  155. # the behaviour did.
  156. # t31_procparam procedure + one parameter. The non-termination above.
  157. # t32_forexit `for` with `exit` in the body. Two faults, both invisible to
  158. # a size check: the loop's exits were patched to the position
  159. # just past the body, which in a FOR is the STEP, so `exit`
  160. # incremented the control variable and jumped back into the test
  161. # - it did not exit; and the EXIT handler also emitted ADD SP,2
  162. # while the loop's `done` label emitted it again, dropping four
  163. # bytes off a stack that had two to give. Exits are now patched
  164. # at `done`, and the handler no longer touches the stack.
  165. # t33_cmpops all six relational operators as VALUES, each with a true case,
  166. # a false case and the equality boundary, plus one signed pair.
  167. # Added while making the 8086 branch/compare lowering checkable:
  168. # measuring which conditions the suite actually emitted showed
  169. # that `=', `<>' and `<=' were never used in a comparison at all,
  170. # because `writeln (a = b)` had no fixture. Only `<', `>' and
  171. # `>=' had coverage - and `>' vs `>=' had ALREADY been swapped
  172. # once (bug 29), so a hole either side of the operators that
  173. # were covered is the last place to leave one. m := -1, n := -2
  174. # makes the last line signed: unsigned, -1 > -2 is FALSE, so that
  175. # one line is what tells SETG from a byte compare.
  176. t01_minimal OK 29 4
  177. t02_writeln OK 38 4
  178. t03_inline_comment OK 38 4
  179. t04_var OK 48 6
  180. t05_own_line_comment OK 38 4
  181. t06_two_args OK 52 4
  182. t07_big OK 102 6
  183. t08_const OK 76 7
  184. t09_if OK 195 6
  185. t10_while OK 151 6
  186. t11_for OK 144 6
  187. t12_repeat OK 137 6
  188. t13_proc OK 126 6
  189. t14_types ERR 102 83
  190. t15_label OK 90 6
  191. t16_str1 OK 42 4
  192. t17_two_str OK 45 4
  193. t18_writeln_bare OK 32 4
  194. t19_int1 OK 42 4
  195. t20_str3 OK 62 4
  196. t21_mixed OK 62 4
  197. t22_case OK 94 6
  198. t23_str_empty OK 36 4
  199. t24_str_quote OK 41 4
  200. t25_str_as_value ERR 102 48
  201. t26_str_mixed_args OK 58 4
  202. t27_localvar OK 256 6
  203. t28_farparam OK 153 8
  204. t29_readln OK 82 7
  205. t30_forloop OK 97 8
  206. t31_procparam OK 69 6
  207. t32_forexit OK 138 8
  208. t33_cmpops OK 404 12
  209. t34_arith OK 448 8
  210. t35_not OK 224 7
  211. uierror ERR 41 331