mirror of
https://github.com/Llewellynvdm/exa.git
synced 2024-12-27 18:24:57 +00:00
61c5df7c11
This commit changes the way the extended test suite is run. Previously, there was a folder full of outputs, and a script that ran exa repeatedly to check the outputs match. This script was hacked-together, with many problems: • It stops at the first failure, so if one test fails, you have no idea how many actually failed. • It also didn't actually show you the diff if one was different, it just checked it. • It combined stdout and stderr, and didn't test the exit status of exa. • All the output file names were just whatever I felt like calling the file at the time. • There is no way to only run a few of the tests — you have to run the whole thing each time. • There's no feel-good overall view where you see how many tests are passing. I started writing Specsheet to solve this problem (amongst other problems), and now, three and a half years later, it's finally ready for prime time. The tests are now defined as data rather than as a script. The outputs have a consistent naming convention (directory_flags.ansitxt), and they check stdout, stderr, and exit status separately. Specsheet also lets simple outputs (empty, non-empty, or one-line error messages) can be written inline rather than needing to be in files. So even though this pretty much runs the same tests as the run.sh script did, the tests are now more organised, making it easy to see where tests are missing and functionality is not being tested.
11 lines
350 B
Plaintext
11 lines
350 B
Plaintext
1_bytes 4_KiB 7_MiB 11_bytes
|
|
1_KiB 4_MiB 8_bytes 11_KiB
|
|
1_MiB 5_bytes 8_KiB 11_MiB
|
|
2_bytes 5_KiB 8_MiB 12_bytes
|
|
2_KiB 5_MiB 9_bytes 12_KiB
|
|
2_MiB 6_bytes 9_KiB 12_MiB
|
|
3_bytes 6_KiB 9_MiB 13_bytes
|
|
3_KiB 6_MiB 10_bytes 13_KiB
|
|
3_MiB 7_bytes 10_KiB 13_MiB
|
|
4_bytes 7_KiB 10_MiB
|