Refactor tests
authorJannis Harder <me@jix.one>
Mon, 11 Apr 2022 15:39:05 +0000 (17:39 +0200)
committerJannis Harder <me@jix.one>
Mon, 11 Apr 2022 15:50:38 +0000 (17:50 +0200)
commit8da6f07cb3c11375ac59b625aee4f75b40ca8464
treef10e49312db426895c316d1f41b1e3b0b3996cf9
parent6daa434d85cd07d5feea5511143c9af793ac1658
Refactor tests

Organize tests into subdirectories and use a new makefile that scans
.sby files and allows selecting tests by mode, engine, solver and/or
subdirectory. Automatically skips tests that use engines/solvers that
are not found in the PATH.

See `cd tests; make help` for a description of supported make targets.
97 files changed:
tests/.gitignore
tests/2props1trace.sby [deleted file]
tests/JUnit.xsd [deleted file]
tests/Makefile
tests/aim_vs_smt2_nonzero_start_offset.sby [deleted file]
tests/both_ex.sby [deleted file]
tests/both_ex.v [deleted file]
tests/check_output.py [deleted file]
tests/cover.sby [deleted file]
tests/cover.sv [deleted file]
tests/cover_fail.sby [deleted file]
tests/demo.sby [deleted file]
tests/demo.sv [deleted file]
tests/invalid_ff_dcinit_merge.sby [deleted file]
tests/junit/JUnit.xsd [new file with mode: 0644]
tests/junit/Makefile [new file with mode: 0644]
tests/junit/junit_assert.sby [new file with mode: 0644]
tests/junit/junit_assert.sh [new file with mode: 0644]
tests/junit/junit_cover.sby [new file with mode: 0644]
tests/junit/junit_cover.sh [new file with mode: 0644]
tests/junit/junit_expect.sby [new file with mode: 0644]
tests/junit/junit_expect.sh [new file with mode: 0644]
tests/junit/junit_nocodeloc.sby [new file with mode: 0644]
tests/junit/junit_nocodeloc.sh [new file with mode: 0644]
tests/junit/junit_timeout_error.sby [new file with mode: 0644]
tests/junit/junit_timeout_error.sh [new file with mode: 0644]
tests/junit/validate_junit.py [new file with mode: 0644]
tests/junit_assert.sby [deleted file]
tests/junit_cover.sby [deleted file]
tests/junit_nocodeloc.sby [deleted file]
tests/junit_timeout_error.sby [deleted file]
tests/keepgoing/Makefile [new file with mode: 0644]
tests/keepgoing/check_output.py [new file with mode: 0644]
tests/keepgoing/keepgoing_multi_step.py [new file with mode: 0644]
tests/keepgoing/keepgoing_multi_step.sby [new file with mode: 0644]
tests/keepgoing/keepgoing_multi_step.sh [new file with mode: 0644]
tests/keepgoing/keepgoing_multi_step.sv [new file with mode: 0644]
tests/keepgoing/keepgoing_same_step.py [new file with mode: 0644]
tests/keepgoing/keepgoing_same_step.sby [new file with mode: 0644]
tests/keepgoing/keepgoing_same_step.sh [new file with mode: 0644]
tests/keepgoing/keepgoing_same_step.sv [new file with mode: 0644]
tests/keepgoing/keepgoing_smtc.py [new file with mode: 0644]
tests/keepgoing/keepgoing_smtc.sby [new file with mode: 0644]
tests/keepgoing/keepgoing_smtc.sh [new file with mode: 0644]
tests/keepgoing_multi_step.check.py [deleted file]
tests/keepgoing_multi_step.sby [deleted file]
tests/keepgoing_multi_step.sv [deleted file]
tests/keepgoing_same_step.check.py [deleted file]
tests/keepgoing_same_step.sby [deleted file]
tests/keepgoing_same_step.sv [deleted file]
tests/keepgoing_smtc.check.py [deleted file]
tests/keepgoing_smtc.sby [deleted file]
tests/make/collect_tests.py [new file with mode: 0644]
tests/make/help.txt [new file with mode: 0644]
tests/make/subdir.mk [new file with mode: 0644]
tests/make/test_rules.py [new file with mode: 0644]
tests/memory.sby [deleted file]
tests/memory.sv [deleted file]
tests/mixed.sby [deleted file]
tests/mixed.v [deleted file]
tests/multi_assert.sby [deleted file]
tests/preunsat.sby [deleted file]
tests/prv32fmcmp.sby [deleted file]
tests/prv32fmcmp.v [deleted file]
tests/redxor.sby [deleted file]
tests/redxor.v [deleted file]
tests/regression/Makefile [new file with mode: 0644]
tests/regression/aim_vs_smt2_nonzero_start_offset.sby [new file with mode: 0644]
tests/regression/invalid_ff_dcinit_merge.sby [new file with mode: 0644]
tests/scripted/.gitignore [deleted file]
tests/scripted/Makefile [deleted file]
tests/scripted/junit_expect.sby [deleted file]
tests/scripted/junit_expect.sh [deleted file]
tests/stopfirst.sby [deleted file]
tests/submod_props.sby [deleted file]
tests/unsorted/2props1trace.sby [new file with mode: 0644]
tests/unsorted/Makefile [new file with mode: 0644]
tests/unsorted/both_ex.sby [new file with mode: 0644]
tests/unsorted/both_ex.v [new file with mode: 0644]
tests/unsorted/cover.sby [new file with mode: 0644]
tests/unsorted/cover.sv [new file with mode: 0644]
tests/unsorted/cover_fail.sby [new file with mode: 0644]
tests/unsorted/demo.sby [new file with mode: 0644]
tests/unsorted/demo.sv [new file with mode: 0644]
tests/unsorted/memory.sby [new file with mode: 0644]
tests/unsorted/memory.sv [new file with mode: 0644]
tests/unsorted/mixed.sby [new file with mode: 0644]
tests/unsorted/mixed.v [new file with mode: 0644]
tests/unsorted/multi_assert.sby [new file with mode: 0644]
tests/unsorted/preunsat.sby [new file with mode: 0644]
tests/unsorted/prv32fmcmp.sby [new file with mode: 0644]
tests/unsorted/prv32fmcmp.v [new file with mode: 0644]
tests/unsorted/redxor.sby [new file with mode: 0644]
tests/unsorted/redxor.v [new file with mode: 0644]
tests/unsorted/stopfirst.sby [new file with mode: 0644]
tests/unsorted/submod_props.sby [new file with mode: 0644]
tests/validate_junit.py [deleted file]