|Did you know ...||Search Documentation:|
|Pack ape -- tests/README.md|
Author: Kaarel Kaljurand
This document explains how to test APE including the various DRS translators that APE contains.
To regression test APE, just run:
or if you want to download the latest regression testset first then run:
bash rtest.bash d
Note that for the above command to work you need an internet connection,
curl installed. (If you edit the script
rtest.bash, then you can
replace the need for
curl with the need for
A file with a timestamp containing the regression test results
along with APE's output is stored into the
In order to get a digest of the testrun, grep the file for regression tester messages, e.g.:
cat testruns/rtest_050601-1310.txt | grep "^0"
or cat an already filtered file:
In order to explore the erronous DRSes, open the file and search for the strings
0000(Correctly generated an empty DRS)
----(Correctly generated a DRS which is not empty)
####(DRSs which are not empty do not match.)
To get a listing of all the regressions:
cat tmp/now.txt | grep "\[.*#.*\]"
Note: the regression testing is only tested with SWI-Prolog.
It is assumed that SWI-Prolog is called
if it is not the case then modify
or set a symbolic link, e.g.:
ln -s `which pl` swipl
Runtime of the complete test run on different machines:
Running the test:
test_drace(core)." | swipl > drace_test_results
test_drace(np)." | swipl > dracenp_test_results
Getting an overview of the problems by filtering out certain testcases that point to pseudo-problems.
cat drace_test_results | grep "FAIL" | grep -v ":" | grep -v "ach of" | wc
This takes about