summary refs log tree commit diff stats
path: root/tests/testament
Commit message (Collapse)AuthorAgeFilesLines
* [Testament] Extend and document message testing aids (#19996)quantimnot2022-09-012-2/+9
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * [Testament] Extend and document message testing aids * Enable inline msgs when not reject action. Eliminates the pain of changing the line and column numbers in `nimout` or `output` while making changes to the test. * Enable using inline msgs and nimout together. Allows ease of inline msgs for the test as well as testing msgs from other modules. * Add path separator and test filename variable interpolation in msgs. Eases handling path separators in the msgs. * Add some documentation. * Fixed lots of broken tests * Fixed more broken tests * Support multiple inline messages per a line * Fix a broken test * Revert variable substitution in `output` * Remove uneeded params * Update doc/testament.md Co-authored-by: Clay Sweetser <Varriount@users.noreply.github.com> * Update testament/specs.nim Co-authored-by: Clay Sweetser <Varriount@users.noreply.github.com> * Update testament/specs.nim Co-authored-by: Clay Sweetser <Varriount@users.noreply.github.com> * Fix indentation Co-authored-by: quantimnot <quantimnot@users.noreply.github.com> Co-authored-by: Clay Sweetser <Varriount@users.noreply.github.com>
* testament :show duration also for failed tests; improve `tshould_not_work`; ↵Timothee Cour2021-05-081-19/+34
| | | | | | | | | | | mitigate #17946 tchannels timeouts (#17947) * refs #17946; refactor testament test summary, show test duration for failures; increase timeout tchannels * revert workarounds from https://github.com/nim-lang/Nim/pull/16698 and add allowPrefixMatch optional param to greedyOrderedSubsetLines * add test * workaround for yet another testament bug
* testament: add `nimoutFull: bool` spec (#17867)Timothee Cour2021-04-271-0/+2
| | | | | | | | | | * testament: add `nimoutFull: bool` spec * PRTEMP * works * cleanup * add test for #12741 * PRTEMP failing test * remove unrelated changes * changelog
* megatest: allow duplicate file names, show compilation progress (#17713)Timothee Cour2021-04-131-0/+1
| | | | | * megatest: allow duplicate file names * megatest: show compilation progress
* fix testament regression: installed testament works again with testament r ↵Timothee Cour2021-01-201-0/+9
| | | | | | | path (#16767) * fix testament regression: installed testament works again with testament r path * fixup
* fix #16576: honor matrix in testament by making such tests non joinable (#16577)Timothee Cour2021-01-042-0/+15
| | | | | | | * refs #16576: honor matrix in testament by making such tests non joinable * add tests + misc fixes * fix test for i386 with -d:danger
* fix #16330 tshould_not_work (#16342)Timothee Cour2020-12-141-3/+1
|
* fix #14242 `testament r tests/js/foo` now works; testament now honors ↵Timothee Cour2020-11-281-14/+14
| | | | | | | --targets (#16163) * fix #14242 `testament r tests/js/foo` now works; testament now honors --targets * fix shouldfail
* add tests for Testament "reject" action (#15709)n5m2020-10-272-0/+8
| | | | | | | | | | | * add test for reject action * highlight that a compilation failure is expected * add the converse test for action=reject * add trailing newline * fix wording
* expect valgrind test failure on memory leak (#15669)n5m2020-10-221-0/+2
| | | | | * expect valgrind test failure on memory leak * alloc 1 instead of 0
* misc testament cleanups (#14764)Timothee Cour2020-06-231-0/+2
| | | | | * misc testament cleanups extracted cleanups from #14530 * make sure all CI failures can be searched with `FAIL: ` including megatest failures
* test suite: rename tests containing 'fail' for easier search in logsAraq2019-11-261-0/+0
|
* added a testcase for #12195; testament now supports a 'timeout' spec fieldAraq2019-09-171-0/+2
|
* make testament a tool we ship with Nim; fixes #12084 (#12088)Andreas Rumpf2019-08-301-1/+1
| | | | | | * make testament a tool we ship with Nim; fixes #12084 * moved config to fit * adapt testament tests to use the testament binary
* lots of testament bug fixes and improvements: (#10044)Timothee Cour2018-12-201-11/+11
|
* tshouldfail is stricterArne Döring2018-12-111-0/+14
|
* allow to disable backend loggingArne Döring2018-12-111-1/+1
|
* Tester tests (#9787)Arne Döring2018-11-271-0/+17
| | | | | | | * remove --lib:lib * added some tests for testatment * tests are addad WIP: add colors switch to tester * meta tester is integrated
* Testament pre parallel (#9137)Jacek Sieka2018-10-128-1979/+0
| | | | | | | | | | * testament: move to root dir (it's not a test) * osproc: fix process index passed to afterRunEvent for parallel runs it was passing the index of the process, not index of all commands * testament: complete file move
* compiler: show name of instantiating context in error traces (#6763) (#9207)xzfc2018-10-111-1/+4
|
* Fix ioTests category after renameSergey Avseyev2018-09-291-1/+1
| | | | Broken in e39f2a9283fc63f529d74acb0d50b0035d513e79
* testament: quote categories too because of 'dir with space' testAraq2018-09-261-2/+2
|
* disable Nimble dependencies for appveyorAraq2018-09-141-1/+1
|
* HTML generation in testament works again (#8702)LemonBoy2018-08-211-2/+2
| | | Fallout from the nil-str patch. Nothing to see here, move along.
* Merge branch 'araq-misc' into develAraq2018-08-162-3/+7
|\
| * Merge branch 'devel' into araq-miscAndreas Rumpf2018-08-161-3/+7
| |\
| * \ Merge branch 'devel' into araq-miscAraq2018-08-132-1/+5
| |\ \
| * | | make NimInAction tests greenAraq2018-08-131-0/+2
| | | |
| * | | testament: change how JS tests are disable for travis on OSXAndreas Rumpf2018-08-132-3/+5
| | | |
* | | | tester.nim add more diagnostics (#8631)Timothee Cour2018-08-161-1/+3
| |_|/ |/| |
* | | Haiku support for Nim (#8542)alaviss2018-08-141-3/+7
| |/ |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * posix_other: Haiku now has spawn.h This is added per https://dev.haiku-os.org/ticket/13446 * posix_other: Add Haiku specific Dirent members * cpuinfo: Add an implementation for Haiku * distros: Add basic Haiku support * encodings: update Haiku support * fenv, math: Haiku now provides libm * times: Add Haiku struct members * ansi_c, osalloc: Add Haiku constants * threads: Add Haiku support * testament: Haiku uses LIBRARY_PATH * nim.cfg: Update Haiku support libnetwork should only be linked if network functions are used * threads: Haiku does not support -pthread switch * tworkingdir: Haiku's env is in /bin * posix_other: add SIGKILLTHR for Haiku * sockets: link with libnetwork on Haiku * coro: correct ucontext.h location http://pubs.opengroup.org/onlinepubs/009696699/basedefs/ucontext.h.html * coro: ucontext backend is not available on Haiku Haiku doesn't provide the <ucontext.h> header, as it was removed from POSIX * coro: fix setjmp backend The compiler does not allow statements after a noreturn function * nativesockets: Haiku doesn't support AI_V4MAPPED * system: hostOS can contains "haiku" * os: add support for Haiku's packagefs packagefs is read-only, but there are writable holes to the underlying file system as well * os: update constant for Haiku
* | Clarify usage of "Test" argument in Koch (#8613)Naveen Arunachalam2018-08-121-1/+1
| | | | | | | | | | | | Minor change to help people (e.g. like myself) who are starting out :) Currently, the readme mentions the use of `./koch tests cat async`, but the help text for koch doesn't mention it. Helptexts are modified accordingly.
* | Preliminary check for test category folder existence (#8579)LemonBoy2018-08-101-0/+4
|/ | | Warn the user if nothing is executed.
* travis/testament: disable JS tests on OSXAndreas Rumpf2018-08-061-2/+4
|
* make 'flags' test green on OSXAndreas Rumpf2018-08-061-1/+1
|
* Testament should run tests with no action (#8232)genotrance2018-07-081-0/+2
| | | | | | * Testament should run tests with no action * Fix strutils tests for JS
* make tests green againAndreas Rumpf2018-07-051-0/+1
|
* Merge pull request #7771 from nim-lang/nim-in-action-fixesAndreas Rumpf2018-06-191-1/+37
|\ | | | | Higher Nim in Action coverage plus regression fix.
| * Workaround VM bug in strutilsDominik Picheta2018-06-171-2/+2
| |
| * Adds smaller code samples from Chapters 1-3 to the tester.Dominik Picheta2018-06-171-1/+37
| |
* | testament: minor code formating changeAndreas Rumpf2018-06-171-1/+1
|/
* Support multi byte characters in module names (#7916)Oscar Nihlgård2018-05-311-1/+1
|
* make the tester compile without warningsAndreas Rumpf2018-05-061-4/+4
|
* Fixes #802, #803 and #3775 - genscript issues (#7677)genotrance2018-04-254-10/+47
| | | | | | | | | | | | | | | | | | * Fixes #802, #803 and #3775 - genscript issues * Test case for genscript * Test script * Verify on Linux * Update categories.nim * Fix merge * Improve test framework * Windows fixes
* unittest: default no color if stdout is not a tty (#7424)Xiao-Yong2018-04-121-1/+1
| | | | | | | We accept a new environment variable, NIMTEST_COLOR, which override the effect of NIMTEST_NO_COLOR. The environment variable, NIMTEST_COLOR, can be 'never' or 'always', which set the color output to false or true, respectively.
* fixes #7236Andreas Rumpf2018-02-261-2/+3
|
* disable symbol file tests for the old symbol file implementationAraq2018-02-191-2/+3
|
* Fix longgc category tests (#7095)Sergey Avseyev2018-01-221-2/+2
| | | | | testC command already has "gcc" as command, second "gcc" as option generates "file not found error", and terminates the compiler with error code
* Merge pull request #7023 from yglukhov/unify-asyncDominik Picheta2018-01-171-1/+2
|\ | | | | Unify async macro and futures for js and native targets
| * Unify async macro and futures for js and native targetsYuriy Glukhov2018-01-051-1/+2
| |