summary refs log tree commit diff stats
path: root/testament/testament.nim
Commit message (Collapse)AuthorAgeFilesLines
* fixes a severe bug of testament (#20832)ringabout2022-11-171-0/+1
| | | | | | | | | | | | | | | | | | | * test azure * use exit 1 * try again * use useSysAssert * disable i386 * use refc for tlsEmulation on i386 * use refc * disable i386 Co-authored-by: Clay Sweetser <Varriount@users.noreply.github.com>
* Update testament usage to clarify testament all (#20757)Lee Matos2022-11-071-1/+1
|
* [Testament] Extend and document message testing aids (#19996)quantimnot2022-09-011-55/+27
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * [Testament] Extend and document message testing aids * Enable inline msgs when not reject action. Eliminates the pain of changing the line and column numbers in `nimout` or `output` while making changes to the test. * Enable using inline msgs and nimout together. Allows ease of inline msgs for the test as well as testing msgs from other modules. * Add path separator and test filename variable interpolation in msgs. Eases handling path separators in the msgs. * Add some documentation. * Fixed lots of broken tests * Fixed more broken tests * Support multiple inline messages per a line * Fix a broken test * Revert variable substitution in `output` * Remove uneeded params * Update doc/testament.md Co-authored-by: Clay Sweetser <Varriount@users.noreply.github.com> * Update testament/specs.nim Co-authored-by: Clay Sweetser <Varriount@users.noreply.github.com> * Update testament/specs.nim Co-authored-by: Clay Sweetser <Varriount@users.noreply.github.com> * Fix indentation Co-authored-by: quantimnot <quantimnot@users.noreply.github.com> Co-authored-by: Clay Sweetser <Varriount@users.noreply.github.com>
* remove some deprecated pre-1.0 stdlib modules (#20202)metagn2022-08-231-1/+0
| | | | | | | | | | | | | | | * remove pre-1.0 stdlib deprecations notable exceptions: * ze, toU8 etc in system/arithmetics * potentially callsite * undo macros, ospaths, securehash, oswalkdir * add sets back * add back future, document deprecated versions * add to changelog [skip ci]
* testament: use full test name in skips [backport] (#19937)Jacek Sieka2022-07-161-7/+13
| | | testament: use full test name in skips
* Fix default testament target in docs and cli help (#19796)quantimnot2022-05-231-1/+1
| | | Co-authored-by: quantimnot <quantimnot@users.noreply.github.com>
* testament: include extra options in test name (#19801)Jacek Sieka2022-05-191-41/+38
| | | there's currently no (simple) way to disambiguate which option failed
* remove `std/sharedstrings` (#19228)flywind2021-12-091-1/+0
| | | | | | | * remove std/sharedstrings it has been broken since 0.18.0 * rephrase the changelog entry
* testament --megatest:off now makes tests non-joinable so that they all run ↵Timothee Cour2021-09-031-1/+1
| | | | (#18787)
* merge BuildMode into SuccessX, remove code duplication w drnim, add useful ↵Timothee Cour2021-06-141-2/+1
| | | | | | | | | | | info to successx, add gc to compilesettings (#18252) * merge BuildMode into SuccessX, add more info * refactor duplicated with drnim * fixup * address comment
* testament: remove deadcode related to realtimeGC, testC, callCCompiler (#18087)Timothee Cour2021-05-261-63/+0
|
* fix #18077 testament now parses `cmd` properly (#18086)Timothee Cour2021-05-261-15/+38
|
* remove some custom logic in testament around flags, testExec (#18090)Timothee Cour2021-05-261-16/+0
| | | | | | | * remove some custom logic in testament around flags, testExec * remove testExec, custom logic around flags from testament * fixup
* fixes #17943 (#18045)Andreas Rumpf2021-05-191-2/+2
| | | | | | | | | | | * fixes #17943 * IC: test 'nim check --ic:on' for the full Nim compiler * Update testament/testament.nim Co-authored-by: Clyybber <darkmine956@gmail.com> Co-authored-by: Clyybber <darkmine956@gmail.com>
* make testament `isSuccess` more robust and allow tests with `--hints:off` to ↵Timothee Cour2021-05-111-7/+29
| | | | | | | | | succeed (#17968) * fix testament isSuccess * show givenSpec in addResult * simplify tstatictypes.nim
* fix #17960: honor `matrix` also for `action: compile, action: reject` (#17980)Timothee Cour2021-05-091-6/+7
| | | | * fix #17960: honor `matrix` for all action
* testament :show duration also for failed tests; improve `tshould_not_work`; ↵Timothee Cour2021-05-081-2/+4
| | | | | | | | | | | mitigate #17946 tchannels timeouts (#17947) * refs #17946; refactor testament test summary, show test duration for failures; increase timeout tchannels * revert workarounds from https://github.com/nim-lang/Nim/pull/16698 and add allowPrefixMatch optional param to greedyOrderedSubsetLines * add test * workaround for yet another testament bug
* gitutils: add diffStrings, diffFiles, and use it in testament to compare ↵Timothee Cour2021-04-301-1/+2
| | | | | | | | | | | | | expected vs gotten (#17892) * gitutils: add diffStrings, diffFiles, and use it in testament to compare expected vs gotten * refactor with createTempDir * cleanup * refacotr * PRTEMP fake test spec changes to show effect of diffStrings * add runnableExamples for experimental/diff + cross-reference with gitutils * Revert "PRTEMP fake test spec changes to show effect of diffStrings" This reverts commit 57dc8d642dce6c1127c98b7cbc9edbfe747d4047.
* Implement https://forum.nim-lang.org/t/7848#50018 (#17874)c-blake2021-04-291-1/+2
| | | | | | | | | | | | | | | | | | | | * Implement https://forum.nim-lang.org/t/7848#50018 with just the same `SuccessX` hint category, build mode on a separate, final line, and no change to how the mode is spelled for -d:release/-d:danger. * Change to add a new BuildMode hint category and keep testament in sync as per comment. * Add "--hint:buildmode:off" to `defaultHintsOff`. * Remove as requested. * As requested for tests clean up. * Address code review. * Address code review. * Mirror db456423116a9b19666f551f4d38aded3964c2e2
* testament: add `nimoutFull: bool` spec (#17867)Timothee Cour2021-04-271-7/+11
| | | | | | | | | | * testament: add `nimoutFull: bool` spec * PRTEMP * works * cleanup * add test for #12741 * PRTEMP failing test * remove unrelated changes * changelog
* add `--processing:dots|filenames|off` to customize `hintProcessing` (#17817)Timothee Cour2021-04-231-1/+1
|
* unit separator (#17730)Andreas Rumpf2021-04-201-0/+7
| | | | | * use the ASCII Unit Separator so that error messages can be handled precisely by the tooling * updated testament
* important_packages: `allowed_failures` batch (#17757)Timothee Cour2021-04-201-1/+1
| | | | | * important_packages: reserve batch 0 for allowed failures * custom batch name: allowed_failures
* ic navigator tests (#17735)Andreas Rumpf2021-04-161-5/+5
| | | * IC navigator: first basic test
* testament --verbose: prints commands; gitignore ic artifacts (#17716)Timothee Cour2021-04-141-3/+11
|
* nim: unbreak CI; testament: add allowedFailure logic for tests that may fail ↵Timothee Cour2021-03-281-5/+11
| | | | but should still run (#17513)
* testament: remove unused tfile,tline,tcolumn (#17515)Timothee Cour2021-03-261-28/+2
|
* remove 'stats' from help document of testament tool (#17364)jiro2021-03-151-1/+0
|
* use NIM_TESTAMENT_BATCH for important_packages, improve formatting, code ↵Timothee Cour2021-03-121-1/+2
| | | | | | | | cleanups (#17301) * use NIM_TESTAMENT_BATCH for important_packages, improve formatting, code cleanups * workaround for nimcrypto not having `--path:.`; remove workaround "two are special snowflakes" * add comment explaining why nimcrypto fails and what packages need to be testable
* asyncjs: add `then`, `catch` for promise pipelining (#16871)Timothee Cour2021-02-241-2/+4
| | | | | | * asyncjs: add then * improve tests, changelog, API * fix cryptic windows error: The parameter is incorrect * address comments
* add -d:nimStrictMode in CI to keep code from regressing; fixes ↵Timothee Cour2021-02-171-4/+3
| | | | ConvFromXtoItselfNotNeeded, UnusedImport notes (#16764)
* remove .github/workflows/ci_ssl.yml; instead run via trunner_thirdparty (#16221)Timothee Cour2021-02-021-1/+4
|
* testament: fix #16829, fix partially #16830 (#16831)Timothee Cour2021-01-271-1/+14
| | | | * fix #16829 * address comments
* Testament small fixes (#16788)Juan Carlos2021-01-221-60/+50
| | | | | | | | | * ReSync with Devel * ReSync * Fix Deprecations, Convertion to itself, code style, etc * Fix Deprecations, Convertion to itself, code style, etc
* fix testament regression: installed testament works again with testament r ↵Timothee Cour2021-01-201-10/+4
| | | | | | | path (#16767) * fix testament regression: installed testament works again with testament r path * fixup
* Deprecate TaintedString (#15423)Juan Carlos2021-01-151-4/+4
| | | | Co-authored-by: Timothee Cour <timothee.cour2@gmail.com> Co-authored-by: Dominik Picheta <dominikpicheta@googlemail.com>
* add error messages (#16679)flywind2021-01-101-1/+1
|
* fix #16576: honor matrix in testament by making such tests non joinable (#16577)Timothee Cour2021-01-041-6/+7
| | | | | | | * refs #16576: honor matrix in testament by making such tests non joinable * add tests + misc fixes * fix test for i386 with -d:danger
* fix #16330 tshould_not_work (#16342)Timothee Cour2020-12-141-2/+2
|
* unittest: use defines instead of env vars (#16165)Timothee Cour2020-12-101-3/+0
| | | | | | | | | * unittest: use defines instead of env vars * use defines in testament * fixup Co-authored-by: Andreas Rumpf <rumpf_a@web.de>
* nimout now consistently uses nimoutCheck (#16189)Timothee Cour2020-12-011-12/+4
|
* testament: error instead of silently overwrite a spec (#16166)Timothee Cour2020-11-291-3/+2
|
* fix #14242 `testament r tests/js/foo` now works; testament now honors ↵Timothee Cour2020-11-281-5/+9
| | | | | | | --targets (#16163) * fix #14242 `testament r tests/js/foo` now works; testament now honors --targets * fix shouldfail
* make megatest consistent with unjoined tests wrt newlines, honor newlines in ↵Timothee Cour2020-11-281-4/+10
| | | | | | | output spec (#16151) * fix megatest newlines * still allow missing trailing newline for now but in a more strict way than before
* targets: use cpp instead of c++ everywhere (was by far the most common) (#15961)Timothee Cour2020-11-141-1/+1
|
* fix #15631 (#15632)n5m2020-10-191-2/+5
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * trigger valgrind failure on memory leak * remove non-malloc tests * remove ORC test is redundant because we already have an ARC test * only run valgrind tests on 64-bit Linux * disable freebsd and openbsd * Remove tleak_refc As to not test implementation details (or bug) * Fix test failures by removing redundant test Since this tests/shoulfail/tvalgrind.nim was specified here to fail this test itself fails since it will be skipped on non-linux CI * Remove test, reason detailed in the previous commit * Remove redundant disables * Revert removing disables * Add and use valgrind: leaks * Fix Co-authored-by: Clyybber <darkmine956@gmail.com> Co-authored-by: n5m
* testament improvement: allow inline error messages inside test cases (#15294)Andreas Rumpf2020-09-101-2/+47
| | | | * testament support for inline error messages * adapt teffects1.nim test to show the potential
* fix #14822 copy test into var in matrix process, so can reset startTime ↵Bung2020-07-171-4/+6
| | | | | | | | | before actully run (#15000) * TTest pass by ref , so can reset startTime before actully run * change TTest to ref type * clone test in matrix process
* Fix style inconsistencies due to the previous commitnarimiran2020-07-061-7/+7
|
* revert 0944b0f4narimiran2020-07-061-7/+7
|
generated by cgit-pink 1.4.1-2-gfad0 (git 2.36.2.497.gbbea4dcf42) at 2025-04-25 13:04:50 +0000