summary refs log tree commit diff stats
path: root/testament/testament.nim
Commit message (Collapse)AuthorAgeFilesLines
* gitutils: add diffStrings, diffFiles, and use it in testament to compare ↵Timothee Cour2021-04-301-1/+2
| | | | | | | | | | | | | expected vs gotten (#17892) * gitutils: add diffStrings, diffFiles, and use it in testament to compare expected vs gotten * refactor with createTempDir * cleanup * refacotr * PRTEMP fake test spec changes to show effect of diffStrings * add runnableExamples for experimental/diff + cross-reference with gitutils * Revert "PRTEMP fake test spec changes to show effect of diffStrings" This reverts commit 57dc8d642dce6c1127c98b7cbc9edbfe747d4047.
* Implement https://forum.nim-lang.org/t/7848#50018 (#17874)c-blake2021-04-291-1/+2
| | | | | | | | | | | | | | | | | | | | * Implement https://forum.nim-lang.org/t/7848#50018 with just the same `SuccessX` hint category, build mode on a separate, final line, and no change to how the mode is spelled for -d:release/-d:danger. * Change to add a new BuildMode hint category and keep testament in sync as per comment. * Add "--hint:buildmode:off" to `defaultHintsOff`. * Remove as requested. * As requested for tests clean up. * Address code review. * Address code review. * Mirror db456423116a9b19666f551f4d38aded3964c2e2
* testament: add `nimoutFull: bool` spec (#17867)Timothee Cour2021-04-271-7/+11
| | | | | | | | | | * testament: add `nimoutFull: bool` spec * PRTEMP * works * cleanup * add test for #12741 * PRTEMP failing test * remove unrelated changes * changelog
* add `--processing:dots|filenames|off` to customize `hintProcessing` (#17817)Timothee Cour2021-04-231-1/+1
|
* unit separator (#17730)Andreas Rumpf2021-04-201-0/+7
| | | | | * use the ASCII Unit Separator so that error messages can be handled precisely by the tooling * updated testament
* important_packages: `allowed_failures` batch (#17757)Timothee Cour2021-04-201-1/+1
| | | | | * important_packages: reserve batch 0 for allowed failures * custom batch name: allowed_failures
* ic navigator tests (#17735)Andreas Rumpf2021-04-161-5/+5
| | | * IC navigator: first basic test
* testament --verbose: prints commands; gitignore ic artifacts (#17716)Timothee Cour2021-04-141-3/+11
|
* nim: unbreak CI; testament: add allowedFailure logic for tests that may fail ↵Timothee Cour2021-03-281-5/+11
| | | | but should still run (#17513)
* testament: remove unused tfile,tline,tcolumn (#17515)Timothee Cour2021-03-261-28/+2
|
* remove 'stats' from help document of testament tool (#17364)jiro2021-03-151-1/+0
|
* use NIM_TESTAMENT_BATCH for important_packages, improve formatting, code ↵Timothee Cour2021-03-121-1/+2
| | | | | | | | cleanups (#17301) * use NIM_TESTAMENT_BATCH for important_packages, improve formatting, code cleanups * workaround for nimcrypto not having `--path:.`; remove workaround "two are special snowflakes" * add comment explaining why nimcrypto fails and what packages need to be testable
* asyncjs: add `then`, `catch` for promise pipelining (#16871)Timothee Cour2021-02-241-2/+4
| | | | | | * asyncjs: add then * improve tests, changelog, API * fix cryptic windows error: The parameter is incorrect * address comments
* add -d:nimStrictMode in CI to keep code from regressing; fixes ↵Timothee Cour2021-02-171-4/+3
| | | | ConvFromXtoItselfNotNeeded, UnusedImport notes (#16764)
* remove .github/workflows/ci_ssl.yml; instead run via trunner_thirdparty (#16221)Timothee Cour2021-02-021-1/+4
|
* testament: fix #16829, fix partially #16830 (#16831)Timothee Cour2021-01-271-1/+14
| | | | * fix #16829 * address comments
* Testament small fixes (#16788)Juan Carlos2021-01-221-60/+50
| | | | | | | | | * ReSync with Devel * ReSync * Fix Deprecations, Convertion to itself, code style, etc * Fix Deprecations, Convertion to itself, code style, etc
* fix testament regression: installed testament works again with testament r ↵Timothee Cour2021-01-201-10/+4
| | | | | | | path (#16767) * fix testament regression: installed testament works again with testament r path * fixup
* Deprecate TaintedString (#15423)Juan Carlos2021-01-151-4/+4
| | | | Co-authored-by: Timothee Cour <timothee.cour2@gmail.com> Co-authored-by: Dominik Picheta <dominikpicheta@googlemail.com>
* add error messages (#16679)flywind2021-01-101-1/+1
|
* fix #16576: honor matrix in testament by making such tests non joinable (#16577)Timothee Cour2021-01-041-6/+7
| | | | | | | * refs #16576: honor matrix in testament by making such tests non joinable * add tests + misc fixes * fix test for i386 with -d:danger
* fix #16330 tshould_not_work (#16342)Timothee Cour2020-12-141-2/+2
|
* unittest: use defines instead of env vars (#16165)Timothee Cour2020-12-101-3/+0
| | | | | | | | | * unittest: use defines instead of env vars * use defines in testament * fixup Co-authored-by: Andreas Rumpf <rumpf_a@web.de>
* nimout now consistently uses nimoutCheck (#16189)Timothee Cour2020-12-011-12/+4
|
* testament: error instead of silently overwrite a spec (#16166)Timothee Cour2020-11-291-3/+2
|
* fix #14242 `testament r tests/js/foo` now works; testament now honors ↵Timothee Cour2020-11-281-5/+9
| | | | | | | --targets (#16163) * fix #14242 `testament r tests/js/foo` now works; testament now honors --targets * fix shouldfail
* make megatest consistent with unjoined tests wrt newlines, honor newlines in ↵Timothee Cour2020-11-281-4/+10
| | | | | | | output spec (#16151) * fix megatest newlines * still allow missing trailing newline for now but in a more strict way than before
* targets: use cpp instead of c++ everywhere (was by far the most common) (#15961)Timothee Cour2020-11-141-1/+1
|
* fix #15631 (#15632)n5m2020-10-191-2/+5
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * trigger valgrind failure on memory leak * remove non-malloc tests * remove ORC test is redundant because we already have an ARC test * only run valgrind tests on 64-bit Linux * disable freebsd and openbsd * Remove tleak_refc As to not test implementation details (or bug) * Fix test failures by removing redundant test Since this tests/shoulfail/tvalgrind.nim was specified here to fail this test itself fails since it will be skipped on non-linux CI * Remove test, reason detailed in the previous commit * Remove redundant disables * Revert removing disables * Add and use valgrind: leaks * Fix Co-authored-by: Clyybber <darkmine956@gmail.com> Co-authored-by: n5m
* testament improvement: allow inline error messages inside test cases (#15294)Andreas Rumpf2020-09-101-2/+47
| | | | * testament support for inline error messages * adapt teffects1.nim test to show the potential
* fix #14822 copy test into var in matrix process, so can reset startTime ↵Bung2020-07-171-4/+6
| | | | | | | | | before actully run (#15000) * TTest pass by ref , so can reset startTime before actully run * change TTest to ref type * clone test in matrix process
* Fix style inconsistencies due to the previous commitnarimiran2020-07-061-7/+7
|
* revert 0944b0f4narimiran2020-07-061-7/+7
|
* {.deprecated: [existsFile: fileExists].} (#14735)Timothee Cour2020-07-021-1/+1
| | | | | | | | | * {.deprecated: [existsFile: fileExists].} * s/existsFile/fileExists/ except under deps * workaround pending #14819 * fix test
* fix `./koch tests` following #14823 (#14845)Timothee Cour2020-06-281-1/+2
|
* testament: generic N-fold batching: windows CI 37mn=>16m (#14823)Timothee Cour2020-06-271-3/+15
| | | | | | | | | * testament: run CI faster thanks to batching * move ta_in, tstdin into existing tosproc * move ta_out,tafalse,texitcode,tstderr into existing tosproc * joinable osproc * move tstdout into existing tosproc * spec: batchable; fix tests * fixup
* misc testament cleanups (#14764)Timothee Cour2020-06-231-2/+3
| | | | | * misc testament cleanups extracted cleanups from #14530 * make sure all CI failures can be searched with `FAIL: ` including megatest failures
* `addQuitProc` now works with closures, and c, js(node/browser) backend; fix ↵Timothee Cour2020-06-161-5/+7
| | | | | | | | | | | | | | | some bugs in testament (#14342) * make addQuitProc great again * fix bugs in testament * fix test * change 2016 => 2020 * addQuitProc => addExitProc + locks * move to std/exitprocs
* normalizeExe (#14668)Timothee Cour2020-06-151-8/+3
|
* testament: don't rely on Nim source structure [backport:1.2] (#14077)alaviss2020-04-231-1/+1
| | | | It's also just faster to get the current file name instead of scanning the PATH.
* faster CIs (#13803)Miran2020-03-301-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * ttables: smaller table, 5x speedup * thavlak: less iterations, less loops; 30% speedup * tasyncclosestall: shorter timeout; 35% speedup * gcleak4: less iterations, 2x speedup * ttimes: remove deprecated stuff * tdangerisrelease: remove cpp backend, 3x speedup * tfrexp1: smaller range, 2x speedup * trtree: fix warnings, less iterations, 6x speedup * tasyncawait_cyclebreaker: smaller swarm size; 2x speedup * trealloc: smaller number of iterations; 10x speedup * towned_binary_tree: less iterations, 4x speedup * tclosure: remove unused code, less iterations; 2x speedup * twaitany: less durations; 1.4x speedup * tasync_misc: less iterations, 2x speedup * t8535: smaller sleep, 1.5x speedup * tmanyjoin: smaller sleep, 2x speedup * t12221: shorter sleeps, removed two slower tests; 1.6x speedup * tfuturestream: smaller sleep; 1.5x speedup * growobjcrash: less iterations; 2x speedup * ttryrecv: smaller sleep; 1.5x speedup * treusetvar: less threads; 2x speedup * delete tthreadanalysis2, basically a duplicate of tthreadanalysis * t7758: less iterations, 1.5x speedup * tasyncawait: smaller swarm, less messages; 1.5x speedup * tjsandnativeasync: smaller sleep, 1.5x speedup * tpendingcheck: smaller sleep, 1.5x speedup * remove rodfiles test category * move tseq from its own category to 'collections' category * remove unneeded tests and helpers from 'assert' category * stdlib: merge tbitops2 into tbitops * remove 'trepr2' from 'stdlib' cat * merge 'tstreams' into one file * remove 'tinefficient_const_table' from 'ccbugs' cat * merge 'tcollections_to_string' into 'tcollections' * tblocking_channel: smaller sleep, small speedup * tconvexhull: less iterartions; 1.2x speedup * merge 'tdeepcopy2' into 'tdeepcopy' * merge 'tdisjoint_slice2' into 'tdisjoint_slice1' * tmissing_deepcopy: smaller sequence * tsendtwice: smaller arrays; 5x speedup * remove 'tindexerrorformatbounds' * disable multimethod tests * remove 'gc:none' and 'refc' without 'd:useRealtimeGC' from gc tests * koch.nim: bootstrap just with '-d:release', no need for 'csource' * add github workflow for documentation * testament: no need for 8 sub-second decimals
* allow category nimble-packages to test a single package (#13576)Arne Döring2020-03-181-1/+0
|
* testament: this now works: "testament r /abspath/to/test.nim" (#13358)Timothee Cour2020-02-091-2/+4
|
* testament: introduce 'matrix' for testing multiple options (#13343)Miran2020-02-071-18/+25
|
* testament/azure: major rewrite (#13246)alaviss2020-01-251-10/+6
| | | | | | | | | | | This commit features a major rewrite of Azure Pipelines integration, turning the spaghetti it originally was into something maintainable. Key changes: - No longer requires a ton of hooks into testament. - Results are now cached then bulk-uploaded to prevent throttling from Azure Pipelines, avoiding costly timeouts. - A low timeout is also employed to avoid inflated test time. - The integration is now documented.
* make SuccessX show project file + output file (#13043)Timothee Cour2020-01-081-3/+7
| | | | | | | * make SuccessX show project file + output file * address comments * fix test and add `result.err = reNimcCrash` otherwise hard to see where reNimcCrash used * address comments
* ARC: cycle detector (#12823)Andreas Rumpf2019-12-171-1/+1
| | | | | | | | | | | | | * first implementation of the =trace and =dispose hooks for the cycle collector * a cycle collector for ARC: progress * manual: the .acyclic pragma is a thing once again * gcbench: adaptations for --gc:arc * enable valgrind tests for the strutils tests * testament: better valgrind support * ARC refactoring: growable jumpstacks * ARC cycle detector: non-recursive algorithm * moved and renamed core/ files back to system/ * refactoring: --gc:arc vs --gc:orc since 'orc' is even more experimental and we want to ship --gc:arc soonish
* [backport] Fix style issues in lib/, tools/, and testament/. Fixes #12687. ↵3n-k12019-11-281-7/+7
| | | | (#12754)
* test suite: rename tests containing 'fail' for easier search in logsAraq2019-11-261-1/+1
|
* attempt to add valgrind support to the CIs and testament (#12646)Andreas Rumpf2019-11-181-7/+11
| | | | | | * attempt to add valgrind support to the CIs and testament * valgrind (currently) works only on 64-bit Linux
generated by cgit-pink 1.4.1-2-gfad0 (git 2.36.2.497.gbbea4dcf42) at 2025-06-08 17:57:49 +0000