summary refs log tree commit diff stats
path: root/testament/testament.nim
Commit message (Collapse)AuthorAgeFilesLines
* fix #15631 (#15632)n5m2020-10-191-2/+5
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * trigger valgrind failure on memory leak * remove non-malloc tests * remove ORC test is redundant because we already have an ARC test * only run valgrind tests on 64-bit Linux * disable freebsd and openbsd * Remove tleak_refc As to not test implementation details (or bug) * Fix test failures by removing redundant test Since this tests/shoulfail/tvalgrind.nim was specified here to fail this test itself fails since it will be skipped on non-linux CI * Remove test, reason detailed in the previous commit * Remove redundant disables * Revert removing disables * Add and use valgrind: leaks * Fix Co-authored-by: Clyybber <darkmine956@gmail.com> Co-authored-by: n5m
* testament improvement: allow inline error messages inside test cases (#15294)Andreas Rumpf2020-09-101-2/+47
| | | | * testament support for inline error messages * adapt teffects1.nim test to show the potential
* fix #14822 copy test into var in matrix process, so can reset startTime ↵Bung2020-07-171-4/+6
| | | | | | | | | before actully run (#15000) * TTest pass by ref , so can reset startTime before actully run * change TTest to ref type * clone test in matrix process
* Fix style inconsistencies due to the previous commitnarimiran2020-07-061-7/+7
|
* revert 0944b0f4narimiran2020-07-061-7/+7
|
* {.deprecated: [existsFile: fileExists].} (#14735)Timothee Cour2020-07-021-1/+1
| | | | | | | | | * {.deprecated: [existsFile: fileExists].} * s/existsFile/fileExists/ except under deps * workaround pending #14819 * fix test
* fix `./koch tests` following #14823 (#14845)Timothee Cour2020-06-281-1/+2
|
* testament: generic N-fold batching: windows CI 37mn=>16m (#14823)Timothee Cour2020-06-271-3/+15
| | | | | | | | | * testament: run CI faster thanks to batching * move ta_in, tstdin into existing tosproc * move ta_out,tafalse,texitcode,tstderr into existing tosproc * joinable osproc * move tstdout into existing tosproc * spec: batchable; fix tests * fixup
* misc testament cleanups (#14764)Timothee Cour2020-06-231-2/+3
| | | | | * misc testament cleanups extracted cleanups from #14530 * make sure all CI failures can be searched with `FAIL: ` including megatest failures
* `addQuitProc` now works with closures, and c, js(node/browser) backend; fix ↵Timothee Cour2020-06-161-5/+7
| | | | | | | | | | | | | | | some bugs in testament (#14342) * make addQuitProc great again * fix bugs in testament * fix test * change 2016 => 2020 * addQuitProc => addExitProc + locks * move to std/exitprocs
* normalizeExe (#14668)Timothee Cour2020-06-151-8/+3
|
* testament: don't rely on Nim source structure [backport:1.2] (#14077)alaviss2020-04-231-1/+1
| | | | It's also just faster to get the current file name instead of scanning the PATH.
* faster CIs (#13803)Miran2020-03-301-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * ttables: smaller table, 5x speedup * thavlak: less iterations, less loops; 30% speedup * tasyncclosestall: shorter timeout; 35% speedup * gcleak4: less iterations, 2x speedup * ttimes: remove deprecated stuff * tdangerisrelease: remove cpp backend, 3x speedup * tfrexp1: smaller range, 2x speedup * trtree: fix warnings, less iterations, 6x speedup * tasyncawait_cyclebreaker: smaller swarm size; 2x speedup * trealloc: smaller number of iterations; 10x speedup * towned_binary_tree: less iterations, 4x speedup * tclosure: remove unused code, less iterations; 2x speedup * twaitany: less durations; 1.4x speedup * tasync_misc: less iterations, 2x speedup * t8535: smaller sleep, 1.5x speedup * tmanyjoin: smaller sleep, 2x speedup * t12221: shorter sleeps, removed two slower tests; 1.6x speedup * tfuturestream: smaller sleep; 1.5x speedup * growobjcrash: less iterations; 2x speedup * ttryrecv: smaller sleep; 1.5x speedup * treusetvar: less threads; 2x speedup * delete tthreadanalysis2, basically a duplicate of tthreadanalysis * t7758: less iterations, 1.5x speedup * tasyncawait: smaller swarm, less messages; 1.5x speedup * tjsandnativeasync: smaller sleep, 1.5x speedup * tpendingcheck: smaller sleep, 1.5x speedup * remove rodfiles test category * move tseq from its own category to 'collections' category * remove unneeded tests and helpers from 'assert' category * stdlib: merge tbitops2 into tbitops * remove 'trepr2' from 'stdlib' cat * merge 'tstreams' into one file * remove 'tinefficient_const_table' from 'ccbugs' cat * merge 'tcollections_to_string' into 'tcollections' * tblocking_channel: smaller sleep, small speedup * tconvexhull: less iterartions; 1.2x speedup * merge 'tdeepcopy2' into 'tdeepcopy' * merge 'tdisjoint_slice2' into 'tdisjoint_slice1' * tmissing_deepcopy: smaller sequence * tsendtwice: smaller arrays; 5x speedup * remove 'tindexerrorformatbounds' * disable multimethod tests * remove 'gc:none' and 'refc' without 'd:useRealtimeGC' from gc tests * koch.nim: bootstrap just with '-d:release', no need for 'csource' * add github workflow for documentation * testament: no need for 8 sub-second decimals
* allow category nimble-packages to test a single package (#13576)Arne Döring2020-03-181-1/+0
|
* testament: this now works: "testament r /abspath/to/test.nim" (#13358)Timothee Cour2020-02-091-2/+4
|
* testament: introduce 'matrix' for testing multiple options (#13343)Miran2020-02-071-18/+25
|
* testament/azure: major rewrite (#13246)alaviss2020-01-251-10/+6
| | | | | | | | | | | This commit features a major rewrite of Azure Pipelines integration, turning the spaghetti it originally was into something maintainable. Key changes: - No longer requires a ton of hooks into testament. - Results are now cached then bulk-uploaded to prevent throttling from Azure Pipelines, avoiding costly timeouts. - A low timeout is also employed to avoid inflated test time. - The integration is now documented.
* make SuccessX show project file + output file (#13043)Timothee Cour2020-01-081-3/+7
| | | | | | | * make SuccessX show project file + output file * address comments * fix test and add `result.err = reNimcCrash` otherwise hard to see where reNimcCrash used * address comments
* ARC: cycle detector (#12823)Andreas Rumpf2019-12-171-1/+1
| | | | | | | | | | | | | * first implementation of the =trace and =dispose hooks for the cycle collector * a cycle collector for ARC: progress * manual: the .acyclic pragma is a thing once again * gcbench: adaptations for --gc:arc * enable valgrind tests for the strutils tests * testament: better valgrind support * ARC refactoring: growable jumpstacks * ARC cycle detector: non-recursive algorithm * moved and renamed core/ files back to system/ * refactoring: --gc:arc vs --gc:orc since 'orc' is even more experimental and we want to ship --gc:arc soonish
* [backport] Fix style issues in lib/, tools/, and testament/. Fixes #12687. ↵3n-k12019-11-281-7/+7
| | | | (#12754)
* test suite: rename tests containing 'fail' for easier search in logsAraq2019-11-261-1/+1
|
* attempt to add valgrind support to the CIs and testament (#12646)Andreas Rumpf2019-11-181-7/+11
| | | | | | * attempt to add valgrind support to the CIs and testament * valgrind (currently) works only on 64-bit Linux
* testament: add azure integrationLeorize2019-10-031-10/+23
|
* Locks modules should give a compile error when threads are not enabled. (#12231)Ray Imber2019-09-261-0/+4
| | | | | | | | * Locks modules should give a compile error when threads are not enabled. * fix the compile flags to make the tests pass, or ignore files where necessary. * Fixed when statement to account for doc builds.
* added a testcase for #12195; testament now supports a 'timeout' spec fieldAraq2019-09-171-1/+4
|
* make tests green againAndreas Rumpf2019-09-131-1/+1
|
* Fixed c filenames mangling (#12161)Yuriy Glukhov2019-09-111-1/+1
|
* fix testsTimothee Cour2019-09-061-2/+1
|
* make testament a tool we ship with Nim; fixes #12084 (#12088)Andreas Rumpf2019-08-301-0/+733
* make testament a tool we ship with Nim; fixes #12084 * moved config to fit * adapt testament tests to use the testament binary