about summary refs log tree commit diff stats
path: root/050scenario.cc
Commit message (Collapse)AuthorAgeFilesLines
* 4139Kartik K. Agaram2017-12-051-5/+1
|
* 4138Kartik K. Agaram2017-12-051-1/+1
|
* 4106Kartik K. Agaram2017-11-031-1/+1
|
* 4104Kartik K. Agaram2017-11-031-3/+3
| | | | | Stop hardcoding Max_depth everywhere; we had a default value for a reason but then we forgot all about it.
* 3966Kartik K. Agaram2017-07-091-1/+1
|
* 3965 - get rid of the teardown() functionKartik K. Agaram2017-07-091-3/+2
| | | | | | Instead of setup() and teardown() we'll just use a reset() function from now on, which will bring the machine back to a good state before each test or run, and also before exit (to avoid memory leaks).
* 3964 - eliminate one global from the test harnessKartik K. Agaram2017-07-091-2/+2
| | | | | I'm in the process of making it more self-contained so I can use it in another project.
* 3910Kartik K. Agaram2017-06-151-0/+1
|
* 3909Kartik K. Agaram2017-06-151-14/+15
| | | | | | | | | In tests where a text has the wrong length, properly show the text observed to help debug failures. We now also consistently say 'text' in Mu errors, never 'string'. Thanks Ella Couch for reporting this long-standing issue.
* 3908Kartik K. Agaram2017-06-151-1/+18
| | | | | Replace an assertion failure with an error message. Thanks Ella Couch for reporting this issue.
* 3907 - standardize test failure messagesKartik K. Agaram2017-06-151-73/+43
|
* 3903 - minimal render when pressing 'tab'Kartik K. Agaram2017-06-091-0/+82
| | | | Turns out all I had to do was reset `go-render?` to false.
* 3877Kartik K. Agaram2017-05-261-1/+1
|
* 3724 - flag duplicate scenariosKartik K. Agaram2016-12-271-2/+23
| | | | | | I took this feature out in 3161 (back in Aug) to support scenarios in lesson/recipes.mu. Setting up snapshots for scenario data structures gives us the best of both worlds.
* 3708Kartik K. Agaram2016-12-121-0/+1
| | | | Fix CI.
* 3707Kartik K. Agaram2016-12-121-0/+6
| | | | | | | | | | | | | | | | | | Be more disciplined about tagging 2 different concepts in the codebase: a) Use the phrase "later layers" to highlight places where a layer doesn't have the simplest possible self-contained implementation. b) Use the word "hook" to point out functions that exist purely to provide waypoints for extension by future layers. Since both these only make sense in the pre-tangled representation of the codebase, using '//:' and '#:' comments to get them stripped out of tangled output. (Though '#:' comments still make it to tangled output at the moment. Let's see if we use it enough to be worth supporting. Scenarios are pretty unreadable in tangled output anyway.)
* 3677 - gracefully handle parse errors in scenariosKartik K. Agaram2016-11-151-3/+26
| | | | Thanks Jack Couch for running into this.
* 3676 - stop scenarios on error in transformKartik K. Agaram2016-11-151-1/+10
| | | | Thanks Jack Couch for running into this.
* 3675Kartik K. Agaram2016-11-151-2/+2
|
* 3663 - fix a refcounting bug: '(type)' != 'type'Kartik K. Agaram2016-11-101-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This was a large commit, and most of it is a follow-up to commit 3309, undoing what is probably the final ill-considered optimization I added to s-expressions in Mu: I was always representing (a b c) as (a b . c), etc. That is now gone. Why did I need to take it out? The key problem was the error silently ignored in layer 30. That was causing size_of("(type)") to silently return garbage rather than loudly complain (assuming 'type' was a simple type). But to take it out I had to modify types_strictly_match (layer 21) to actually strictly match and not just do a prefix match. In the process of removing the prefix match, I had to make extracting recipe types from recipe headers more robust. So far it only matched the first element of each ingredient's type; these matched: (recipe address:number -> address:number) (recipe address -> address) I didn't notice because the dotted notation optimization was actually representing this as: (recipe address:number -> address number) --- One final little thing in this commit: I added an alias for 'assert' called 'assert_for_now', to indicate that I'm not sure something's really an invariant, that it might be triggered by (invalid) user programs, and so require more thought on error handling down the road. But this may well be an ill-posed distinction. It may be overwhelmingly uneconomic to continually distinguish between model invariants and error states for input. I'm starting to grow sympathetic to Google Analytics's recent approach of just banning assertions altogether. We'll see..
* 3643Kartik K. Agaram2016-11-071-2/+2
| | | | | Standardize on calling literate waypoints "Special-cases" rather than "Cases". Invariably there's a default path already present.
* 3630 - generate trace for a single scenarioKartik K. Agaram2016-11-061-0/+4
| | | | | | | | To do so, run: $ ./mu --trace test <scenario name> The trace will then be in file 'interactive'.
* 3623Kartik K. Agaram2016-11-051-0/+1
| | | | Umpteenth bugfix to ensure we show the number of failed scenarios.
* 3593Kartik K. Agaram2016-10-251-1/+2
|
* 3561Kartik K. Agaram2016-10-221-7/+8
|
* 3555Kartik K. Agaram2016-10-221-1/+1
|
* 3539Kartik K. Agaram2016-10-211-0/+30
| | | | | | | | | | | | | Always check if next_word() returned an empty string (if it hit eof). Thanks Rebecca Allard for running into a crash when a .mu file ends with '{' (without a following newline). Open question: how to express the constraint that next_word() should always check if its result is empty? Can *any* type system do that?! Even the usual constraint that we must use a result isn't iron-clad: you could save the result in a variable but then ignore it. Unless you go to Go's extraordinary lengths of considering any dead code an error.
* 3532Kartik K. Agaram2016-10-201-2/+0
| | | | Coalesce all the management of number of failed scenarios.
* 3531Kartik K. Agaram2016-10-201-3/+3
| | | | | Be consistent in checking for Scenario_testing_scenario when signalling that a Mu scenario failed.
* 3530Kartik K. Agaram2016-10-201-1/+1
| | | | Coalesce some duplicate signalling that the current test failed.
* 3522Kartik K. Agaram2016-10-191-8/+8
|
* 3429 - standardize Mu scenariosKartik K. Agaram2016-09-281-31/+11
| | | | | | | | | | | | | A long-standing problem has been that I couldn't spread code across 'run' blocks because they were separate scopes, so I've ended up making them effectively comments. Running code inside a 'run' block is identical in every way to simply running the code directly. The 'run' block is merely a visual aid to separate setup from the component under test. In the process I've also standardized all Mu scenarios to always run in a local scope, and only use (raw) numeric addresses for values they want to check later.
* 3425 - support for disabling some scenariosKartik K. Agaram2016-09-271-0/+4
|
* 3424Kartik K. Agaram2016-09-271-1/+5
|
* 3385Kartik K. Agaram2016-09-171-19/+19
|
* 3376 - start maximally using all type abbreviationsKartik K. Agaram2016-09-171-1/+1
| | | | | | It might be too much, particularly if students start peeking inside .mu files early. But worth a shot for not just to iron out the kinks in the abbreviation system.
* 3374Kartik K. Agaram2016-09-161-2/+2
|
* 3366Kartik K. Agaram2016-09-151-1/+1
| | | | | | Small bugfix in error messages for scenarios: we're trying to use read_mu_string() on an array of characters rather than an address to an array of characters. So we need to pretend we have a refcount.
* 3327Kartik K. Agaram2016-09-111-1/+1
|
* 3309Kartik K. Agaram2016-09-091-3/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Rip out everything to fix one failing unit test (commit 3290; type abbreviations). This commit does several things at once that I couldn't come up with a clean way to unpack: A. It moves to a new representation for type trees without changing the actual definition of the `type_tree` struct. B. It adds unit tests for our type metadata precomputation, so that errors there show up early and in a simpler setting rather than dying when we try to load Mu code. C. It fixes a bug, guarding against infinite loops when precomputing metadata for recursive shape-shifting containers. To do this it uses a dumb way of comparing type_trees, comparing their string representations instead. That is likely incredibly inefficient. Perhaps due to C, this commit has made Mu incredibly slow. Running all tests for the core and the edit/ app now takes 6.5 minutes rather than 3.5 minutes. == more notes and details I've been struggling for the past week now to back out of a bad design decision, a premature optimization from the early days: storing atoms directly in the 'value' slot of a cons cell rather than creating a special 'atom' cons cell and storing it on the 'left' slot. In other words, if a cons cell looks like this: o / | \ left val right ..then the type_tree (a b c) used to look like this (before this commit): o | \ a o | \ b o | \ c null ..rather than like this 'classic' approach to s-expressions which never mixes val and right (which is what we now have): o / \ o o | / \ a o o | / \ b o null | c The old approach made several operations more complicated, most recently the act of replacing a (possibly atom/leaf) sub-tree with another. That was the final straw that got me to realize the contortions I was going through to save a few type_tree nodes (cons cells). Switching to the new approach was hard partly because I've been using the old approach for so long and type_tree manipulations had pervaded everything. Another issue I ran into was the realization that my layers were not cleanly separated. Key parts of early layers (precomputing type metadata) existed purely for far later ones (shape-shifting types). Layers I got repeatedly stuck at: 1. the transform for precomputing type sizes (layer 30) 2. type-checks on merge instructions (layer 31) 3. the transform for precomputing address offsets in types (layer 36) 4. replace operations in supporting shape-shifting recipes (layer 55) After much thrashing I finally noticed that it wasn't the entirety of these layers that was giving me trouble, but just the type metadata precomputation, which had bugs that weren't manifesting until 30 layers later. Or, worse, when loading .mu files before any tests had had a chance to run. A common failure mode was running into types at run time that I hadn't precomputed metadata for at transform time. Digging into these bugs got me to realize that what I had before wasn't really very good, but a half-assed heuristic approach that did a whole lot of extra work precomputing metadata for utterly meaningless types like `((address number) 3)` which just happened to be part of a larger type like `(array (address number) 3)`. So, I redid it all. I switched the representation of types (because the old representation made unit tests difficult to retrofit) and added unit tests to the metadata precomputation. I also made layer 30 only do the minimal metadata precomputation it needs for the concepts introduced until then. In the process, I also made the precomputation more correct than before, and added hooks in the right place so that I could augment the logic when I introduced shape-shifting containers. == lessons learned There's several levels of hygiene when it comes to layers: 1. Every layer introduces precisely what it needs and in the simplest way possible. If I was building an app until just that layer, nothing would seem over-engineered. 2. Some layers are fore-shadowing features in future layers. Sometimes this is ok. For example, layer 10 foreshadows containers and arrays and so on without actually supporting them. That is a net win because it lets me lay out the core of Mu's data structures out in one place. But if the fore-shadowing gets too complex things get nasty. Not least because it can be hard to write unit tests for features before you provide the plumbing to visualize and manipulate them. 3. A layer is introducing features that are tested only in later layers. 4. A layer is introducing features with tests that are invalidated in later layers. (This I knew from early on to be an obviously horrendous idea.) Summary: avoid Level 2 (foreshadowing layers) as much as possible. Tolerate it indefinitely for small things where the code stays simple over time, but become strict again when things start to get more complex. Level 3 is mostly a net lose, but sometimes it can be expedient (a real case of the usually grossly over-applied term "technical debt"), and it's better than the conventional baseline of no layers and no scenarios. Just clean it up as soon as possible. Definitely avoid layer 4 at any time. == minor lessons Avoid unit tests for trivial things, write scenarios in context as much as possible. But within those margins unit tests are fine. Just introduce them before any scenarios (commit 3297). Reorganizing layers can be easy. Just merge layers for starters! Punt on resplitting them in some new way until you've gotten them to work. This is the wisdom of Refactoring: small steps. What made it hard was not wanting to merge *everything* between layer 30 and 55. The eventual insight was realizing I just need to move those two full-strength transforms and nothing else.
* 3294Kartik K. Agaram2016-09-021-1/+1
|
* 3273Kartik K. Agaram2016-08-281-0/+1
| | | | | | | | | | | Undo 3272. The trouble with creating a new section for constants is that there's no good place to order it since constants can be initialized using globals as well as vice versa. And I don't want to add constraints disallowing either side. Instead, a new plan: always declare constants in the Globals section using 'extern const' rather than just 'const', since otherwise constants implicitly have internal linkage (http://stackoverflow.com/questions/14894698/why-does-extern-const-int-n-not-work-as-expected)
* 3252Kartik K. Agaram2016-08-251-1/+1
|
* 3247Kartik K. Agaram2016-08-251-4/+4
|
* 3188Kartik K. Agaram2016-08-141-2/+2
|
* 3177Kartik K. Agaram2016-08-131-1/+2
| | | | Systematize all the newlines while displaying test progress.
* 3176Kartik K. Agaram2016-08-131-7/+9
| | | | Don't print the header for 'Mu tests' if there are no Mu tests to run.
* 3175Kartik K. Agaram2016-08-131-1/+0
|
* 3172Kartik K. Agaram2016-08-121-4/+0
| | | | Fix CI.
* 3170 - multiple --options at the commandlineKartik K. Agaram2016-08-121-1/+8
| | | | | | | | The mu commandline now has four parts: options, commands (of which we only have one so far: 'test'), files/directories and ingredients to pass to 'main'. That cleans up the hacky ordering constraint we had earlier. I've also cleaned up the usage message.
<vc@akkartik.com> 2021-01-16 09:29:21 -0800 committer Kartik Agaram <vc@akkartik.com> 2021-01-16 09:29:21 -0800 7526' href='/akkartik/mu/commit/120allocate.subx?h=hlt&id=b62865572211a5675493956605e7137d19265a9b'>b6286557 ^
71e4f381 ^
7a583220 ^
33352536 ^

6a7eaa81 ^

01b72aa0 ^
7a583220 ^
33352536 ^

ca358b17 ^

e5118fa9 ^

ca358b17 ^

e5118fa9 ^


ca358b17 ^















71e4f381 ^




ca358b17 ^




71e4f381 ^








ca358b17 ^
ca358b17 ^


33352536 ^
ca358b17 ^


6a7eaa81 ^
33352536 ^
ca358b17 ^

6a7eaa81 ^
84a02972 ^
6a7eaa81 ^
ca358b17 ^







33352536 ^
ca358b17 ^

6a7eaa81 ^
ca358b17 ^


33352536 ^
6a7eaa81 ^


33352536 ^
ca358b17 ^
f7360e49 ^
b6286557 ^
71e4f381 ^
e5118fa9 ^





























b6286557 ^

ca358b17 ^








71e4f381 ^









ca358b17 ^



71e4f381 ^
ca358b17 ^

71e4f381 ^
ca358b17 ^







71e4f381 ^
ca358b17 ^





71e4f381 ^
ca358b17 ^












6a7eaa81 ^


33352536 ^
ca358b17 ^









f7360e49 ^
b6286557 ^
71e4f381 ^
7a583220 ^
33352536 ^

6a7eaa81 ^

456b44fb ^
01b72aa0 ^
456b44fb ^





























01b72aa0 ^
3b5b19df ^





















bc20cc3d ^
546a9298 ^
7a583220 ^
33352536 ^

bc20cc3d ^
546a9298 ^
33352536 ^
546a9298 ^
bc20cc3d ^
546a9298 ^
33352536 ^

bc20cc3d ^


546a9298 ^



ca358b17 ^

33352536 ^

6070c23e ^
bc20cc3d ^
33352536 ^







bc20cc3d ^
33352536 ^
546a9298 ^
7a583220 ^
33352536 ^

bc20cc3d ^

aff782c4 ^





bc20cc3d ^
71e4f381 ^



bc20cc3d ^

c48ce3c8 ^

01b72aa0 ^
c48ce3c8 ^



546a9298 ^
c48ce3c8 ^


dfb4a6f9 ^
c48ce3c8 ^

546a9298 ^
c48ce3c8 ^
546a9298 ^
c48ce3c8 ^




546a9298 ^



ca358b17 ^


c48ce3c8 ^




546a9298 ^
c48ce3c8 ^




ca358b17 ^



71e4f381 ^






ca358b17 ^
71e4f381 ^

ca358b17 ^










































































b6286557 ^
71e4f381 ^
ca358b17 ^




01b72aa0 ^
ca358b17 ^
































































71e4f381 ^






ca358b17 ^
71e4f381 ^

ca358b17 ^





































































02b7f9bd ^
ca358b17 ^











b6286557 ^
71e4f381 ^
ca358b17 ^




84a02972 ^
e2b55208 ^
84a02972 ^



5462619d ^
84a02972 ^















5462619d ^
84a02972 ^

5462619d ^
84a02972 ^


ae1089cb ^
84a02972 ^
























5462619d ^
84a02972 ^














b6286557 ^

84a02972 ^




6a7eaa81 ^
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914