diff options
| author | Kartik K. Agaram <vc@akkartik.com> | 2021-06-22 22:30:21 -0700 |
|---|---|---|
| committer | Kartik K. Agaram <vc@akkartik.com> | 2021-06-22 22:32:20 -0700 |
| commit | aebcfd1bfbf1d071ffbff7603c89c9746cb81017 (patch) | |
| tree | 7b91afdbb3f59a7a0dc9dcd69a66d32aef061196 /shell/tokenize.mu | |
| parent | f5e55cbbdbe177f5174112f811af20bd76150b6f (diff) | |
| download | mu-aebcfd1bfbf1d071ffbff7603c89c9746cb81017.tar.gz | |
beginnings of tokenization within symbols
We're now down to 4 failing tests. But these will require surgery.
Diffstat (limited to 'shell/tokenize.mu')
| -rw-r--r-- | shell/tokenize.mu | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/shell/tokenize.mu b/shell/tokenize.mu index 3a080135..2d7ea041 100644 --- a/shell/tokenize.mu +++ b/shell/tokenize.mu @@ -523,7 +523,7 @@ fn next-symbol-token in: (addr gap-buffer), _out: (addr token), trace: (addr tra trace-lower trace var out/eax: (addr token) <- copy _out var out-data-ah/eax: (addr handle stream byte) <- get out, text-data - populate-stream out-data-ah, 0x40 + populate-stream out-data-ah, 0x40/max-symbol-size var _out-data/eax: (addr stream byte) <- lookup *out-data-ah var out-data/edi: (addr stream byte) <- copy _out-data $next-symbol-token:loop: { |