Commit 7173fe3
committed
fix(treebuild): use Unicode compatibility API
Use the existing kind-aware constructor wrapper for borrowed text spans.
PyPy requires its widening path to preserve surrogate code points; CPython
expands it to the same constructor used by the measured optimization.
Cover lone surrogates and surrogate pairs through tree-builder callbacks.1 parent 83e6fe2 commit 7173fe3
2 files changed
Lines changed: 12 additions & 3 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
81 | 81 | | |
82 | 82 | | |
83 | 83 | | |
84 | | - | |
| 84 | + | |
85 | 85 | | |
86 | 86 | | |
87 | 87 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
105 | 105 | | |
106 | 106 | | |
107 | 107 | | |
108 | | - | |
109 | | - | |
| 108 | + | |
| 109 | + | |
| 110 | + | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
110 | 119 | | |
111 | 120 | | |
112 | 121 | | |
| |||
0 commit comments