 Brett Langdon
|
96513b67c1
|
add in base for NOT_TEST
|
10 years ago |
|
Brett Langdon
|
49871aff13
|
add token.IsLiteral() method
|
10 years ago |
|
Brett Langdon
|
c407f08d6f
|
add parsing of or test and or test
|
10 years ago |
|
Brett Langdon
|
9a6c39b455
|
setup better parent/child interface naming
|
10 years ago |
|
Brett Langdon
|
6de4a22c88
|
cleanup ast directory
|
10 years ago |
|
Brett Langdon
|
426f42c799
|
add Repr(), added ListNode back in, and some more nodes
|
10 years ago |
|
Brett Langdon
|
4e5763924c
|
update main's signature
|
10 years ago |
|
Brett Langdon
|
8de9bd86d6
|
get working on the parser
|
10 years ago |
|
Brett Langdon
|
a108db6903
|
add String() method for TokenID
|
10 years ago |
|
Brett Langdon
|
c7f8fa356e
|
parser errors
|
10 years ago |
|
Brett Langdon
|
2168bbf7cd
|
add in some node types
|
10 years ago |
|
Brett Langdon
|
4144f5c209
|
get rid of ListNode
|
10 years ago |
|
Brett Langdon
|
4b7b7c9955
|
update main to run parser
|
10 years ago |
|
Brett Langdon
|
fa746cb77e
|
add start to parser
|
10 years ago |
|
Brett Langdon
|
5ced4fc0f9
|
add start to ast
|
10 years ago |
|
Brett Langdon
|
1ebb286c50
|
add grammar file from CPython
|
10 years ago |
|
Brett Langdon
|
2084229cd0
|
update readme docs for parser todo
|
10 years ago |
|
Brett Langdon
|
9943cab792
|
I can markdown
|
10 years ago |
|
Brett Langdon
|
94aab82e63
|
add more readme
|
10 years ago |
|
Brett Langdon
|
281d3a270a
|
no longer using parser.tokenizer
|
10 years ago |
|
Brett Langdon
|
7abed6705a
|
fix up indentation levels
|
10 years ago |
|
Brett Langdon
|
f8ea67a844
|
add errorcode names
|
10 years ago |
|
Brett Langdon
|
a151dea987
|
emit async/await tokens
|
10 years ago |
|
Brett Langdon
|
82746ab67f
|
add proper indent/dedent handling
|
10 years ago |
|
Brett Langdon
|
61fe505579
|
add number parsing
|
10 years ago |
|
Brett Langdon
|
882ba15c02
|
add skeleton for async/await
|
10 years ago |
|
Brett Langdon
|
438e5d1d4a
|
add ATEQUAL checking
|
10 years ago |
|
Brett Langdon
|
a7a729f579
|
do not include EOF in token literal
|
10 years ago |
|
Brett Langdon
|
4e318409ff
|
shuffle line/column incrementing around
|
10 years ago |
|
Brett Langdon
|
f81c42552e
|
add python 3.5.0 missing tokens
|
10 years ago |
|
Brett Langdon
|
2dc98e0cf4
|
use scanner instead of tokenizer
|
10 years ago |
|
Brett Langdon
|
cda0816873
|
start port of tokenizer over to scanner
|
10 years ago |
|
Brett Langdon
|
0c626ae164
|
move tokenizer helpers over to scanner
|
10 years ago |
|
Brett Langdon
|
d7c41f3fae
|
add scanner.Positions
|
10 years ago |
|
Brett Langdon
|
7bc717e693
|
add start to new scanner
|
10 years ago |
|
Brett Langdon
|
8f070002a6
|
add errorcode
|
10 years ago |
|
Brett Langdon
|
d191ba369b
|
emit indent/dedent tokens
|
10 years ago |
|
Brett Langdon
|
8ac42a22ef
|
give main similar output as python -m tokenize
|
10 years ago |
|
Brett Langdon
|
707eb48690
|
properly track line/columns for tokens
|
10 years ago |
|
Brett Langdon
|
7a8c9699ee
|
basic port of tokenizer from CPython
|
10 years ago |
|
Brett Langdon
|
bd8d350650
|
initial commit
|
10 years ago |
