rocky
d32e67891b
More 3.0 bug fixing and tollerance and...
...
add some 1.4 bytecode tests
2018-06-12 12:19:43 -04:00
rocky
600e56b1d7
Better "continue" detection on Python 3.0
2018-06-12 04:47:29 -04:00
rocky
c481d97866
A more uniform way to track opcodes seen...
...
use a set rather than these boolean variables. Done in 3.x
only for now. May do more later..
2018-04-18 12:01:46 -04:00
rocky
1890aad660
Small 3.7 steps
2018-04-13 07:26:32 -04:00
rocky
68821efdb0
Improve 3.5+ BUILD_MAP_UNPACK...
...
And add build_tuple_unpack runtime test from a previous commit.
We are far from out of the woods, as there is more to do and
we've uncovered more bugs in handling this.
2018-04-06 21:34:31 -04:00
rocky
ff9ae4e792
Better handling of BUILD_TUPLE_UNPACK
2018-04-06 11:35:41 -04:00
rocky
d9eb5c5b09
Start folding in 3.5 vararg ops as varargs ops
2018-04-05 23:02:45 -04:00
rocky
1cd2d1e915
DRY scanner code more...
...
Expand 2.6 testing
2018-04-03 10:35:02 -04:00
rocky
fad43feb3d
DRY instruction building code...
...
There is a little more that could be done with self.offset2inst_index
2018-04-03 04:41:36 -04:00
rocky
f18ce71e91
Replace all_instrs with inst_matches...
...
which works on 3.6+. Still should write a pytest for this.
2018-03-29 21:23:26 -04:00
rocky
d90c44b454
3.5+ handle then before "if" jump going to loop
2018-03-27 19:24:29 -04:00
rocky
c5f8bbf32d
Remove hacky 3.x offset address arithmetic
2018-03-26 14:50:17 -04:00
rocky
26e1df835c
Better "continue" detection for 2.7
2018-03-01 23:34:26 -05:00
rocky
6807015526
Better CONTINUE detection on 3.x
...
Helps when line numbers have been stripped say in optimization
2018-03-01 22:47:36 -05:00
rocky
f7439f506a
Fix 3.6 MAKE_FUNCTION for kw params...
...
and remove duplicated attributies in pattr of MAKE_FUNCITON token.
2018-03-01 07:14:46 -05:00
rocky
e23315b2e6
Fallout from more precise token attributes
2018-02-28 23:35:52 -05:00
rocky
413df51dfa
Token.format(), shows CONST values better...
...
We were not showing the proper value for None, or False.
Start a unit test for Token().
I think this cleans the Token class up a little more.
More work is needed for MAKE_FUNCTION...
Note: Some debug stuff is commented out in make_funciton.py for upcoming work.
2018-02-28 22:05:12 -05:00
rocky
c43c9a19aa
Move to GPL3 license
2018-02-27 06:40:36 -05:00
rocky
d3f5ec6f30
Fix Bug in recalculating prev_op ...
...
in removing EXTENDED_ARG
2018-02-27 06:15:37 -05:00
rocky
d09e820d89
Use get_inst() to paper around EXTENDED_ARG
2018-02-25 23:02:23 -05:00
rocky
493835b8cd
bild_lines API changed. Adjust test for change
2018-02-25 21:27:09 -05:00
rocky
f6aa775d58
EXTENDED_ARG in 3.6 fixes
...
3.6 uses EXTENDED_ARG more often appearing as the targets of jump
instructions at the beginning of line statements. All of this wreaks
havoc in the current way that our instruction processing works
2018-02-25 21:06:57 -05:00
rocky
2f6a85d538
Merge branch 'master' into extended_args
2018-02-25 19:19:32 -05:00
rocky
8c0f256b78
Sync python2 and python3 scanner/injest code more
2018-02-25 09:42:04 -05:00
rocky
6e2ca8f53d
Add another guard on a test
2018-02-25 08:59:12 -05:00
rocky
c1ed6dea62
Merge branch 'master' into extended_args
2018-02-25 08:57:11 -05:00
rocky
e3d0b1b9ce
move more toward instruction-based ingest...
...
rather than bytecode-based. This cleans up code
up a little bit better by using more general instructions
2018-02-25 08:51:50 -05:00
rocky
aaf83ea35d
WIP: Handle EXTENDED_ARGS better
2018-02-25 08:22:07 -05:00
rocky
b2dfe0889a
Mark more 3.6+ code that needs to be fixed
2018-01-20 08:09:18 -05:00
rocky
8194595ec9
Handle 3.6+ EXTENDED_ARGs for POP_JUMP_IF... instructions
2018-01-19 16:56:21 -05:00
rocky
f59174575e
Fix 3.5+ bug in if's with pass bodies
...
Fixes #104 in a somewhat hacky way.
2018-01-08 10:21:53 -05:00
rocky
b0d18cae6a
Fix bug in 2.5- try/else inside ifelsestmt
2018-01-06 22:19:44 -05:00
rocky
b139e21ca3
Isolation of <= 3.5 bogus COME_FROM workaround
...
Fixes #144
2017-12-12 12:12:29 -05:00
rocky
41bfa3fc01
Back off 3.5 control flow for now
2017-12-07 15:25:32 -05:00
rocky
b6413b6e6e
Skirt around control-flow problems...
...
Tag some of the weaknesses if we can't address them now
2017-12-07 08:55:45 -05:00
rocky
dded92b85d
Narrow unused classdefdeco2 rules
2017-11-28 12:49:37 -05:00
rocky
e9b60ddbf0
Better Python 3 ENDIF detection
...
If we have
COMPARE_OP exception-match
POP_JUMP_IF...
....
RETURN_VALUE
Then RETURN_VALUE can't be RETURN_END_IF
2017-11-08 23:05:01 -05:00
rocky
0bb793239b
Add 3.6+ grammar for except's ending in RETURN...
...
Not totally out of the maze in 3.6 control flow...
There are still problems with erroneous RETURN_VALUEs becoming RETURN_END_IF,
2017-11-08 10:31:38 -05:00
rocky
4c77170ddf
Small fixes and tweaks:
...
parser.py: handle errors when no tokens have been produced.
scanner3{,0}.py: DRY custom scanner 3.0 rem_or code.
scanner3.py misc other small tweaks
2017-11-07 12:48:03 -05:00
rocky
3e4889bcd7
Small tweaks to sync up better with scanner2.py
2017-11-06 13:30:49 -05:00
rocky
6b6755d599
Fix 3.{3,4} pytest. Remove dup find_jump_targets
2017-11-06 12:27:43 -05:00
rocky
4a904951f4
Move refactored find-jump-targets from 3.6 to 3.x
2017-11-06 11:54:01 -05:00
rocky
124267849c
Move refactored ingest from 3.6 to 3.x...
...
We are getting away from working with bytecode in favor of
working with full-fledged structured instructions
Up next: find_jump_targets()
2017-11-06 09:43:49 -05:00
rocky
9379922c89
Iterate over instruction, not bytecode
2017-11-06 00:46:49 -05:00
rocky
b83d6c64ed
Python 3.6 control flow bug...
...
Much more is needed, but it's a start
2017-10-29 23:52:58 -04:00
rocky
5df09540b5
Python 3.6-inspired instruction size cleanup
...
Revise and generalize for Python 3.6+ instructions vs < 3.6 instuctions.
Used more of the generalized methods in xdis and remove some (but not
all) of the magic numbers.
This is a lot of changes, but not all of the refactoring needed. Much
crap still remains. Also, there are still bugs in handling 3.6 bytecodes.
2017-10-29 11:46:28 -04:00
rocky
9cfd7d669e
Get ready for release 2.13.0
2017-10-10 22:08:10 -04:00
rocky
92f5981661
Misc bugs
2017-10-10 16:08:24 -04:00
rocky
1392b18bd7
Adjust for spark-parser 2.7.0 incompatabilities
2017-10-10 14:14:26 -04:00
rocky
1d7a3c6444
Document hacky customize arg count better.
2017-09-30 18:02:35 -04:00
