Skip to content

Add AST generation #44

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
MarcellPerger1 merged 67 commits into from
Nov 12, 2024
Merged

Add AST generation #44

MarcellPerger1 merged 67 commits into from
Nov 12, 2024

Conversation

@MarcellPerger1
Copy link
Owner

@MarcellPerger1 MarcellPerger1 commented Nov 9, 2024 •
edited
Loading

  • Add AST generation, fixes Add AST generator #33
  • Run tests/fuzzing on Python 3.10 as well
  • More tests are required!

MarcellPerger1 and others added 30 commits November 5, 2024 18:11
@MarcellPerger1
feat(ast): Start AST generation (handles smt)
6a9705d 
Expr handling in a later/next commit
@MarcellPerger1
feat(ast): Finish expr handling in AstGen
49abb1f 
TODO: Implement all the TODOs
@MarcellPerger1
fix(ast): Fix the AST walk not doing anything
d521160
@MarcellPerger1
perf(cst): Use cached CST result if possible
e53ca64
@MarcellPerger1
fix(ast): Fix crash when finding indirect autowalker
c5467ed
@MarcellPerger1
refactor(test): Rename CST functions in CommonTestCase
8a8d387
@MarcellPerger1
refactor(test): Move assertValidParseAST to CommonTestCase
e7ac0ac
@MarcellPerger1
test(ast): Use fuzzing for AST
3356879
@MarcellPerger1
ci: Add option of running 4 different machines (per python version) i…
cbcf6ee 
…n GH actions
@MarcellPerger1
fix(cst): Fix checked_cast on named children for Getattr/Getitem
6b58983
@MarcellPerger1
feat(ast): Add AST node handling to tree_print.py
f302955
@MarcellPerger1
test(ast): Test main examples AST
e9dd389
@MarcellPerger1
refactor(ast): Add type annotations
004c064
@MarcellPerger1
refactor(ast): Extract out errors.py
db9730d
@MarcellPerger1
feat(ast): Add function to evaluate literal strings
75cec69
@MarcellPerger1
test(ast): Add consistency test for eval_string
9c6d004
@MarcellPerger1
fix(ast): Make _register_autowalk_expr work without parens
3b7941e
@MarcellPerger1
fix(snapshots): Fix the distinct lack of snapshots for AST
76fff51
@MarcellPerger1
refactor(ast): Add __all__ to ast_node.py
c52f91f
@MarcellPerger1
fix: Make it work for Python 3.10
54dc854 
(Use Enum instead of the 3.11+ StrEnum)
@MarcellPerger1
fix(ci): Fix fuzzer action on GH mobile
4c2b25e 
(gh mobile can only input floats as workflow args, so accept float, then convert to int)
@MarcellPerger1
fix: Fix workflow names
9b7ab37
@MarcellPerger1
ci: Add Python version to fuzzing workflow name
a941fd6
@MarcellPerger1
fix(ci): Fix fuzzing workflow name
5378d8a
@MarcellPerger1
fix(ci): Fix fuzzing workflow name, yet again
aec85e2
@MarcellPerger1
ci: Add Python 3.12 to test workflow
05c71d9
@MarcellPerger1
refactor: Clarify some comments in error.py
0a0ad70
@MarcellPerger1
test: Add some tests for bugs in eval_string
35b5ca6
@MarcellPerger1
refactor: Extract eval_string to _EvalString class
8774a99
@MarcellPerger1
feat(ast): Add values to literal AST nodes
b999852
@MarcellPerger1
test: Add coverage scripts
f5f6d83
@MarcellPerger1
test: Add over-the-top CSS/JS injection to make HTML output look decent
972e038
@MarcellPerger1
fix: Fix injection for functions/classes page
d6b81e3
@MarcellPerger1
refactor: Refactor the htmlcov-enhancer
1090a94
@MarcellPerger1
test: Add test for NopNode-handling
f08499a
@MarcellPerger1
test: Add some stuff as ignored
4c751f7 
See https://coverage.readthedocs.io/en/7.6.4/excluding.html
@MarcellPerger1
test: Add multiprocessing/SimpleProcessPool coverage
595e7f9
@MarcellPerger1
refactor: Remove unneeded pycharm ignore
7ffad98
@MarcellPerger1
refactor: Rename overly long class in simple_process_pool.py to _Time…
1b7119b 
…outMgr
@MarcellPerger1
fix: Increase _finalize timeout as it takes ages to shut down.
26b5e5e
@MarcellPerger1
fix: Fiz 'process didn't close' message formatting
50fe66e
@MarcellPerger1
perf: Don't test as many combinations in test_py_consistency
24064cb
@MarcellPerger1
test: Add tests for error handling in eval_literal.py
3527128
@MarcellPerger1
Copy link
Owner Author

MarcellPerger1 commented Nov 11, 2024

Coverage right now:
All files:
image
Functions in AST:
image

@MarcellPerger1
Copy link
Owner Author

MarcellPerger1 commented Nov 11, 2024

Tests for eval_literal.py are good enough - these are the only uncovered lines:

Lines Reason
This code path will only happen if there's a bug in NumberParser
None of the code uses this part of this internal method (it's just there for consistency/future use for now)

@MarcellPerger1
Copy link
Owner Author

MarcellPerger1 commented Nov 11, 2024

This code path will only happen if there's a bug in NumberParser

This should probably be pragma: no covered

@MarcellPerger1
Copy link
Owner Author

MarcellPerger1 commented Nov 11, 2024

This code path will only happen if there's a bug in NumberParser

This should probably be pragma: no covered

^^ Done in 19b66a2

@MarcellPerger1
Copy link
Owner Author

MarcellPerger1 commented Nov 12, 2024

The remaining uncovered functions are all internal or one-liners
image

@MarcellPerger1 MarcellPerger1 merged commit aebd6c3 into main Nov 12, 2024
@MarcellPerger1 MarcellPerger1 deleted the start-ast branch November 12, 2024 18:41
@MarcellPerger1
Copy link
Owner Author

MarcellPerger1 commented Nov 12, 2024

Finally done, branch deleted!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

A-AST Area: Abstract Syntax Tree generation (AST) T-feature A new feature

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Add AST generator

2 participants

@MarcellPerger1