You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The collection of tasks defined below should be all that is needed to prepare the tests that will determine if the grfn2gromet branch to merge into master. All tasks defined should be carried out on the grfn2gromet branch or a branch from that branch.
Full pipeline script: scripts/model_assembly/py2grfn.py
Tasks
Write a script that will auto-generate the test stubs for tests/program_analysis/test_python2cag.py, tests/program_analysis/test_cag2air.py, tests/model_assembly/test_air2grfn.py, and tests/model_assembly/test_grfn2cag.py for all of the Python code examples according to the three example stubs shown
Create or refactor tests/model_assembly/test_grfn_execution.py to utilize all of the Python code examples
Implement the GrFN3 execution framework
Run the Python code examples with sample input/output. Save those examples to a JSON file that you can load during testing so that you can verify that the GrFN execution is producing the appropriate output for given input.
Run the full pipeline script for each example in the Python code examples with all of the necessary flags to produce the JSON file output for CAST, AIR, GrFN, GrFN dotfiles, and CAG.
This may require changes or corrections to be made in the pipeline that generates these items
Manually inspect the output to ensure that the output is correct
Remove old tests that are no longer necessary for the new pipeline, add any other desired test cases and mark the sensitivity analysis test cases with pytest.mark.skip so that we have a record of them but they will not be caught as failing for this PR.
The text was updated successfully, but these errors were encountered:
Overview
The collection of tasks defined below should be all that is needed to prepare the tests that will determine if the
grfn2gromet
branch to merge intomaster
. All tasks defined should be carried out on thegrfn2gromet
branch or a branch from that branch.Useful pointers
tests/data/program_analysis/language_tests/python/<idiom-name>/<test-name>/<test-name>.py
tests/conftest.py
./pytest.ini
scripts/model_assembly/py2grfn.py
Tasks
tests/program_analysis/test_python2cag.py
,tests/program_analysis/test_cag2air.py
,tests/model_assembly/test_air2grfn.py
, andtests/model_assembly/test_grfn2cag.py
for all of the Python code examples according to the three example stubs showntests/model_assembly/test_grfn_execution.py
to utilize all of the Python code examplespytest.mark.skip
so that we have a record of them but they will not be caught as failing for this PR.The text was updated successfully, but these errors were encountered: