Use SierraGenerator for testing (part 5)

[FrancoGiachetta]

Checklist

• Linked to Github Issue
• Unit tests added
• Integration tests added.
• This change requires new documentation.
  • Documentation has been added/updated.

[github-actions]

Benchmark results Main vs HEAD.

Base

Command	Mean [s]	Min [s]	Max [s]	Relative
base dict_insert.cairo (JIT)	3.949 ± 0.051	3.884	4.055	1.01 ± 0.02
base dict_insert.cairo (AOT)	3.900 ± 0.053	3.822	3.985	1.00

Head

Command	Mean [s]	Min [s]	Max [s]	Relative
head dict_insert.cairo (JIT)	3.857 ± 0.031	3.807	3.900	1.03 ± 0.01
head dict_insert.cairo (AOT)	3.751 ± 0.024	3.722	3.792	1.00

Base

Command	Mean [s]	Min [s]	Max [s]	Relative
base dict_snapshot.cairo (JIT)	3.830 ± 0.028	3.788	3.879	1.03 ± 0.01
base dict_snapshot.cairo (AOT)	3.707 ± 0.033	3.668	3.763	1.00

Head

Command	Mean [s]	Min [s]	Max [s]	Relative
head dict_snapshot.cairo (JIT)	3.708 ± 0.013	3.684	3.730	1.02 ± 0.01
head dict_snapshot.cairo (AOT)	3.624 ± 0.020	3.596	3.656	1.00

Base

Command	Mean [s]	Min [s]	Max [s]	Relative
base factorial_2M.cairo (JIT)	4.122 ± 0.025	4.093	4.171	1.01 ± 0.01
base factorial_2M.cairo (AOT)	4.080 ± 0.021	4.051	4.121	1.00

Head

Command	Mean [s]	Min [s]	Max [s]	Relative
head factorial_2M.cairo (JIT)	4.067 ± 0.026	4.038	4.125	1.01 ± 0.01
head factorial_2M.cairo (AOT)	4.026 ± 0.016	3.997	4.046	1.00

Base

Command	Mean [s]	Min [s]	Max [s]	Relative
base fib_2M.cairo (JIT)	3.651 ± 0.027	3.614	3.710	1.01 ± 0.01
base fib_2M.cairo (AOT)	3.605 ± 0.021	3.570	3.634	1.00

Head

Command	Mean [s]	Min [s]	Max [s]	Relative
head fib_2M.cairo (JIT)	3.606 ± 0.043	3.560	3.706	1.00 ± 0.01
head fib_2M.cairo (AOT)	3.591 ± 0.027	3.541	3.637	1.00

Base

Command	Mean [s]	Min [s]	Max [s]	Relative
base linear_search.cairo (JIT)	3.824 ± 0.034	3.779	3.873	1.02 ± 0.02
base linear_search.cairo (AOT)	3.763 ± 0.058	3.688	3.857	1.00

Head

Command	Mean [s]	Min [s]	Max [s]	Relative
head linear_search.cairo (JIT)	3.808 ± 0.017	3.784	3.832	1.03 ± 0.01
head linear_search.cairo (AOT)	3.695 ± 0.017	3.672	3.721	1.00

Base

Command	Mean [s]	Min [s]	Max [s]	Relative
base logistic_map.cairo (JIT)	3.949 ± 0.032	3.898	3.997	1.02 ± 0.02
base logistic_map.cairo (AOT)	3.877 ± 0.057	3.791	4.000	1.00

Head

Command	Mean [s]	Min [s]	Max [s]	Relative
head logistic_map.cairo (JIT)	3.901 ± 0.016	3.884	3.924	1.04 ± 0.01
head logistic_map.cairo (AOT)	3.748 ± 0.017	3.718	3.771	1.00

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 95.00000% with 15 lines in your changes missing coverage. Please review.

Project coverage is 81.22%. Comparing base (3ed2f4b) to head (892438f).

Files with missing lines	Patch %	Lines
src/values.rs	88.78%	12 Missing ⚠️
src/libfuncs/felt252_dict_entry.rs	96.66%	2 Missing ⚠️
src/libfuncs/felt252.rs	97.36%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1129      +/-   ##
==========================================
+ Coverage   81.07%   81.22%   +0.14%     
==========================================
  Files         110      110              
  Lines       29312    29483     +171     
==========================================
+ Hits        23765    23947     +182     
+ Misses       5547     5536      -11     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[github-actions]

Benchmarking results

Benchmark for program dict_insert

Open benchmarks

Command	Mean [s]	Min [s]	Max [s]	Relative
Cairo-vm (Rust, Cairo 1)	20.662 ± 0.138	20.485	20.933	5.29 ± 0.05
cairo-native (embedded AOT)	3.907 ± 0.030	3.869	3.979	1.00
cairo-native (embedded JIT using LLVM's ORC Engine)	3.972 ± 0.029	3.934	4.033	1.02 ± 0.01

Benchmark for program dict_snapshot

Open benchmarks

Command	Mean [s]	Min [s]	Max [s]	Relative
Cairo-vm (Rust, Cairo 1)	5.950 ± 0.031	5.910	6.006	1.59 ± 0.02
cairo-native (embedded AOT)	3.743 ± 0.030	3.715	3.816	1.00
cairo-native (embedded JIT using LLVM's ORC Engine)	3.845 ± 0.014	3.820	3.869	1.03 ± 0.01

Benchmark for program factorial_2M

Open benchmarks

Command	Mean [s]	Min [s]	Max [s]	Relative
Cairo-vm (Rust, Cairo 1)	14.119 ± 0.056	14.068	14.260	3.36 ± 0.03
cairo-native (embedded AOT)	4.197 ± 0.040	4.139	4.257	1.00
cairo-native (embedded JIT using LLVM's ORC Engine)	4.221 ± 0.062	4.153	4.329	1.01 ± 0.02

Benchmark for program fib_2M

Open benchmarks

Command	Mean [s]	Min [s]	Max [s]	Relative
Cairo-vm (Rust, Cairo 1)	14.036 ± 0.090	13.883	14.173	3.81 ± 0.04
cairo-native (embedded AOT)	3.682 ± 0.034	3.650	3.756	1.00
cairo-native (embedded JIT using LLVM's ORC Engine)	3.695 ± 0.016	3.674	3.727	1.00 ± 0.01

Benchmark for program linear_search

Open benchmarks

Command	Mean [s]	Min [s]	Max [s]	Relative
Cairo-vm (Rust, Cairo 1)	5.917 ± 0.033	5.846	5.973	1.56 ± 0.02
cairo-native (embedded AOT)	3.787 ± 0.051	3.735	3.903	1.00
cairo-native (embedded JIT using LLVM's ORC Engine)	3.900 ± 0.027	3.869	3.948	1.03 ± 0.02

Benchmark for program logistic_map

Open benchmarks

Command	Mean [s]	Min [s]	Max [s]	Relative
Cairo-vm (Rust, Cairo 1)	5.820 ± 0.029	5.779	5.863	1.53 ± 0.01
cairo-native (embedded AOT)	3.804 ± 0.021	3.774	3.832	1.00
cairo-native (embedded JIT using LLVM's ORC Engine)	4.016 ± 0.046	3.962	4.098	1.06 ± 0.01