Use SierraGenerator for testing (part 1)

[FrancoGiachetta]

Checklist

• Linked to Github Issue
• Unit tests added
• Integration tests added.
• This change requires new documentation.
  • Documentation has been added/updated.

[github-actions]

Benchmark results Main vs HEAD.

Base

Command	Mean [s]	Min [s]	Max [s]	Relative
base dict_insert.cairo (JIT)	3.804 ± 0.022	3.782	3.844	1.02 ± 0.01
base dict_insert.cairo (AOT)	3.725 ± 0.013	3.702	3.746	1.00

Head

Command	Mean [s]	Min [s]	Max [s]	Relative
head dict_insert.cairo (JIT)	3.880 ± 0.035	3.828	3.931	1.02 ± 0.01
head dict_insert.cairo (AOT)	3.811 ± 0.024	3.783	3.854	1.00

Base

Command	Mean [s]	Min [s]	Max [s]	Relative
base dict_snapshot.cairo (JIT)	3.693 ± 0.016	3.660	3.712	1.02 ± 0.01
base dict_snapshot.cairo (AOT)	3.604 ± 0.019	3.575	3.630	1.00

Head

Command	Mean [s]	Min [s]	Max [s]	Relative
head dict_snapshot.cairo (JIT)	3.742 ± 0.025	3.701	3.786	1.03 ± 0.01
head dict_snapshot.cairo (AOT)	3.635 ± 0.029	3.592	3.689	1.00

Base

Command	Mean [s]	Min [s]	Max [s]	Relative
base factorial_2M.cairo (JIT)	4.037 ± 0.027	3.995	4.089	1.00 ± 0.01
base factorial_2M.cairo (AOT)	4.018 ± 0.040	3.961	4.072	1.00

Head

Command	Mean [s]	Min [s]	Max [s]	Relative
head factorial_2M.cairo (JIT)	4.079 ± 0.020	4.045	4.112	1.00
head factorial_2M.cairo (AOT)	4.160 ± 0.048	4.096	4.267	1.02 ± 0.01

Base

Command	Mean [s]	Min [s]	Max [s]	Relative
base fib_2M.cairo (JIT)	3.591 ± 0.020	3.571	3.637	1.01 ± 0.01
base fib_2M.cairo (AOT)	3.549 ± 0.025	3.512	3.579	1.00

Head

Command	Mean [s]	Min [s]	Max [s]	Relative
head fib_2M.cairo (JIT)	3.688 ± 0.035	3.611	3.736	1.02 ± 0.01
head fib_2M.cairo (AOT)	3.610 ± 0.037	3.546	3.674	1.00

Base

Command	Mean [s]	Min [s]	Max [s]	Relative
base linear_search.cairo (JIT)	3.761 ± 0.021	3.714	3.787	1.03 ± 0.01
base linear_search.cairo (AOT)	3.654 ± 0.029	3.615	3.708	1.00

Head

Command	Mean [s]	Min [s]	Max [s]	Relative
head linear_search.cairo (JIT)	3.796 ± 0.015	3.759	3.809	1.03 ± 0.01
head linear_search.cairo (AOT)	3.680 ± 0.018	3.651	3.706	1.00

Base

Command	Mean [s]	Min [s]	Max [s]	Relative
base logistic_map.cairo (JIT)	3.879 ± 0.041	3.830	3.968	1.02 ± 0.02
base logistic_map.cairo (AOT)	3.799 ± 0.053	3.730	3.913	1.00

Head

Command	Mean [s]	Min [s]	Max [s]	Relative
head logistic_map.cairo (JIT)	3.905 ± 0.019	3.870	3.930	1.04 ± 0.01
head logistic_map.cairo (AOT)	3.754 ± 0.022	3.718	3.785	1.00

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 97.42765% with 8 lines in your changes missing coverage. Please review.

Project coverage is 81.10%. Comparing base (3ed2f4b) to head (bc11b41).

Files with missing lines	Patch %	Lines
src/libfuncs/bounded_int.rs	89.18%	4 Missing ⚠️
src/values.rs	70.00%	3 Missing ⚠️
src/libfuncs/bytes31.rs	88.88%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1125      +/-   ##
==========================================
+ Coverage   81.07%   81.10%   +0.02%     
==========================================
  Files         110      110              
  Lines       29312    29192     -120     
==========================================
- Hits        23765    23675      -90     
+ Misses       5547     5517      -30     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[github-actions]

Benchmarking results

Benchmark for program dict_insert

Open benchmarks

Command	Mean [s]	Min [s]	Max [s]	Relative
Cairo-vm (Rust, Cairo 1)	21.046 ± 0.133	20.793	21.209	5.08 ± 0.06
cairo-native (embedded AOT)	4.147 ± 0.041	4.058	4.191	1.00
cairo-native (embedded JIT using LLVM's ORC Engine)	4.346 ± 0.089	4.237	4.529	1.05 ± 0.02

Benchmark for program dict_snapshot

Open benchmarks

Command	Mean [s]	Min [s]	Max [s]	Relative
Cairo-vm (Rust, Cairo 1)	6.165 ± 0.047	6.079	6.228	1.58 ± 0.02
cairo-native (embedded AOT)	3.893 ± 0.036	3.858	3.956	1.00
cairo-native (embedded JIT using LLVM's ORC Engine)	4.026 ± 0.047	3.959	4.101	1.03 ± 0.02

Benchmark for program factorial_2M

Open benchmarks

Command	Mean [s]	Min [s]	Max [s]	Relative
Cairo-vm (Rust, Cairo 1)	14.785 ± 0.116	14.644	14.999	3.37 ± 0.04
cairo-native (embedded AOT)	4.424 ± 0.071	4.286	4.515	1.01 ± 0.02
cairo-native (embedded JIT using LLVM's ORC Engine)	4.389 ± 0.038	4.342	4.462	1.00

Benchmark for program fib_2M

Open benchmarks

Command	Mean [s]	Min [s]	Max [s]	Relative
Cairo-vm (Rust, Cairo 1)	14.379 ± 0.097	14.143	14.461	3.78 ± 0.04
cairo-native (embedded AOT)	3.801 ± 0.028	3.748	3.841	1.00
cairo-native (embedded JIT using LLVM's ORC Engine)	3.903 ± 0.039	3.856	3.976	1.03 ± 0.01

Benchmark for program linear_search

Open benchmarks

Command	Mean [s]	Min [s]	Max [s]	Relative
Cairo-vm (Rust, Cairo 1)	6.291 ± 0.087	6.182	6.512	1.58 ± 0.02
cairo-native (embedded AOT)	3.984 ± 0.028	3.934	4.013	1.00
cairo-native (embedded JIT using LLVM's ORC Engine)	4.128 ± 0.043	4.040	4.198	1.04 ± 0.01

Benchmark for program logistic_map

Open benchmarks

Command	Mean [s]	Min [s]	Max [s]	Relative
Cairo-vm (Rust, Cairo 1)	6.135 ± 0.091	6.036	6.327	1.52 ± 0.03
cairo-native (embedded AOT)	4.037 ± 0.033	3.985	4.082	1.00
cairo-native (embedded JIT using LLVM's ORC Engine)	4.248 ± 0.051	4.178	4.348	1.05 ± 0.02