Commit 2902e1b
authored
Grid-search Temperature (google#533)
[08-07](https://llm-exp.oss-fuzz.com/Result-reports/scheduled/2024-08-07-weekly-all/)
experiment, with temperature 0-0.4, did not perform well either.
Given we have a weekly experiment scheduled tmr and only very few
temperature values were untested, I'd propose doing a "grid search" on
the rest.
Current ranking is:
1.
[07-06](https://llm-exp.oss-fuzz.com/Result-reports/scheduled/2024-07-06-weekly-all/)
with constant temperature 0.4: 1042 successful builds.
2.
[08-03](https://llm-exp.oss-fuzz.com/Result-reports/scheduled/2024-08-03-weekly-all/)
with constant temperature 1: 960 builds.
3.
[08-07](https://llm-exp.oss-fuzz.com/Result-reports/scheduled/2024-08-07-weekly-all/)
with vary temperature 0-0.4: 898 builds.
The new experiment will test 0.5-0.9 so that we have some data for each.1 parent 3d29ac2 commit 2902e1b
1 file changed
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
118 | 118 | | |
119 | 119 | | |
120 | 120 | | |
121 | | - | |
| 121 | + | |
122 | 122 | | |
123 | 123 | | |
124 | 124 | | |
| |||
0 commit comments