Skip to content

Commit 2902e1b

Browse files
authored
Grid-search Temperature (google#533)
[08-07](https://llm-exp.oss-fuzz.com/Result-reports/scheduled/2024-08-07-weekly-all/) experiment, with temperature 0-0.4, did not perform well either. Given we have a weekly experiment scheduled tmr and only very few temperature values were untested, I'd propose doing a "grid search" on the rest. Current ranking is: 1. [07-06](https://llm-exp.oss-fuzz.com/Result-reports/scheduled/2024-07-06-weekly-all/) with constant temperature 0.4: 1042 successful builds. 2. [08-03](https://llm-exp.oss-fuzz.com/Result-reports/scheduled/2024-08-03-weekly-all/) with constant temperature 1: 960 builds. 3. [08-07](https://llm-exp.oss-fuzz.com/Result-reports/scheduled/2024-08-07-weekly-all/) with vary temperature 0-0.4: 898 builds. The new experiment will test 0.5-0.9 so that we have some data for each.
1 parent 3d29ac2 commit 2902e1b

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

report/docker_run.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -118,7 +118,7 @@ fi
118118

119119
if [[ "$VARY_TEMPERATURE" = "true" ]]
120120
then
121-
VARY_TEMPERATURE=(0.0 0.1 0.2 0.3 0.4)
121+
VARY_TEMPERATURE=(0.5 0.6 0.7 0.8 0.9)
122122
else
123123
VARY_TEMPERATURE=()
124124
fi

0 commit comments

Comments
 (0)