critic model on multiple goals

[efessas]

Hi,

I am trying to reproduce the proof search using the critic model. May I check If the current state has multiple goals, then how do we use the critic model evaluate it?

1. just join all the goals together as a single state (prompt) and send it into the critic model to get a single score.
2. for each goal get a score from the critic model individually and add them together.
3. just evaluate the current goal we are trying to solve.

Many thanks for your help in advance!

efessas

[wzj423]

We joined all the goals together as a single state.

[efessas]

got it, many thanks!