-
Notifications
You must be signed in to change notification settings - Fork 116
Description
Is your feature request related to a problem? Please describe.
The long-text methods in UQLM require decomposing a response into claims. This is done by instructing an LLM to decompose the response with a carefully constructed decomposition prompt. Currently, we offer claim decomposition with the decomposition prompt from Zhang et al., 2025, but we would like to offer other templates as well:
Describe the solution you'd like
The option to specify which claim decomposition prompt should be specified via a claim_decomposition_prompt argument in LongTextUQ, LongTextGraph, and LongTextQA constructors of the uqlm.scorers.longform directory. The prompts themselves should live in uqlm.utils.prompts.
Describe alternatives you've considered
Status quo (only one prompt)
Additional context
We may decide to only implement a subset of the listed methods. We should explore and test before finalizing the decision on what to include.