Skip to content

Enable alternative claim decomposition templates #335

@dylanbouchard

Description

@dylanbouchard

Is your feature request related to a problem? Please describe.
The long-text methods in UQLM require decomposing a response into claims. This is done by instructing an LLM to decompose the response with a carefully constructed decomposition prompt. Currently, we offer claim decomposition with the decomposition prompt from Zhang et al., 2025, but we would like to offer other templates as well:

Describe the solution you'd like
The option to specify which claim decomposition prompt should be specified via a claim_decomposition_prompt argument in LongTextUQ, LongTextGraph, and LongTextQA constructors of the uqlm.scorers.longform directory. The prompts themselves should live in uqlm.utils.prompts.

Describe alternatives you've considered
Status quo (only one prompt)

Additional context
We may decide to only implement a subset of the listed methods. We should explore and test before finalizing the decision on what to include.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions