Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEA] Add option to extract last token embedding #490

Open
VibhuJawa opened this issue Jan 19, 2025 · 0 comments · May be fixed by #491
Open

[FEA] Add option to extract last token embedding #490

VibhuJawa opened this issue Jan 19, 2025 · 0 comments · May be fixed by #491
Assignees
@VibhuJawa
Labels
enhancement New feature or request

Comments

@VibhuJawa
Copy link
Collaborator

Is your feature request related to a problem? Please describe.

@avem-nv and team found that extracting last token embedding can be better for sem dedup than mean pooling. We should support that out of the box.
@VibhuJawa VibhuJawa added the enhancement New feature or request label Jan 19, 2025
@VibhuJawa VibhuJawa self-assigned this Jan 19, 2025
@VibhuJawa VibhuJawa linked a pull request Jan 20, 2025 that will close this issue
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@VibhuJawa VibhuJawa

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add Pooling Strategy Option for embedding creation VibhuJawa/NeMo-Curator
1 participant
@VibhuJawa