Skip to content

Conversation

@kylesayrs
Copy link
Collaborator

Purpose

  • Support compression of very large models
    • Enable multiprocessing for model compression
    • Enable layer-wise model compression for disk offloading

Signed-off-by: Kyle Sayers <[email protected]>
Signed-off-by: Kyle Sayers <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants