Skip to content

Write a guide for quantizing models using frameworks outside of Compressed-Tensors quantization #646

Description

@kylesayrs

Background

  • Some users want to quantize models and encode using the compressed-tensors format, but do not necessarily want to use compressed-tensors primitives

Proposed Changes

  • Add documentation for encoding a model using compressed tensors format using, for example, QAT

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentationgood first issueGood for newcomers

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions