Skip to content

Commit 3a99da4

Browse files
authored
quick fix for dsv3 perchannel/pertensor (online quantization) (#774)
Co-authored-by: shihaobai <[email protected]>
1 parent ffc9af4 commit 3a99da4

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

lightllm/common/quantization/quantize_method.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -7,6 +7,8 @@ class QuantizationMethod(ABC):
77
def __init__(self):
88
super().__init__()
99
self.device_id_ = get_current_device_id()
10+
self.weight_scale_suffix = None
11+
self.act_scale_suffix = None
1012

1113
@abstractmethod
1214
def quantize(self, weights: torch.Tensor):

0 commit comments

Comments
 (0)