Search results

3-bit dequantize to be tested

Status: Open.

#37 In casper-hansen/AutoAWQ_kernels;

· vince62s opened on Jan 31, 2025

awq_ext is not defined

Status: Open.

#34 In casper-hansen/AutoAWQ_kernels;

· Yarflam opened on Oct 13, 2024

conversion error big time

Status: Open.

#33 In casper-hansen/AutoAWQ_kernels;

· BBC-Esq opened on Sep 11, 2024

Is there Any way to infer awq marlin model

Status: Open.

#26 In casper-hansen/AutoAWQ_kernels;

· DeJoker opened on Jul 23, 2024

Why not set stream in <code>gemmv2_forward_cuda</code> and <code>dequantize_weights_cuda</code>

Status: Open.

#23 In casper-hansen/AutoAWQ_kernels;

· grimoire opened on Jul 3, 2024

AssertionError: AWQ kernels could not be loaded.

Status: Open.

#21 In casper-hansen/AutoAWQ_kernels;

· xieziyi881 opened on Jun 21, 2024

when can v100 be supported

Status: Open.

#18 In casper-hansen/AutoAWQ_kernels;

· 1SingleFeng opened on May 28, 2024

cuda 12.2 AssertionError: AWQ kernels could not be loaded.

Status: Open.

#16 In casper-hansen/AutoAWQ_kernels;

· s-natsubori opened on Apr 2, 2024

Question about QUICK kernel integration

Status: Open.

#15 In casper-hansen/AutoAWQ_kernels;

· crisb-7 opened on Feb 28, 2024

DLL load failed on Windows via pip

Status: Open.

#14 In casper-hansen/AutoAWQ_kernels;

· GuillaumeBruand opened on Feb 27, 2024