Search results

Add npu support for LLM.int8 forward

Ascend NPURelated to Ascend NPU backendRelated to Ascend NPU backend

Status: Open (in progress).

bitsandbytes-foundation/bitsandbytesnumber 1534

#1534 In bitsandbytes-foundation/bitsandbytes;

· SlightwindSec opened on Feb 20, 2025

Ascend NPU installation

Ascend NPURelated to Ascend NPU backendRelated to Ascend NPU backend

DocumentationImprovements or additions to documentationImprovements or additions to documentation

Low RiskRisk of bugs in transformers and other librariesRisk of bugs in transformers and other libraries

Status: Open.

Bug

#1523 In bitsandbytes-foundation/bitsandbytes;

· LoSunny opened on Feb 18, 2025

[Ascend][Bug] Fail to use 4-bit quant model to inference

Ascend NPURelated to Ascend NPU backendRelated to Ascend NPU backend

Status: Open.

Bug

#1465 In bitsandbytes-foundation/bitsandbytes;

· MengqingCao opened on Dec 28, 2024