Skip to content

Commit

Permalink
Fixed typo in group quantization command
Browse files Browse the repository at this point in the history
Typo in given command for group quantization causes error as the CLI does not recognize it. Updated argument from --group_size to --group-size fixes the issue.
  • Loading branch information
avitial authored Dec 19, 2024
1 parent 83a55df commit c98207a
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -44,7 +44,7 @@ You select one of the methods by setting the ``--group-size`` parameter to eithe
.. code-block:: console
:name: group-quant
optimum-cli export openvino -m TinyLlama/TinyLlama-1.1B-Chat-v1.0 --weight-format int4 --sym --ratio 1.0 --group_size 128 TinyLlama-1.1B-Chat-v1.0
optimum-cli export openvino -m TinyLlama/TinyLlama-1.1B-Chat-v1.0 --weight-format int4 --sym --ratio 1.0 --group-size 128 TinyLlama-1.1B-Chat-v1.0
.. tab-item:: Channel-wise quantization

Expand Down

0 comments on commit c98207a

Please sign in to comment.