Skip to content

Commit 4bdc74c

Browse files
dross20stevhliu
authored andcommitted
Include cache_implementation argument in quantization example
1 parent 21c2634 commit 4bdc74c

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

docs/source/en/model_doc/pegasus.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -116,7 +116,7 @@ This process involves converting sunlight, carbon dioxide, and water into glucos
116116
Plants play a crucial role in sustaining life on Earth by generating oxygen and serving as the foundation of most ecosystems."""
117117
input_ids = tokenizer(input_text, return_tensors="pt").to("cuda")
118118

119-
output = model.generate(**input_ids)
119+
output = model.generate(**input_ids, cache_implementation="static")
120120
print(tokenizer.decode(output[0], skip_special_tokens=True))
121121
```
122122

0 commit comments

Comments
 (0)