-
Notifications
You must be signed in to change notification settings - Fork 236
Open
Labels
bugSomething isn't workingSomething isn't working
Description
Describe the bug
Currently, a lot of the torch.compile tests are disabled because of the following reasons:
- Different behaviours comparing cpu vs gpu
- Different behaviours comparing pip vs conda install (this could also be on our side)
- Different behaviours across torch versions
On top of this, people have reported issues with segmentation fault when resetting compilation status in some torch versions, which is something we rely on when compiling for PTQ + inference.
Additional context
We should study the problem in mode details and catalog the various failures. It must be said, the first failures we should focus on are on GPU (if any), and we don't have a way to test easily across multiple torch version at the moment.
In the meantime, new tests for inference_mode without compile have been added to avoid new bugs sneaking in from there.
CC: @nickfraser
nickfraser
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working