You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Some users require deterministic outputs for reproducibility, but the PyTorch backend does not currently expose a way to enable deterministic algorithms.
Describe the solution you'd like
Add a model configuration parameter to enable at::Context::setDeterministicAlgorithms(...) during model execution.
Is your feature request related to a problem? Please describe.
Some users require deterministic outputs for reproducibility, but the PyTorch backend does not currently expose a way to enable deterministic algorithms.
Describe the solution you'd like
Add a model configuration parameter to enable
at::Context::setDeterministicAlgorithms(...)
during model execution.Describe alternatives you've considered
N/A
Additional context
I’ve opened a small PR to add this feature. Would appreciate a review: triton-inference-server/pytorch_backend#150
The text was updated successfully, but these errors were encountered: