mirror of
https://github.com/pytorch/pytorch.git
synced 2025-11-11 22:34:53 +08:00
e2f9759bd0
Pull Request resolved: https://github.com/pytorch/pytorch/pull/152237 Approved by: https://github.com/huydhn, https://github.com/malfet
17 lines
656 B
ReStructuredText
17 lines
656 B
ReStructuredText
.. warning::
|
|
There are known non-determinism issues for RNN functions on some versions of cuDNN and CUDA.
|
|
You can enforce deterministic behavior by setting the following environment variables:
|
|
|
|
On CUDA 10.1, set environment variable ``CUDA_LAUNCH_BLOCKING=1``.
|
|
This may affect performance.
|
|
|
|
On CUDA 10.2 or later, set environment variable
|
|
(note the leading colon symbol)
|
|
``CUBLAS_WORKSPACE_CONFIG=:16:8``
|
|
or
|
|
``CUBLAS_WORKSPACE_CONFIG=:4096:2``.
|
|
|
|
See the `cuDNN 8 Release Notes`_ for more information.
|
|
|
|
.. _cuDNN 8 Release Notes: https://docs.nvidia.com/deeplearning/cudnn/archives/cudnn-880/release-notes/rel_8.html
|