Jia Li 20b62fed21 Create processes in parallel in mp.start_processes for forkserver (#134629) ...

Summary:
This is to fix the pytorch issue filed https://github.com/pytorch/pytorch/issues/133010
one way to fix this problem is to enable parallel start processes in mp.start_processes.
What else in the diff:
refactored a test case api_test which was repeating a lot of tests due to the inheritance.
added unit test for forkserver when parallel start is on.

Test Plan: Added unit tests

Differential Revision: D61878552

Pull Request resolved: https://github.com/pytorch/pytorch/pull/134629
Approved by: https://github.com/d4l3k

2024-08-28 21:34:32 +00:00

..

__init__.py

Create processes in parallel in mp.start_processes for forkserver (#134629)

2024-08-28 21:34:32 +00:00

_atfork.py

[BE][Easy][17/19] enforce style for empty lines in import segments in torch/[a-c]*/ and torch/[e-n]*/ (#129769)

2024-08-04 10:24:09 +00:00

cuda_multiprocessing.md

…

pool.py

Fix docstring errors in reductions.py, spawn.py, pool.py, parameter.py, cpp.py, grad.py, __init__.py, profiler.py, queue.py, graph.py (#113052)

2023-11-10 21:19:17 +00:00

queue.py

Flip default value for mypy disallow_untyped_defs [7/11] (#127844)

2024-06-08 18:49:45 +00:00

reductions.py

Add None return type to init (#132335)

2024-08-01 15:26:45 +00:00

spawn.py

Create processes in parallel in mp.start_processes for forkserver (#134629)

2024-08-28 21:34:32 +00:00