Files
pytorch/torch
Chien-Chin Huang 8461b63f2c [CP] Replace context_parallel context manager with functional APIs (#164500)
`context_parallel()` being a context manager has annoyed users. Now that we plan to redesign CP's UX to explicitly ask users to:

1. Wrap the attention op into an `nn.Module`
2. Lift any buffers that are not sequence agnostic to input

We can replace `context_parallel()` with two functional APIs: `_context_parallel_shard` and `_enable_context_parallel_dispatcher`.

Pull Request resolved: https://github.com/pytorch/pytorch/pull/164500
Approved by: https://github.com/XilunWu
ghstack dependencies: #162542
2025-10-13 06:30:18 +00:00
..
2025-10-13 01:48:55 +00:00
2025-10-13 01:48:55 +00:00
2025-10-13 01:48:55 +00:00
2025-10-13 01:48:55 +00:00
2025-10-13 01:48:55 +00:00
2025-10-13 01:48:55 +00:00
2025-10-13 01:48:55 +00:00
2025-10-13 01:48:55 +00:00
2025-10-12 20:06:41 +00:00
2025-10-13 01:48:55 +00:00
2025-10-10 17:23:31 +00:00
2025-10-08 02:30:57 +00:00
2025-10-12 20:06:41 +00:00
2025-10-13 01:48:55 +00:00
2025-10-08 02:30:57 +00:00
2025-10-13 01:48:55 +00:00