Commit Graph

133 Commits

Author SHA1 Message Date
2e358cc98f Add platform markers for linux only extra_install_requires (#88826)
Fixes #88049

https://github.com/pytorch/pytorch/pull/85097 added new extra dependencies on `nvidia-*`. They are linux (GPU) only packages, but were not marked as such, causing issues installing pytorch 1.13 via Poetry (and possibly other tools that follow PyPI's metadata API) on non-Linux systems. This "fixes" the issue by adding the `; platform_system = 'Linux'` marker on these dependencies, but the main problem of different metadata for different wheels is a [somewhat larger issue](https://github.com/pytorch/pytorch/issues/88049#issuecomment-1302555269).

https://github.com/pytorch/pytorch/pull/85097 used `;` as a delimiter for splitting the different deps, but that is the delimiter used in markers, so I changed to split on `|`.

Pull Request resolved: https://github.com/pytorch/pytorch/pull/88826
Approved by: https://github.com/neersighted, https://github.com/lalmei, https://github.com/malfet
2022-11-18 14:09:21 +00:00
a807f1987a Stop cuda-10.2 binary builds (#85873)
Deprecate cuda 10.2 nightly

Pull Request resolved: https://github.com/pytorch/pytorch/pull/85873
Approved by: https://github.com/malfet
2022-09-29 15:04:24 +00:00
3007093007 Add new cudnn buid for linux only (#85549)
Add new cudnn buid for linux only

New pypi packaged are available only for linux:
https://pypi.org/project/nvidia-cudnn-cu11/
Pull Request resolved: https://github.com/pytorch/pytorch/pull/85549
Approved by: https://github.com/malfet
2022-09-23 20:21:36 +00:00
eb94df28c7 Use pip install cu117 (#85097)
Creates new wheel workflow specific to CUDA 11.7 that does not bundle the cudnn and cublas.

Workflow:
https://github.com/pytorch/pytorch/actions/runs/3094622781

New Package:
manywheel-py3_10-cuda11_7-with-pypi-cudnn | 843 MB

Old Package:
manywheel-py3_10-cuda11_7 | 1.65 GB

Testing workflow:

[manywheel-py3_7-cuda11_7-with-pypi-cudnn-build / build](https://github.com/pytorch/pytorch/actions/runs/3091145546/jobs/5000867662#logs):
```
Bundling without cudnn and cublas.
+ DEPS_LIST=("/usr/local/cuda/lib64/libcudart.so.11.0" "/usr/local/cuda/lib64/libnvToolsExt.so.1" "/usr/local/cuda/lib64/libnvrtc.so.11.2" "/usr/local/cuda/lib64/libnvrtc-builtins.so.11.7" "$LIBGOMP_PATH")
+ DEPS_SONAME=("libcudart.so.11.0" "libnvToolsExt.so.1" "libnvrtc.so.11.2" "libnvrtc-builtins.so.11.7" "libgomp.so.1")
.....
pytorch_extra_install_requirements: nvidia-cuda-runtime-cu11, nvidia-cudnn-cu11, nvidia-cublas-cu11
```

[manywheel-py3_7-cuda11_7-build / build](https://github.com/pytorch/pytorch/actions/runs/3091145546/jobs/5000863250#logs)

```
Bundling with cudnn and cublas.
+ DEPS_LIST=("/usr/local/cuda/lib64/libcudart.so.11.0" "/usr/local/cuda/lib64/libnvToolsExt.so.1" "/usr/local/cuda/lib64/libnvrtc.so.11.2" "/usr/local/cuda/lib64/libnvrtc-builtins.so.11.7" "/usr/local/cuda/lib64/libcudnn_adv_infer.so.8" "/usr/local/cuda/lib64/libcudnn_adv_train.so.8" "/usr/local/cuda/lib64/libcudnn_cnn_infer.so.8" "/usr/local/cuda/lib64/libcudnn_cnn_train.so.8" "/usr/local/cuda/lib64/libcudnn_ops_infer.so.8" "/usr/local/cuda/lib64/libcudnn_ops_train.so.8" "/usr/local/cuda/lib64/libcudnn.so.8" "/usr/local/cuda/lib64/libcublas.so.11" "/usr/local/cuda/lib64/libcublasLt.so.11" "$LIBGOMP_PATH")
+ DEPS_SONAME=("libcudart.so.11.0" "libnvToolsExt.so.1" "libnvrtc.so.11.2" "libnvrtc-builtins.so.11.7" "libcudnn_adv_infer.so.8" "libcudnn_adv_train.so.8" "libcudnn_cnn_infer.so.8" "libcudnn_cnn_train.so.8" "libcudnn_ops_infer.so.8" "libcudnn_ops_train.so.8" "libcudnn.so.8" "libcublas.so.11" "libcublasLt.so.11" "libgomp.so.1")
```

cc: @malfet @ptrblck
Pull Request resolved: https://github.com/pytorch/pytorch/pull/85097
Approved by: https://github.com/malfet
2022-09-21 16:30:25 +00:00
5014282792 Removing cuda 11.3 nightly builds (#84866)
Removing cuda 11.3 nightly builds

Pull Request resolved: https://github.com/pytorch/pytorch/pull/84866
Approved by: https://github.com/weiwangmeta, https://github.com/malfet
2022-09-15 15:47:36 +00:00
2dae93b212 [ROCm] update nightly builds to rocm5.2 (#82353)
### Description
Updates ROCm arches for nightly binaries to 5.1.1 and 5.2, dropping 5.0.

Corresponding builder PR:
https://github.com/pytorch/builder/pull/1033

### Testing
PR CI with extra label to enable binary builds.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/82353
Approved by: https://github.com/janeyx99, https://github.com/malfet
2022-08-11 00:33:59 +00:00
36120ce5c0 Adding 3.11 nightlies for linux PyPi (#82302)
Pull Request resolved: https://github.com/pytorch/pytorch/pull/82302
Approved by: https://github.com/malfet
2022-08-01 15:01:51 +00:00
99c464ae26 Add CUDA 11.7 workflows (#81095)
Ref https://github.com/pytorch/builder/issues/1042

CC @atalman

Pull Request resolved: https://github.com/pytorch/pytorch/pull/81095
Approved by: https://github.com/atalman
2022-07-18 09:03:03 +00:00
e549e97484 Upgrade CI to ROCm 5.1
Pull Request resolved: https://github.com/pytorch/pytorch/pull/76365
Approved by: https://github.com/seemethere, https://github.com/jeffdaily
2022-04-28 00:02:07 +00:00
31a6e6cabc Remove cuda 11.5 builds since we have 11.6
CUDA 11.5 was experimental, but now that we are moving to 11.6, we don't need to keep 11.5 around.
Please note following PR's where merged for domain libraries
[vision](https://github.com/pytorch/vision/pull/5862)
[audio](https://github.com/pytorch/audio/pull/2346)
Pull Request resolved: https://github.com/pytorch/pytorch/pull/76257
Approved by: https://github.com/seemethere, https://github.com/malfet
2022-04-23 00:24:58 +00:00
1118b157bc Revert "Remove 11.5 experimental builds now that we have 11.6"
This reverts commit 5d059d20ad2f871cba082b9919c55630d0b3c16c.

Reverted https://github.com/pytorch/pytorch/pull/75749 on behalf of https://github.com/janeyx99
2022-04-14 00:54:22 +00:00
5d059d20ad Remove 11.5 experimental builds now that we have 11.6
CUDA 11.5 was experimental, but now that we are hoping to jump to 11.6, we don't need to keep 11.5 around.

Pull Request resolved: https://github.com/pytorch/pytorch/pull/75749
Approved by: https://github.com/seemethere
2022-04-13 20:28:52 +00:00
d38d950f22 [ROCm] libtorch nightly now correctly uses rocm runners
Fixes nightly rocm libtorch builds.

Pull Request resolved: https://github.com/pytorch/pytorch/pull/74992
Approved by: https://github.com/seemethere, https://github.com/malfet
2022-04-12 16:41:34 +00:00
e7f4f5dd9b CUDA 11.6 workflows (#75518)
Summary:
Adding CUDA 11.6 workflows .
Please note we still depend on conda-forge for cuda 11.6.
Issue created to remove conda-forge dependency: [75532](https://github.com/pytorch/pytorch/issues/75532)

Pull Request resolved: https://github.com/pytorch/pytorch/pull/75518

Reviewed By: janeyx99

Differential Revision: D35516057

Pulled By: atalman

fbshipit-source-id: 44a3a0f8954d98adca2280b2e9f203267ebe98cd
(cherry picked from commit 97a4e52ecee8540453e2871714275796dc1c4abb)
2022-04-11 14:05:41 +00:00
92f01e19f3 [ROCm] libtorch nightly builds
Enables libtorch builds for ROCm, starting with ROCm version 4.5.2.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/57506
Approved by: https://github.com/malfet
2022-03-29 20:36:55 +00:00
9929a9fc8f [GHA] Migrate win/linux binary-smoke workflows from CircleCI
Partially fixes https://github.com/pytorch/pytorch/issues/72956
Pull Request resolved: https://github.com/pytorch/pytorch/pull/73788
Approved by: https://github.com/seemethere
2022-03-07 15:22:23 +00:00
ea698c148a Revert "[GHA] Migrate win/linux binary-smoke workflows from CircleCI"
This reverts commit 486bd9f3069758a0c512f18c3547c0c3267258e0.

Reverted https://github.com/pytorch/pytorch/pull/73788 on behalf of https://github.com/malfet
2022-03-06 19:07:04 +00:00
486bd9f306 [GHA] Migrate win/linux binary-smoke workflows from CircleCI
Partially fixes https://github.com/pytorch/pytorch/issues/72956
Pull Request resolved: https://github.com/pytorch/pytorch/pull/73788
Approved by: https://github.com/seemethere
2022-03-06 17:08:08 +00:00
bebfdca093 Re-enable Windows debug libtorch
Get rid of `BUILD_FOR_SYSTEM` environment variable
Pass `libtorch_config` environment variable for Windows builds

Fixes https://github.com/pytorch/pytorch/issues/73068

Pull Request resolved: https://github.com/pytorch/pytorch/pull/73805
Approved by: https://github.com/seemethere
2022-03-04 23:49:07 +00:00
201b51078a Update nightly wheels to ROCm5.0 for GHA
Depends on https://github.com/pytorch/builder/pull/941

Signed-off-by: Kyle Chen <kylechen@amd.com>

@jithunnair-amd @jeffdaily
Pull Request resolved: https://github.com/pytorch/pytorch/pull/72895
Approved by: jithunnair-amd, malfet, seemethere
2022-03-02 19:27:35 +00:00
67cb0f2a03 ci: Remove CUDA 11.1 binary builds
These builds weren't advertised on our websites and we've confirmed that
CUDA 11.3 binaries are forwards compatible with CUDA 11.1 drivers.

Signed-off-by: Eli Uriegas <eliuriegasfb.com>

Pull Request resolved: https://github.com/pytorch/pytorch/pull/73376
2022-02-24 20:34:47 +00:00
c963dedcd3 ci: Migrate macOS x86_64 binary builds to GHA (#71888)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/71888

Migrates binary builds for x86_64 for macOS from CircleCI to GHA.

Signed-off-by: Eli Uriegas <eliuriegas@fb.com>

Test Plan: Imported from OSS

Reviewed By: janeyx99

Differential Revision: D34150398

Pulled By: seemethere

fbshipit-source-id: 1b439c397d3732418c0958aa1ec6d277ab878e99
(cherry picked from commit f5b1f66f6d33e638011ccd005249fa77552f4134)
2022-02-10 21:12:24 +00:00
2a391284fc Revert D33851316: ci: Migrate macOS x86_64 binary builds to GHA
Test Plan: revert-hammer

Differential Revision:
D33851316 (c2e63b43ce)

Original commit changeset: 3c953f0e4e4b

Original Phabricator Diff: D33851316 (c2e63b43ce)

fbshipit-source-id: d95670332bbe44725b589e6d895f99b6d8821024
(cherry picked from commit 5f1861d777b913a94be7844e5eef28b53ab7010d)
2022-02-03 04:08:39 +00:00
c2e63b43ce ci: Migrate macOS x86_64 binary builds to GHA (#71888)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/71888

Migrates binary builds for x86_64 for macOS from CircleCI to GHA.

Signed-off-by: Eli Uriegas <eliuriegas@fb.com>

Test Plan: Imported from OSS

Reviewed By: malfet

Differential Revision: D33851316

Pulled By: seemethere

fbshipit-source-id: 3c953f0e4e4b434f4e0f95156d50484a5b56d0c7
(cherry picked from commit 15de76a6bec68e18fc4882f29984cc32a546754c)
2022-02-02 23:44:13 +00:00
09e54ffec3 .github: Ensure we're using correct build matrix (#72010)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/72010

We were adding additional CUDA arches to our libtorch builds when we
shouldn't have been

Signed-off-by: Eli Uriegas <eliuriegas@fb.com>

Test Plan: Imported from OSS

Reviewed By: atalman

Differential Revision: D33851196

Pulled By: seemethere

fbshipit-source-id: 52055d0cf5b528f45ef0aa33da297cd4175e8dcf
(cherry picked from commit f33b27ecab856a69c52625abf292f51dd2602229)
2022-01-28 19:35:07 +00:00
5ee629e50d .github: Enable windows binary builds (#71484)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/71484

Signed-off-by: Eli Uriegas <eliuriegas@fb.com>

Test Plan: Imported from OSS

Reviewed By: malfet, atalman

Differential Revision: D33800904

Pulled By: seemethere

fbshipit-source-id: 56d0a6e34ac8023745e36ae341efec79384d1dde
(cherry picked from commit 0339a882c99d0da56a85d492ac1aab2188816daa)
2022-01-26 22:29:33 +00:00
7ed2a43d26 Adding wheels with py3.10 (#71419)
Summary:
Adding wheels with py3.10

Pull Request resolved: https://github.com/pytorch/pytorch/pull/71419

Reviewed By: janeyx99

Differential Revision: D33657770

Pulled By: atalman

fbshipit-source-id: 5d24f1771991ff07fbfd92d04d3d5211cf53084c
(cherry picked from commit bf2f2624e12821a417a17bd374e13fda5ab69724)
2022-01-19 16:40:39 +00:00
87484d67e3 .github: Enable linux binary builds (#68388)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/68388

Updates the gpu architectures as well as adding a trigger for
on_pull_request for the binary build workflows so that we can iterate on
this later

TODO:
* Create follow up PR to enable nightly linux GHA builds / disable CircleCI nighlty linux builds

Signed-off-by: Eli Uriegas <eliuriegas@fb.com>

Test Plan: Imported from OSS

Reviewed By: janeyx99

Differential Revision: D33462294

Pulled By: seemethere

fbshipit-source-id: 5fa30517550d36f504b491cf6c1e5c9da56d8191
2022-01-10 11:30:45 -08:00
066c9ff08f Deprecating python 3.6 (#70325)
Summary:
Fixes https://github.com/pytorch/pytorch/issues/70457

Pull Request resolved: https://github.com/pytorch/pytorch/pull/70325

Reviewed By: seemethere

Differential Revision: D33339496

Pulled By: atalman

fbshipit-source-id: 7509cab4f7469dae234bcf3f79e0aabb54577b8a
2021-12-28 18:44:59 -08:00
50bd6a3640 ci: Remove CUDA 10.1 builds (#56056)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/56056

Since internal systems as well as colab have updated beyond CUDA 10.1
I'd say it's safe to remove CUDA 10.1 builds entirely

As mentioned in https://github.com/pytorch/pytorch/issues/55829#issuecomment-818236019

Signed-off-by: Eli Uriegas <eliuriegas@fb.com>

Test Plan: Imported from OSS

Reviewed By: walterddr

Differential Revision: D27772826

Pulled By: seemethere

fbshipit-source-id: 1599bba26b73b909b2575130219e2708ade5654c
2021-04-14 14:24:56 -07:00
fa07d0c8eb .github: Add workflow to build libtorch (#53292)
Summary:
Based on https://github.com/pytorch/pytorch/issues/50633 and https://github.com/pytorch/pytorch/issues/51243.

Things left to do:

- [x] modify `.github/scripts/generate_binary_build_matrix.py` further
  - [x] add option for not iterating over Python version
  - [x] add `LIBTORCH_VARIANT`
  - [x] add option for cxx11
  - [x] fix the artifact uploading
  - [x] remove `pull_request` hook before merging

Pull Request resolved: https://github.com/pytorch/pytorch/pull/53292

Test Plan: [CI](https://github.com/pytorch/pytorch/actions/runs/665781075).

Reviewed By: seemethere

Differential Revision: D27189150

Pulled By: samestep

fbshipit-source-id: ec91e1f0b75b8c93613d55801585ed975697be03
2021-03-19 12:39:36 -07:00
569d4fe3f9 .github: Add workflow to build conda packages (#51243)
Summary:
Signed-off-by: Eli Uriegas <eliuriegas@fb.com>

Pull Request resolved: https://github.com/pytorch/pytorch/pull/51243

Reviewed By: walterddr

Differential Revision: D26669795

Pulled By: seemethere

fbshipit-source-id: 1e54aa8cab2b0b5324815fa4f1706e468f9f57dd
2021-02-25 16:50:02 -08:00
1b7a4f9cde .github: Add GitHub Actions workflow to build wheels (#50633)
Summary:
Signed-off-by: Eli Uriegas <eliuriegas@fb.com>

Fixes #{issue number}

Pull Request resolved: https://github.com/pytorch/pytorch/pull/50633

Reviewed By: samestep

Differential Revision: D26083492

Pulled By: seemethere

fbshipit-source-id: c133671b9cf5074539133ee79fca5c680793a85d
2021-01-27 11:52:28 -08:00