Open
Description
Our Nightly and Release pipeline spread over 3 repositories: pytorch/pytorch, pytorch/builder and pytorch/test-infra .This creates maintenance overhead and following issues:
- Builder Repo Changes are not getting tested by PyTorch CI on PR. To test these changes developer need to open special PR against Pytorch/Pytorch poining to his builder fork. This makes it extremely difficult to test changes to builder repo
- Changes to Docker builds can't be tested.
- During Pytorch Release process we perform branch cut and cherry-picking to builder repo, not only pytorch/pytorch
Hence to solve these issues we are working on Moving all Build and Test Scripts for pytorch binary to pytorch/pytorch
All Validation and analytics scripts to pytorch/test-infra repository.
Following Work Has been Completed:
- Migrate Docker builds Migrate conda, manywheel and libtorch docker builds to pytorch/pytorch pytorch#129022
- Move Magma builds f Replace magma-cuda dependency on
pytorch/conda-builder
Docker image pytorch#138909 Build magma for windows pytorch#139924 Replace magma-cuda dependency onpytorch/conda-builder
Docker image pytorch#138909 - Move manywheel binary scripts to pytorch pytorch#138103
- Move Windows build scripts Migrate windows build scripts from builder to pytorch pytorch#142156
- Removal of Anaconda build scripts Delete conda build scripts - 2 #2045 Remove windows conda build script #2047 Delete conda build scripts #2041
- Migration of smoke test scripts to pytorch/pytorch Migrate smoke tests to pytorch/pytorch pytorch#142482
- Migration of most of validation framework to pytorh/test-infra https://github.com/pytorch/test-infra/pull/6029/files
- Add check_binary workflow to pytorch/pytorch pytorch#143201
- Remove dependency on builder since these workflows are moved to test-infra pytorch.github.io#1858
- Deprecate builder scripts Remove validation framework scripts and check_binary.sh #2055
- Remove builder repo from workflows and scripts pytorch#143776
- Revise RELEASE.md pytorch file
- Revise CUDA_UDPATE guide
- Migration of analytics and release scripts to pytorch/test-infra
Please note: If you intend to add or modify PyTorch build or test scripts please do it directly in pytorch/pytorch repository
Metadata
Metadata
Assignees
Labels
No labels