Skip to content

Self-hosted runner (nightly-past-ci-caller) #161

Self-hosted runner (nightly-past-ci-caller)

Self-hosted runner (nightly-past-ci-caller) #161

Triggered via schedule May 16, 2024 02:27
Status Failure
Total duration 2h 21m 26s
Artifacts 4
Build Nightly CI Docker Images  /  Nightly PyTorch + Stable TensorFlow
17m 46s
Build Nightly CI Docker Images / Nightly PyTorch + Stable TensorFlow
Build Nightly CI Docker Images  /  Nightly PyTorch + DeepSpeed
5m 20s
Build Nightly CI Docker Images / Nightly PyTorch + DeepSpeed
Matrix: Nightly CI / Setup
Waiting for pending jobs
Matrix: Nightly CI / Model tests
Waiting for pending jobs
Matrix: Nightly CI / Model tests
Waiting for pending jobs
Matrix: Nightly CI / Torch CUDA extension tests
Waiting for pending jobs
Nightly CI  /  Send results to webhook
Nightly CI / Send results to webhook
Matrix: PyTorch 1.13 / Setup
Matrix: PyTorch 1.13 / Model tests
Waiting for pending jobs
Matrix: PyTorch 1.13 / Model tests
Waiting for pending jobs
Matrix: PyTorch 1.13 / Torch CUDA extension tests
PyTorch 1.13  /  Send results to webhook
9s
PyTorch 1.13 / Send results to webhook
Matrix: PyTorch 1.12 / Setup
Matrix: PyTorch 1.12 / Model tests
Matrix: PyTorch 1.12 / Model tests
Matrix: PyTorch 1.12 / Torch CUDA extension tests
PyTorch 1.12  /  Send results to webhook
9s
PyTorch 1.12 / Send results to webhook
Matrix: PyTorch 1.11 / Setup
Matrix: PyTorch 1.11 / Model tests
Waiting for pending jobs
Matrix: PyTorch 1.11 / Model tests
Waiting for pending jobs
Matrix: PyTorch 1.11 / Torch CUDA extension tests
PyTorch 1.11  /  Send results to webhook
28s
PyTorch 1.11 / Send results to webhook
Matrix: TensorFlow 2.11 / Setup
Waiting for pending jobs
Matrix: TensorFlow 2.11 / Model tests
Waiting for pending jobs
Matrix: TensorFlow 2.11 / Model tests
Waiting for pending jobs
Matrix: TensorFlow 2.11 / Torch CUDA extension tests
Waiting for pending jobs
TensorFlow 2.11  /  Send results to webhook
TensorFlow 2.11 / Send results to webhook
Matrix: TensorFlow 2.10 / Setup
Waiting for pending jobs
Matrix: TensorFlow 2.10 / Model tests
Waiting for pending jobs
Matrix: TensorFlow 2.10 / Model tests
Waiting for pending jobs
Matrix: TensorFlow 2.10 / Torch CUDA extension tests
Waiting for pending jobs
TensorFlow 2.10  /  Send results to webhook
TensorFlow 2.10 / Send results to webhook
Matrix: TensorFlow 2.9 / Setup
Waiting for pending jobs
Matrix: TensorFlow 2.9 / Model tests
Waiting for pending jobs
Matrix: TensorFlow 2.9 / Model tests
Waiting for pending jobs
Matrix: TensorFlow 2.9 / Torch CUDA extension tests
Waiting for pending jobs
TensorFlow 2.9  /  Send results to webhook
TensorFlow 2.9 / Send results to webhook
Matrix: TensorFlow 2.8 / Setup
Waiting for pending jobs
Matrix: TensorFlow 2.8 / Model tests
Waiting for pending jobs
Matrix: TensorFlow 2.8 / Model tests
Waiting for pending jobs
Matrix: TensorFlow 2.8 / Torch CUDA extension tests
Waiting for pending jobs
TensorFlow 2.8  /  Send results to webhook
TensorFlow 2.8 / Send results to webhook
Matrix: TensorFlow 2.7 / Setup
Waiting for pending jobs
Matrix: TensorFlow 2.7 / Model tests
Waiting for pending jobs
Matrix: TensorFlow 2.7 / Model tests
Waiting for pending jobs
Matrix: TensorFlow 2.7 / Torch CUDA extension tests
Waiting for pending jobs
TensorFlow 2.7  /  Send results to webhook
TensorFlow 2.7 / Send results to webhook
Matrix: TensorFlow 2.6 / Setup
Waiting for pending jobs
Matrix: TensorFlow 2.6 / Model tests
Waiting for pending jobs
Matrix: TensorFlow 2.6 / Model tests
Waiting for pending jobs
Matrix: TensorFlow 2.6 / Torch CUDA extension tests
Waiting for pending jobs
TensorFlow 2.6  /  Send results to webhook
TensorFlow 2.6 / Send results to webhook
Matrix: TensorFlow 2.5 / Setup
Waiting for pending jobs
Matrix: TensorFlow 2.5 / Model tests
Waiting for pending jobs
Matrix: TensorFlow 2.5 / Model tests
Waiting for pending jobs
Matrix: TensorFlow 2.5 / Torch CUDA extension tests
Waiting for pending jobs
TensorFlow 2.5  /  Send results to webhook
TensorFlow 2.5 / Send results to webhook
Fit to window
Zoom out
Zoom in

Annotations

15 errors and 9 warnings
Build Nightly CI Docker Images / Nightly PyTorch + DeepSpeed
No space left on device : '/home/runner/runners/2.316.1/_diag/pages/68d45cd9-a0a5-485d-ad28-7a37ce0f368a_7358f5a2-8608-548d-3dd6-da0b44ef1487_1.log'
PyTorch 1.13 / Torch CUDA extension tests (single-gpu)
Process completed with exit code 1.
PyTorch 1.13 / Torch CUDA extension tests (multi-gpu)
Process completed with exit code 1.
PyTorch 1.13 / Send results to webhook
Process completed with exit code 1.
PyTorch 1.12 / Setup (single-gpu)
Docker pull failed with exit code 1
PyTorch 1.12 / Setup (multi-gpu)
The job was canceled because "single-gpu" failed.
PyTorch 1.12 / Setup (multi-gpu)
The operation was canceled.
PyTorch 1.12 / Send results to webhook
Process completed with exit code 1.
PyTorch 1.11 / Torch CUDA extension tests (single-gpu)
Process completed with exit code 1.
PyTorch 1.11 / Torch CUDA extension tests (multi-gpu)
Process completed with exit code 1.
PyTorch 1.11 / Send results to webhook
Process completed with exit code 1.
Self-hosted runner (nightly-past-ci-caller)
Strategy expansion exceeded 256 results for job 'run_past_ci_pytorch_1-13.run_tests_single_gpu'
Self-hosted runner (nightly-past-ci-caller)
Strategy expansion exceeded 256 results for job 'run_past_ci_pytorch_1-11.run_tests_multi_gpu'
Self-hosted runner (nightly-past-ci-caller)
Strategy expansion exceeded 256 results for job 'run_past_ci_pytorch_1-13.run_tests_multi_gpu'
Self-hosted runner (nightly-past-ci-caller)
Strategy expansion exceeded 256 results for job 'run_past_ci_pytorch_1-11.run_tests_single_gpu'
Build Nightly CI Docker Images / Nightly PyTorch + DeepSpeed
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: docker/setup-buildx-action@v2, docker/login-action@v2, docker/build-push-action@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Build Nightly CI Docker Images / Nightly PyTorch + Stable TensorFlow
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: docker/setup-buildx-action@v2, docker/login-action@v2, docker/build-push-action@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
PyTorch 1.13 / Send results to webhook
No files were found with the provided path: test_failure_tables. No artifacts will be uploaded.
PyTorch 1.12 / Setup (single-gpu)
You are running out of disk space. The runner will stop working when the machine runs out of disk space. Free space left: 0 MB
PyTorch 1.12 / Setup (single-gpu)
Docker pull failed with exit code 1, back off 1.083 seconds before retry.
PyTorch 1.12 / Setup (single-gpu)
Docker pull failed with exit code 1, back off 9.282 seconds before retry.
PyTorch 1.12 / Setup (multi-gpu)
Docker pull failed with exit code 1, back off 4.447 seconds before retry.
PyTorch 1.12 / Send results to webhook
No files were found with the provided path: test_failure_tables. No artifacts will be uploaded.
PyTorch 1.11 / Send results to webhook
No files were found with the provided path: test_failure_tables. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size
multi-gpu_run_torch_cuda_extensions_gpu_test_reports_postfix_pytorch-1.11
485 KB
multi-gpu_run_torch_cuda_extensions_gpu_test_reports_postfix_pytorch-1.13
642 KB
single-gpu_run_torch_cuda_extensions_gpu_test_reports_postfix_pytorch-1.11
652 KB
single-gpu_run_torch_cuda_extensions_gpu_test_reports_postfix_pytorch-1.13
647 KB