Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

release: v1.12.1 #558

Open
wants to merge 6 commits into
base: main
Choose a base branch
from
Open

release: v1.12.1 #558

wants to merge 6 commits into from

Conversation

github-actions[bot]
Copy link
Contributor

@github-actions github-actions bot commented Feb 4, 2025

This pull request was created by GitHub Actions/AWS CodeBuild! Before merging, please do the following:

  • Review changelog/staleness report.
  • (Only for Minor/Major version releases) Review python package dependency and size report.
  • Review build/test results by clicking Build Logs in CI Report (be patient, tests take ~4hr).
  • Review ECR Scan results.

@sagemaker-distribution-bot sagemaker-distribution-bot deleted the release-1.12.1 branch February 4, 2025 22:31
@TRNWWZ TRNWWZ restored the release-1.12.1 branch February 5, 2025 05:50
@TRNWWZ TRNWWZ reopened this Feb 5, 2025
@TRNWWZ
Copy link
Contributor

TRNWWZ commented Feb 5, 2025 •
edited
Loading 

FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[keras.test.Dockerfile-required_packages0]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[scipy.test.Dockerfile-required_packages5]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[sagemaker-studio-analytics-extension.test.Dockerfile-required_packages21]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[gpu-dependencies.test.Dockerfile-required_packages31]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[pandas.test.Dockerfile-required_packages8]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[sm-python-sdk.test.Dockerfile-required_packages9]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[pytorch.examples.Dockerfile-required_packages10]

  • keras - Single test fails with AttributeError: 'CustomLayer' object has no attribute '_build_input_shape'. Issue with test, not installation

  • scipy:

=================================== 20 failed, 42506 passed, 2773 skipped, 12693 deselected, 135 xfailed, 11 xpassed, 36 warnings in 629.03s (0:10:29) ====================================

#30 Failed: DID NOT WARN. No warnings of type (<class 'DeprecationWarning'>, <class 'PendingDeprecationWarning'>, <class 'FutureWarning'>) were emitted. exceptions for all 20 failed test cases.

  • sagemaker-studio-analytics-extension - test passed locally, NoCredentialsError: Unable to locate credentials exception.

  • gpu-dependencies - env setup issue

  • pandas - single test faied with E matplotlib._api.deprecation.MatplotlibDeprecationWarning: The plot_date function was deprecated in Matplotlib 3.9 and will be removed in 3.11. Use plot instead. - should be warning, test is using deprecated function

  • sm-python-sdk - sm-python-sdk test failures #316

========================================== 25 failed, 8043 passed, 3778 skipped, 2 deselected, 3 xpassed, 3337 warnings in 1855.76s (0:30:55) ===========================================
  • pytorch - passed when running tests in container directly, failure was caused by dependencies conflict when installing some , but not impacting functionality.

@aws aws deleted a comment from sagemaker-distribution-bot Feb 6, 2025
@aws aws deleted a comment from sagemaker-distribution-bot Feb 6, 2025
@aws aws deleted a comment from sagemaker-distribution-bot Feb 6, 2025
@aws aws deleted a comment from sagemaker-distribution-bot Feb 6, 2025
@sagemaker-distribution-bot
Copy link
Collaborator

Staleness Report: 1.12.1(gpu)

Package Current Version in the Distribution image Latest Relevant Version in Upstream
numpy 1.26.4 1.26.4
jinja2 3.1.5 3.1.5
pytorch 2.0.0 2.0.0
altair 5.5.0 5.5.0
boto3 1.34.162 1.34.162
ipython 8.31.0 8.31.0
jupyter-lsp 2.2.5 2.2.5
jupyterlab 4.3.5 4.3.5
amazon-q-developer-jupyterlab-ext 3.4.6 3.4.6
langchain 0.2.17 0.2.17
jupyter-ai 2.28.5 2.28.5
amazon-sagemaker-jupyter-ai-q-developer 1.0.16 1.0.16
jupyter-scheduler 2.10.0 2.10.0
amazon-sagemaker-jupyter-scheduler 3.1.9 3.1.9
pandas 2.1.4 2.1.4
amazon-sagemaker-sql-magic 0.1.3 0.1.3
jupyterlab-lsp 5.0.3 5.0.3
amazon_sagemaker_sql_editor 0.1.14 0.1.14
scipy 1.11.4 1.11.4
scikit-learn 1.4.2 1.4.2
${\color{red}evaluate}$ 0.4.1 0.4.3
pip 23.3.2 23.3.2
torchvision 0.15.2 0.15.2
autogluon 0.8.3 0.8.3
ipywidgets 8.1.5 8.1.5
notebook 7.3.2 7.3.2
aws-glue-sessions 1.0.8 1.0.8
${\color{red}libmamba}$ 1.5.11 1.5.12
conda 23.11.0 23.11.0
uvicorn 0.34.0 0.34.0
fastapi 0.115.8 0.115.8
jupyter-collaboration 1.2.0 1.2.0
jupyter-dash 0.4.2 0.4.2
jupyter-server-proxy 4.4.0 4.4.0
jupyterlab-git 0.50.2 0.50.2
keras 2.14.0 2.14.0
langchain-aws 0.1.18 0.1.18
matplotlib 3.10.0 3.10.0
${\color{red}nodejs}$ 18.20.3 18.20.5
py-xgboost-gpu 1.7.6 1.7.6
pyarrow-hotfix 0.6 0.6
thrift_sasl 0.4.3 0.4.3
pyhive 0.7.0 0.7.0
python-gssapi 1.9.0 1.9.0
python-lsp-server 1.12.0 1.12.0
sagemaker-code-editor 1.1.5 1.1.5
sagemaker-headless-execution-driver 0.0.13 0.0.13
sagemaker-jupyterlab-emr-extension 0.3.7 0.3.7
sagemaker-jupyterlab-extension 0.3.3 0.3.3
sagemaker-kernel-wrapper 0.0.4 0.0.4
sagemaker-python-sdk 2.228.0 2.228.0
sagemaker-studio-analytics-extension 0.1.4 0.1.4
sasl 0.3.1 0.3.1
supervisor 4.2.5 4.2.5
tensorflow 2.14.0 2.14.0

Staleness Report: 1.12.1(cpu)

Package Current Version in the Distribution image Latest Relevant Version in Upstream
numpy 1.26.4 1.26.4
jinja2 3.1.5 3.1.5
pytorch 2.0.0 2.0.0
altair 5.5.0 5.5.0
boto3 1.34.162 1.34.162
ipython 8.31.0 8.31.0
jupyter-lsp 2.2.5 2.2.5
jupyterlab 4.3.5 4.3.5
amazon-q-developer-jupyterlab-ext 3.4.6 3.4.6
langchain 0.2.17 0.2.17
jupyter-ai 2.28.5 2.28.5
amazon-sagemaker-jupyter-ai-q-developer 1.0.16 1.0.16
jupyter-scheduler 2.10.0 2.10.0
amazon-sagemaker-jupyter-scheduler 3.1.9 3.1.9
pandas 2.1.4 2.1.4
amazon-sagemaker-sql-magic 0.1.3 0.1.3
jupyterlab-lsp 5.0.3 5.0.3
amazon_sagemaker_sql_editor 0.1.14 0.1.14
scipy 1.11.4 1.11.4
scikit-learn 1.4.2 1.4.2
${\color{red}evaluate}$ 0.4.1 0.4.3
pip 23.3.2 23.3.2
torchvision 0.15.2 0.15.2
catboost 1.2.7 1.2.7
autogluon 0.8.3 0.8.3
ipywidgets 8.1.5 8.1.5
notebook 7.3.2 7.3.2
aws-glue-sessions 1.0.8 1.0.8
${\color{red}libmamba}$ 1.5.11 1.5.12
conda 23.11.0 23.11.0
uvicorn 0.34.0 0.34.0
fastapi 0.115.8 0.115.8
jupyter-collaboration 1.2.0 1.2.0
jupyter-dash 0.4.2 0.4.2
jupyter-server-proxy 4.4.0 4.4.0
jupyterlab-git 0.50.2 0.50.2
keras 2.15.0 2.15.0
langchain-aws 0.1.18 0.1.18
matplotlib 3.10.0 3.10.0
${\color{red}nodejs}$ 18.20.3 18.20.5
py-xgboost-cpu 1.7.6 1.7.6
thrift_sasl 0.4.3 0.4.3
pyhive 0.7.0 0.7.0
python-gssapi 1.9.0 1.9.0
python-lsp-server 1.12.0 1.12.0
sagemaker-code-editor 1.1.5 1.1.5
sagemaker-headless-execution-driver 0.0.13 0.0.13
sagemaker-jupyterlab-emr-extension 0.3.7 0.3.7
sagemaker-jupyterlab-extension 0.3.3 0.3.3
sagemaker-kernel-wrapper 0.0.4 0.0.4
sagemaker-python-sdk 2.228.0 2.228.0
sagemaker-studio-analytics-extension 0.1.4 0.1.4
sasl 0.3.1 0.3.1
supervisor 4.2.5 4.2.5
tensorflow 2.15.0 2.15.0

@sagemaker-distribution-bot
Copy link
Collaborator

GPU Total Image Size Report

Target Image Size Base Image Size Size Difference Size Change (%)
1.12.1-gpu:5.94 GB 1.12.0-gpu:5.90 GB 0.04 GB Larger 0.72% Larger

CPU Total Image Size Report

Target Image Size Base Image Size Size Difference Size Change (%)
1.12.1-cpu:2.02 GB 1.12.0-cpu:2.14 GB -0.12 GB Smaller 5.63% Smaller

Python Package Size Report (GPU)

Target Image Version: 1.12.1 | Base Image Version: 1.12.0

Python Packages Total Size Summary

Target Version Total Size Base Version Total Size Size Change (abs) Size Change (%)
3.47GB 3.46GB 14.92MB 0.42

Top-20 Largest Python Packages

Package Version in the Target Image Size
cudatoolkit 11.8.0 682.45MB
tensorflow-base 2.14.0 513.71MB
cudnn 8.9.7.29 443.90MB
pytorch 2.0.0 403.50MB
mkl 2022.2.1 201.46MB
libmagma 2.7.1 201.22MB
nccl 2.25.1.1 126.62MB
libxgboost 1.7.6 99.28MB
qt6-main 6.7.2 44.84MB
catboost 1.2.7 44.41MB
libgoogle-cloud 2.12.0 43.43MB
pillow 10.4.0 40.77MB
sagemaker-code-editor 1.1.5 39.10MB
libllvm19 19.1.2 38.28MB
libllvm18 18.1.8 36.46MB
libllvm15 15.0.7 31.78MB
libarrow 12.0.1 26.43MB
python 3.10.16 24.03MB
pandoc 3.6.2 20.36MB
libclang-cpp18.1 18.1.8 18.38MB

Python Package Size Delta

The total size of newly introduced Python packages is 47.14MB, accounts for 1.33% of the total package size.

Package Version in the Target Image Version in the Base Image Size Change (abs) Size Change (%)
libllvm15 15.0.7 - 31.78MB -
sysroot_linux-64 2.17 - 14.46MB -
kernel-headers_linux-64 3.10.0 - 921.37KB -
llvmlite 0.44.0 0.43.0 563.53KB 17.07
babel 2.17.0 2.16.0 378.12KB 5.91
jupyterlab 4.3.5 4.3.4 348.54KB 4.92
numba 0.61.0 0.60.0 69.14KB 1.62
nccl 2.25.1.1 2.24.3.1 47.56KB 0.04
beautifulsoup4 4.13.3 4.12.3 26.80KB 23.25
pylint 3.3.4 3.3.3 26.30KB 7.63
nbconvert-core 7.16.6 7.16.5 11.21KB 6.07
transformers 4.48.2 4.48.1 11.16KB 0.34
referencing 0.36.2 0.36.1 9.15KB 22.16
huggingface_hub 0.28.0 0.27.1 5.86KB 2.15
fastapi 0.115.8 0.115.6 4.74KB 6.64
snowflake-connector-python 3.13.2 3.12.4 4.63KB 0.48
narwhals 1.25.0 1.23.0 3.13KB 1.83
libpng 1.6.46 1.6.45 2.78KB 0.98
pyzmq 26.2.1 26.2.0 2.57KB 0.78
liblzma-devel 5.6.4 5.6.3 1.98KB 0.54
h2 4.2.0 4.1.0 1.84KB 3.63
jupyter_events 0.12.0 0.11.0 1.45KB 6.71
hpack 4.1.0 4.0.0 1.29KB 4.48
marshmallow 3.26.1 3.25.1 1.18KB 1.31
ca-certificates 2025.1.31 2024.12.14 1.03KB 0.67
isort 6.0.0 5.13.2 970.00B 1.32
amazon-sagemaker-jupyter-scheduler 3.1.9 3.1.8 876.00B 0.51
sleef 3.8 3.7 865.00B 0.05
amazon-sagemaker-jupyter-ai-q-developer 1.0.16 1.0.14 851.00B 1.02
imageio 2.37.0 2.36.1 760.00B 0.26
amazon-q-developer-jupyterlab-ext 3.4.6 3.4.5 602.00B 0.25
google-auth 2.38.0 2.37.0 555.00B 0.48
sagemaker-jupyterlab-extension-common 0.1.33 0.1.32 485.00B 0.21
paramiko 3.5.1 3.5.0 369.00B 0.23
sagemaker-studio-analytics-extension 0.1.4 0.1.3 361.00B 0.84
liblzma 5.6.4 5.6.3 225.00B 0.2
lightning-utilities 0.12.0 0.11.9 208.00B 0.73
hyperframe 6.1.0 6.0.1 158.00B 0.92
mistune 3.1.1 3.1.0 132.00B 0.19
python-flatbuffers 25.1.24 25.1.21 51.00B 0.15
libedit 3.1.20250104 3.1.20240808 19.00B 0.01
xz 5.6.4 5.6.3 0.00B -
xz-gpl-tools 5.6.4 5.6.3 -69.00B -0.21
sagemaker-jupyterlab-emr-extension 0.3.7 0.3.5 -423.00B -0.14
xz-tools 5.6.4 5.6.3 -619.00B -0.69
starlette 0.45.3 0.41.3 -904.00B -1.54
xorg-libx11 1.8.11 1.8.10 -2.31KB -0.28
nbconvert-pandoc 7.16.6 7.16.5 -2.38KB -29.9
nbconvert 7.16.6 7.16.5 -2.82KB -35.5
fonttools 4.55.8 4.55.4 -64.57KB -2.77
plotly 6.0.0 5.24.1 -2.85MB -37.25

Python Package Size Report (CPU)

Target Image Version: 1.12.1 | Base Image Version: 1.12.0

Python Packages Total Size Summary

Target Version Total Size Base Version Total Size Size Change (abs) Size Change (%)
1.19GB 1.26GB -67.02MB -5.2

Top-20 Largest Python Packages

Package Version in the Target Image Size
mkl 2022.2.1 201.46MB
tensorflow-base 2.15.0 136.50MB
pytorch 2.0.0 66.99MB
qt6-main 6.7.2 44.84MB
libgoogle-cloud 2.12.0 41.48MB
pillow 10.4.0 40.77MB
sagemaker-code-editor 1.1.5 39.10MB
libllvm19 19.1.2 38.28MB
libllvm18 18.1.8 36.46MB
libllvm15 15.0.7 31.78MB
python 3.10.16 24.03MB
libarrow 15.0.0 21.99MB
pandoc 3.6.2 20.36MB
libclang-cpp18.1 18.1.8 18.38MB
amazon_sagemaker_sql_editor 0.1.14 17.18MB
nodejs 18.20.3 14.82MB
scipy 1.11.4 14.55MB
pandas 2.1.4 11.84MB
scikit-image 0.19.3 11.60MB
icu 73.2 11.53MB

Python Package Size Delta

The total size of newly introduced Python packages is 0.00B, accounts for 0.0% of the total package size.

Package Version in the Target Image Version in the Base Image Size Change (abs) Size Change (%)
llvmlite 0.44.0 0.43.0 563.53KB 17.07
babel 2.17.0 2.16.0 378.12KB 5.91
jupyterlab 4.3.5 4.3.4 348.54KB 4.92
numba 0.61.0 0.60.0 69.14KB 1.62
beautifulsoup4 4.13.3 4.12.3 26.80KB 23.25
pylint 3.3.4 3.3.3 26.30KB 7.63
nbconvert-core 7.16.6 7.16.5 11.21KB 6.07
transformers 4.48.2 4.48.1 11.16KB 0.34
referencing 0.36.2 0.36.1 9.15KB 22.16
huggingface_hub 0.28.0 0.27.1 5.86KB 2.15
fastapi 0.115.8 0.115.6 4.74KB 6.64
snowflake-connector-python 3.13.2 3.12.4 4.63KB 0.48
narwhals 1.25.0 1.23.0 3.13KB 1.83
libpng 1.6.46 1.6.45 2.78KB 0.98
pyzmq 26.2.1 26.2.0 2.57KB 0.78
liblzma-devel 5.6.4 5.6.3 1.98KB 0.54
h2 4.2.0 4.1.0 1.84KB 3.63
jupyter_events 0.12.0 0.11.0 1.45KB 6.71
hpack 4.1.0 4.0.0 1.29KB 4.48
marshmallow 3.26.1 3.25.1 1.18KB 1.31
ca-certificates 2025.1.31 2024.12.14 1.03KB 0.67
isort 6.0.0 5.13.2 970.00B 1.32
amazon-sagemaker-jupyter-scheduler 3.1.9 3.1.8 876.00B 0.51
sleef 3.8 3.7 865.00B 0.05
amazon-sagemaker-jupyter-ai-q-developer 1.0.16 1.0.14 851.00B 1.02
imageio 2.37.0 2.36.1 760.00B 0.26
amazon-q-developer-jupyterlab-ext 3.4.6 3.4.5 602.00B 0.25
google-auth 2.38.0 2.37.0 555.00B 0.48
sagemaker-jupyterlab-extension-common 0.1.33 0.1.32 485.00B 0.21
paramiko 3.5.1 3.5.0 369.00B 0.23
sagemaker-studio-analytics-extension 0.1.4 0.1.3 361.00B 0.84
liblzma 5.6.4 5.6.3 225.00B 0.2
lightning-utilities 0.12.0 0.11.9 208.00B 0.73
hyperframe 6.1.0 6.0.1 158.00B 0.92
mistune 3.1.1 3.1.0 132.00B 0.19
python-flatbuffers 25.1.24 25.1.21 51.00B 0.15
libedit 3.1.20250104 3.1.20240808 19.00B 0.01
xz 5.6.4 5.6.3 0.00B -
xz-gpl-tools 5.6.4 5.6.3 -69.00B -0.21
sagemaker-jupyterlab-emr-extension 0.3.7 0.3.5 -423.00B -0.14
xz-tools 5.6.4 5.6.3 -619.00B -0.69
starlette 0.45.3 0.41.3 -904.00B -1.54
xorg-libx11 1.8.11 1.8.10 -2.31KB -0.28
nbconvert-pandoc 7.16.6 7.16.5 -2.38KB -29.9
nbconvert 7.16.6 7.16.5 -2.82KB -35.5
fonttools 4.55.8 4.55.4 -64.57KB -2.77
plotly 6.0.0 5.24.1 -2.85MB -37.25

@sagemaker-distribution-bot
Copy link
Collaborator

Python Package Dependency Report

Target Image Version: 1.12.1 | Base Image Version: 1.12.0

Image Type: (GPU)

Package Version in the Target Image Dependencies

Image Type: (CPU)

Package Version in the Target Image Dependencies

Image Type: (GPU)

Package Version in the Target Image Dependencies

Image Type: (CPU)

Package Version in the Target Image Dependencies

Image Type: (GPU)

Package Version in the Target Image Dependencies

Image Type: (CPU)

Package Version in the Target Image Dependencies

Image Type: (GPU)

Package Version in the Target Image Dependencies

Image Type: (CPU)

Package Version in the Target Image Dependencies

@sagemaker-distribution-bot sagemaker-distribution-bot deleted the release-1.12.1 branch February 6, 2025 07:25
@sagemaker-distribution-bot
Copy link
Collaborator

AWS CodeBuild CI Report

  • CodeBuild project: CosmosImageBuildersagemaker-U5omrjiHQCoa
  • Commit ID: f769c0a
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@TRNWWZ TRNWWZ restored the release-1.12.1 branch February 6, 2025 07:26
@TRNWWZ TRNWWZ reopened this Feb 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@TRNWWZ @sagemaker-distribution-bot