Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

release: v2.3.0 #542

Merged
merged 25 commits into from
Jan 28, 2025
Merged

release: v2.3.0 #542

merged 25 commits into from
Jan 28, 2025

Conversation

github-actions[bot]
Copy link
Contributor

@github-actions github-actions bot commented Jan 6, 2025

This pull request was created by GitHub Actions/AWS CodeBuild! Before merging, please do the following:

  • Review changelog/staleness report.
  • (Only for Minor/Major version releases) Review python package dependency and size report.
  • Review build/test results by clicking Build Logs in CI Report (be patient, tests take ~4hr).
  • Review ECR Scan results.

@sagemaker-distribution-bot

This comment was marked as outdated.

@sagemaker-distribution-bot

This comment was marked as outdated.

@sagemaker-distribution-bot

This comment was marked as outdated.

@sagemaker-distribution-bot

This comment was marked as outdated.

@sagemaker-distribution-bot

This comment was marked as outdated.

@sagemaker-distribution-bot

This comment was marked as outdated.

@aws-tianquaw

This comment was marked as outdated.

@sagemaker-distribution-bot

This comment was marked as outdated.

@sagemaker-distribution-bot

This comment was marked as outdated.

@sagemaker-distribution-bot

This comment was marked as outdated.

@sagemaker-distribution-bot

This comment was marked as outdated.

@claytonparnell
Copy link
Contributor


=========================== short test summary info ============================
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[pandas.test.Dockerfile-required_packages8]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[sm-python-sdk.test.Dockerfile-required_packages9]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[sagemaker-studio-analytics-extension.test.Dockerfile-required_packages21]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[gpu-dependencies.test.Dockerfile-required_packages31]

@sagemaker-distribution-bot

This comment was marked as outdated.

@sagemaker-distribution-bot

This comment was marked as outdated.

@sagemaker-distribution-bot

This comment was marked as outdated.

@sagemaker-distribution-bot

This comment was marked as outdated.

@sagemaker-distribution-bot

This comment was marked as outdated.

@sagemaker-distribution-bot

This comment was marked as outdated.

@sagemaker-distribution-bot

This comment was marked as outdated.

@claytonparnell
Copy link
Contributor

FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[s3fs.test.Dockerfile-required_packages33] - assert 1 == 0
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[pandas.test.Dockerfile-required_packages8] - assert 1 == 0
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[scipy.test.Dockerfile-required_packages5] - assert 1 == 0
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[sm-python-sdk.test.Dockerfile-required_packages9] - assert 1 == 0
  • s3fs
    =========================== short test summary info ============================
    FAILED s3fs/tests/test_s3fs.py::test_info - assert {'ETag': '"d4...size': 0, ...
    = 1 failed, 314 passed, 2 skipped, 3 xfailed, 14 warnings in 138.44s (0:02:18) 
    
    Able to reproduce this in a clean environment, so don't think it's specific to the install/image itself.. seems like some upgrade in boto/moto causing the issue, will open Issue on https://github.com/fsspec/s3fs .
  • pandas - failures due to E PendingDeprecationWarning: vert: bool will be deprecated in a future version. Use orientation: {'vertical', 'horizontal'} instead.. Should be warning.
  • scipy - Fix Scipy tests for GPU based docker images #30
  • sm-python-sdk - sm-python-sdk test failures #316

@claytonparnell
Copy link
Contributor

Staleness Report: 2.3.0(gpu)

Package Current Version in the Distribution image Latest Relevant Version in Upstream
numpy 1.26.4 1.26.4
jinja2 3.1.5 3.1.5
${\color{red}pytorch}$ 2.4.1 2.5.1
pandas 2.2.3 2.2.3
altair 5.5.0 5.5.0
${\color{red}boto3}$ 1.36.3 1.36.7
ipython 8.31.0 8.31.0
jupyter-lsp 2.2.5 2.2.5
${\color{red}jupyterlab}$ 4.2.6 4.3.4
amazon-q-developer-jupyterlab-ext 3.4.5 3.4.5
langchain 0.3.15 0.3.15
jupyter-ai 2.29.0 2.29.0
amazon-sagemaker-jupyter-ai-q-developer 1.0.16 1.0.16
jupyter-scheduler 2.10.0 2.10.0
amazon-sagemaker-jupyter-scheduler 3.1.8 3.1.8
amazon-sagemaker-sql-magic 0.1.3 0.1.3
${\color{red}jupyterlab-lsp}$ 5.0.3 5.1.0
amazon_sagemaker_sql_editor 0.1.14 0.1.14
scipy 1.15.1 1.15.1
matplotlib-base 3.10.0 3.10.0
${\color{red}scikit-learn}$ 1.5.2 1.6.1
${\color{red}evaluate}$ 0.4.1 0.4.3
${\color{red}sentencepiece}$ 0.1.99 0.2.0
pip 24.3.1 24.3.1
${\color{red}torchvision}$ 0.19.1 0.20.1
autogluon 1.2.0 1.2.0
ipywidgets 8.1.5 8.1.5
${\color{red}notebook}$ 7.2.2 7.3.2
aws-glue-sessions 1.0.8 1.0.8
libmamba 1.5.12 1.5.12
conda 24.11.3 24.11.3
${\color{red}dash}$ 2.18.1 2.18.2
docker-cli 27.5.1 27.5.1
uvicorn 0.34.0 0.34.0
fastapi 0.115.7 0.115.7
git-remote-codecommit 1.16 1.16
jupyter-activity-monitor-extension 0.3.1 0.3.1
jupyter-collaboration 2.1.5 2.1.5
jupyter-dash 0.4.2 0.4.2
jupyter-server-proxy 4.4.0 4.4.0
jupyterlab-git 0.50.2 0.50.2
keras 3.8.0 3.8.0
${\color{red}langchain-aws}$ 0.2.10 0.2.11
mlflow 2.20.0 2.20.0
py-xgboost-gpu 2.1.3 2.1.3
pyhive 0.7.0 0.7.0
python-gssapi 1.9.0 1.9.0
python-lsp-server 1.12.0 1.12.0
${\color{red}s3fs}$ 2024.10.0 2024.12.0
sagemaker-code-editor 1.4.2 1.4.2
sagemaker-headless-execution-driver 0.0.13 0.0.13
sagemaker-jupyterlab-emr-extension 0.3.7 0.3.7
sagemaker-jupyterlab-extension 0.3.3 0.3.3
sagemaker-kernel-wrapper 0.0.4 0.0.4
sagemaker-mlflow 0.1.0 0.1.0
${\color{red}sagemaker-python-sdk}$ 2.228.0 2.237.3
sagemaker-studio-analytics-extension 0.1.4 0.1.4
seaborn 0.13.2 0.13.2
supervisor 4.2.5 4.2.5
tensorflow 2.17.0 2.17.0
tf-keras 2.17.0 2.17.0

Staleness Report: 2.3.0(cpu)

Package Current Version in the Distribution image Latest Relevant Version in Upstream
numpy 1.26.4 1.26.4
jinja2 3.1.5 3.1.5
${\color{red}pytorch}$ 2.4.1 2.5.1
pandas 2.2.3 2.2.3
altair 5.5.0 5.5.0
${\color{red}boto3}$ 1.36.3 1.36.7
ipython 8.31.0 8.31.0
jupyter-lsp 2.2.5 2.2.5
${\color{red}jupyterlab}$ 4.2.6 4.3.4
amazon-q-developer-jupyterlab-ext 3.4.5 3.4.5
langchain 0.3.15 0.3.15
jupyter-ai 2.29.0 2.29.0
amazon-sagemaker-jupyter-ai-q-developer 1.0.16 1.0.16
jupyter-scheduler 2.10.0 2.10.0
amazon-sagemaker-jupyter-scheduler 3.1.8 3.1.8
amazon-sagemaker-sql-magic 0.1.3 0.1.3
${\color{red}jupyterlab-lsp}$ 5.0.3 5.1.0
amazon_sagemaker_sql_editor 0.1.14 0.1.14
scipy 1.15.1 1.15.1
matplotlib-base 3.10.0 3.10.0
${\color{red}scikit-learn}$ 1.5.2 1.6.1
${\color{red}evaluate}$ 0.4.1 0.4.3
${\color{red}sentencepiece}$ 0.1.99 0.2.0
pip 24.3.1 24.3.1
${\color{red}torchvision}$ 0.19.1 0.20.1
autogluon 1.2.0 1.2.0
ipywidgets 8.1.5 8.1.5
${\color{red}notebook}$ 7.2.2 7.3.2
aws-glue-sessions 1.0.8 1.0.8
libmamba 1.5.12 1.5.12
conda 24.11.3 24.11.3
${\color{red}dash}$ 2.18.1 2.18.2
docker-cli 27.5.1 27.5.1
uvicorn 0.34.0 0.34.0
fastapi 0.115.7 0.115.7
git-remote-codecommit 1.16 1.16
jupyter-activity-monitor-extension 0.3.1 0.3.1
jupyter-collaboration 2.1.5 2.1.5
jupyter-dash 0.4.2 0.4.2
jupyter-server-proxy 4.4.0 4.4.0
jupyterlab-git 0.50.2 0.50.2
keras 3.8.0 3.8.0
${\color{red}langchain-aws}$ 0.2.10 0.2.11
mlflow 2.20.0 2.20.0
py-xgboost-cpu 2.1.3 2.1.3
pyhive 0.7.0 0.7.0
python-gssapi 1.9.0 1.9.0
python-lsp-server 1.12.0 1.12.0
${\color{red}s3fs}$ 2024.10.0 2024.12.0
sagemaker-code-editor 1.4.2 1.4.2
sagemaker-headless-execution-driver 0.0.13 0.0.13
sagemaker-jupyterlab-emr-extension 0.3.7 0.3.7
sagemaker-jupyterlab-extension 0.3.3 0.3.3
sagemaker-kernel-wrapper 0.0.4 0.0.4
sagemaker-mlflow 0.1.0 0.1.0
${\color{red}sagemaker-python-sdk}$ 2.228.0 2.237.3
sagemaker-studio-analytics-extension 0.1.4 0.1.4
seaborn 0.13.2 0.13.2
supervisor 4.2.5 4.2.5
tensorflow 2.17.0 2.17.0
tf-keras 2.17.0 2.17.0

@claytonparnell
Copy link
Contributor

GPU Total Image Size Report

Target Image Size Base Image Size Size Difference Size Change (%)
2.3.0-gpu:6.26 GB 2.2.1-gpu:6.26 GB -0.00 GB Smaller 0.05% Smaller

CPU Total Image Size Report

Target Image Size Base Image Size Size Difference Size Change (%)
2.3.0-cpu:2.08 GB 2.2.1-cpu:2.02 GB 0.07 GB Larger 3.25% Larger

@claytonparnell claytonparnell merged commit 61e0068 into main Jan 28, 2025
1 check failed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants