Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix marshmallow-enum bug #1746

Merged
merged 7 commits into from
Jul 17, 2023
Merged

fix marshmallow-enum bug #1746

merged 7 commits into from
Jul 17, 2023

Conversation

cosmicBboy
Copy link
Contributor

TL;DR

Installing flytekit==1.8.0 in a fresh environment gives a module not found error

Type

  • Bug Fix
  • Feature
  • Plugin

Are all requirements met?

  • Code completed
  • Smoke tested
  • Unit tests added
  • Code documentation added
  • Any pending items have an associated Issue

Complete description

Error:

"/home/runner/work/flytekit/flytekit/flytekit/core/type_engine.py", line 24, in <module>
2023-07-17T19:54:05.3909379Z     from marshmallow_enum import EnumField, LoadDumpOptions
2023-07-17T19:54:05.3909825Z ModuleNotFoundError: No module named 'marshmallow_enum'

Tracking Issue

NA

Follow-up issue

NA

Signed-off-by: Niels Bantilan <[email protected]>
Signed-off-by: eduardo apolinario <[email protected]>
Signed-off-by: eduardo apolinario <[email protected]>
@eapolinario eapolinario changed the title fix marchmallow-enum bug fix marshmallow-enum bug Jul 17, 2023
Signed-off-by: eduardo apolinario <[email protected]>
This reverts commit 7d92b0f.

Signed-off-by: eduardo apolinario <[email protected]>
Signed-off-by: eduardo apolinario <[email protected]>
Signed-off-by: eduardo apolinario <[email protected]>
@eapolinario eapolinario merged commit bc298bf into master Jul 17, 2023
eapolinario added a commit that referenced this pull request Jul 18, 2023
* fix marchmallow-enum bug

Signed-off-by: Niels Bantilan <[email protected]>

* Remove constraints in requirements.in

Signed-off-by: eduardo apolinario <[email protected]>

* Fix test_dataclass_transformer

Signed-off-by: eduardo apolinario <[email protected]>

* Remove more dev dependencies

Signed-off-by: eduardo apolinario <[email protected]>

* Revert "Fix test_dataclass_transformer"

This reverts commit 7d92b0f.

Signed-off-by: eduardo apolinario <[email protected]>

* Set upper bound ot dataclasses-json

Signed-off-by: eduardo apolinario <[email protected]>

* Set pyyaml version to 5.4.1

Signed-off-by: eduardo apolinario <[email protected]>

---------

Signed-off-by: Niels Bantilan <[email protected]>
Signed-off-by: eduardo apolinario <[email protected]>
Co-authored-by: eduardo apolinario <[email protected]>
eapolinario added a commit that referenced this pull request Jul 19, 2023
* fix marshmallow-enum bug (#1746)

* fix marchmallow-enum bug

Signed-off-by: Niels Bantilan <[email protected]>

* Remove constraints in requirements.in

Signed-off-by: eduardo apolinario <[email protected]>

* Fix test_dataclass_transformer

Signed-off-by: eduardo apolinario <[email protected]>

* Remove more dev dependencies

Signed-off-by: eduardo apolinario <[email protected]>

* Revert "Fix test_dataclass_transformer"

This reverts commit 7d92b0f.

Signed-off-by: eduardo apolinario <[email protected]>

* Set upper bound ot dataclasses-json

Signed-off-by: eduardo apolinario <[email protected]>

* Set pyyaml version to 5.4.1

Signed-off-by: eduardo apolinario <[email protected]>

---------

Signed-off-by: Niels Bantilan <[email protected]>
Signed-off-by: eduardo apolinario <[email protected]>
Co-authored-by: eduardo apolinario <[email protected]>

* Do not use latest tag in images

Signed-off-by: eduardo apolinario <[email protected]>

* Linting and replace pyyaml

Signed-off-by: eduardo apolinario <[email protected]>

* Regenerate doc-requirements

Signed-off-by: eduardo apolinario <[email protected]>

* Bring .readthedocs.yml back

Signed-off-by: eduardo apolinario <[email protected]>

---------

Signed-off-by: Niels Bantilan <[email protected]>
Signed-off-by: eduardo apolinario <[email protected]>
Co-authored-by: Niels Bantilan <[email protected]>
Co-authored-by: eduardo apolinario <[email protected]>
eapolinario added a commit that referenced this pull request Jul 28, 2023
Signed-off-by: eduardo apolinario <[email protected]>
eapolinario added a commit that referenced this pull request Jul 28, 2023
Signed-off-by: eduardo apolinario <[email protected]>
eapolinario added a commit that referenced this pull request Jul 28, 2023
* gate grpc to <1.53.1

Signed-off-by: Yee Hing Tong <[email protected]>

* pyyaml gate as well

Signed-off-by: Yee Hing Tong <[email protected]>

* Fail CI tests faster

Signed-off-by: eduardo apolinario <[email protected]>

* Bring #1746 as well

Signed-off-by: eduardo apolinario <[email protected]>

---------

Signed-off-by: Yee Hing Tong <[email protected]>
Signed-off-by: eduardo apolinario <[email protected]>
Co-authored-by: eduardo apolinario <[email protected]>
eapolinario added a commit that referenced this pull request Jul 28, 2023
* Fail CI tests faster

Signed-off-by: eduardo apolinario <[email protected]>

* gate grpcio and pyyaml

Signed-off-by: Yee Hing Tong <[email protected]>

* Bring #1746 as well

Signed-off-by: eduardo apolinario <[email protected]>

---------

Signed-off-by: eduardo apolinario <[email protected]>
Signed-off-by: Yee Hing Tong <[email protected]>
Co-authored-by: eduardo apolinario <[email protected]>
fg91 pushed a commit that referenced this pull request Aug 15, 2023
* fix marchmallow-enum bug

Signed-off-by: Niels Bantilan <[email protected]>

* Remove constraints in requirements.in

Signed-off-by: eduardo apolinario <[email protected]>

* Fix test_dataclass_transformer

Signed-off-by: eduardo apolinario <[email protected]>

* Remove more dev dependencies

Signed-off-by: eduardo apolinario <[email protected]>

* Revert "Fix test_dataclass_transformer"

This reverts commit 7d92b0f.

Signed-off-by: eduardo apolinario <[email protected]>

* Set upper bound ot dataclasses-json

Signed-off-by: eduardo apolinario <[email protected]>

* Set pyyaml version to 5.4.1

Signed-off-by: eduardo apolinario <[email protected]>

---------

Signed-off-by: Niels Bantilan <[email protected]>
Signed-off-by: eduardo apolinario <[email protected]>
Co-authored-by: eduardo apolinario <[email protected]>
@fellhorn
Copy link
Contributor

@eapolinario Do you remember what needs to be done to remove the dataclasses-json upper bound introduced in d64f35b034ac728dbb27febcad017e1f9685ff5f?

It looks like 0.5.12 has been fixed and newer releases of dataclasses-json would allow proper type definitions:
lidatong/dataclasses-json#433

If it was just issues with 0.5.12 I can prepare a PR to remove the upper bound but forbid this specific version.

@pingsutw
Copy link
Member

If it was just issues with 0.5.12 I can prepare a PR to remove the upper bound but forbid this specific version.

@fellhorn yes, please do it, thanks

@fellhorn
Copy link
Contributor

If it was just issues with 0.5.12 I can prepare a PR to remove the upper bound but forbid this specific version.

@fellhorn yes, please do it, thanks

It seems to go deeper and there is an issue with marshmallow-jsonschema effectively being unmaintained:
flyteorg/flyte#3873 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] The new release of dataclasses-json broke flytekit stock installations
4 participants