Skip to content

Upgrade to Datafusion 48 #84

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

friendlymatthew
Copy link
Contributor

@friendlymatthew friendlymatthew commented May 8, 2025

This commit accounts for breaking changes in Datafusion 48. See upgrading guide.

Here are the things that break:

  • ScalarFunctionArgs now take in Fields rather than purely DataTypes. Since it is quite trivial to work around them as it purely contains metadata, I've forged it for now.

@friendlymatthew friendlymatthew changed the title DNM: Point dependency to the _latest_ version Prepare for Datafusion 48 May 20, 2025
@friendlymatthew friendlymatthew changed the title Prepare for Datafusion 48 Upgrade to Datafusion 48 Jun 12, 2025
@friendlymatthew friendlymatthew force-pushed the friendlymatthew/df-latest branch from 2e461c3 to ae09910 Compare June 12, 2025 14:07
tests/main.rs Outdated
Comment on lines 507 to 512
return_type: &DataType::Utf8,
return_field: Arc::new(Field::new("ret_field", DataType::Utf8, false)),
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we mark these as json?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, what do you mean by marking as json? Do you mean marking the return_field as a json type? This test case is expecting json_get_str to return a ScalarValue::Utf8.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let json_metadata: HashMap<String, String> =

@codecov-commenter
Copy link

Codecov Report

Attention: Patch coverage is 50.00000% with 1 line in your changes missing coverage. Please review.

Project coverage is 82.62%. Comparing base (b9dfacd) to head (3994247).

Files with missing lines Patch % Lines
src/rewrite.rs 50.00% 0 Missing and 1 partial ⚠️
Additional details and impacted files
@@           Coverage Diff           @@
##             main      #84   +/-   ##
=======================================
  Coverage   82.62%   82.62%           
=======================================
  Files          15       15           
  Lines        1180     1180           
  Branches     1180     1180           
=======================================
  Hits          975      975           
  Misses        144      144           
  Partials       61       61           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@davidhewitt davidhewitt merged commit f603bc2 into datafusion-contrib:main Jun 16, 2025
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants