Big upstream sync #217

khatchad · 2024-11-08T21:30:09Z

Sorry for the large sync up. I'll try to summarize the changes as best as I can:

Start a CODEOWNERS file (please modify if desired).
Add dependabot build schedule.
Move Black out of spotless and into the build (much faster; spotless support for Black is not working well).
Various formatting fixes as a result of expanding spotless to XML files and others.
Make other metadata consistent with "recent" change to Java upgrade.
PYTHONPATH module fixes (e.g., Incorrect import when there are two files with the same name but in different directories #209).
Workaround Not tracking tensors returned by tf.reshape() for data sources other than MNIST #195.
Enhance TF2 tests: fail if we don't have a node for a function under test (was passing before). Because the ML tests are still on Jython 2 and modules aren't supported there, we have a bunch of tests to consider.
Initialization script enhancements (e.g., Module initialization code not reflected in importing script #202).
Add reshape() parsing (this causes a need for a workaround after exposing a bug).
Some dependency version upgrades.
Various entry point additions, e.g., abseil, click.
Add missing initialization files (__init__.py).

To prevent infinite recursion, only the "top-level" method established the "seen" set.

I originally wrote this as a proof-of-concept and testing, but it's not a legal case because the `Dataset` ctor isn't publicly visible. In other words, `Dataset` isn't a ctor that returns in `Dataset` in "real life." Doing this initially just made the implementation a bit easier to visualize.

It shouldn't just pass-through it's argument. Otherwise, the PA doesn't look right.

* Intraprocedural case for dataset iterators. * More tests. * Handle the intraprocedural case.

This reverts commit 53aa471. It's failing test cases in our client but seems not to do any harm here.

…_from_directory()`.

* New dataset APIs. * Add `from_tensors()`. * Add summary for `tf.data.Dataset.enumerate()`. * More APIs. * Apply spotless. * Add `list_files` summary. * Add random. * Sample from datasets. * Apply spotless.

Let's keep it. We may use it at some point.

* Add tests. * More tests for wala#65. * Hack it. * More tests. * More tests. * Revert "Hack it." This reverts commit 13f6c78. Do it through the PA instead. * Progress. * Remove warning suppression. We're using the logger now. * More tests. * Add logging. * Progress. * Another transitive test. * Only traverse the queue. We still need it. * Check if the value is a constant first. * Rearrange. * Short circuit when we find the import. Use only the first found library. * Generalize. * Move CG assertions after dump. * Cleanup variables. * Remove unnecessarily method call. * Move variables out. * Progress. * Cleanup. * Update test.

Fix wala#209.

Bumps `maven.surefire.version` from 3.3.0 to 3.3.1. Updates `org.apache.maven.plugins:maven-surefire-plugin` from 3.3.0 to 3.3.1 - [Release notes](https://github.com/apache/maven-surefire/releases) - [Commits](apache/maven-surefire@surefire-3.3.0...surefire-3.3.1) Updates `org.apache.maven.plugins:maven-surefire-report-plugin` from 3.3.0 to 3.3.1 - [Release notes](https://github.com/apache/maven-surefire/releases) - [Commits](apache/maven-surefire@surefire-3.3.0...surefire-3.3.1) --- updated-dependencies: - dependency-name: org.apache.maven.plugins:maven-surefire-plugin dependency-type: direct:production update-type: version-update:semver-patch - dependency-name: org.apache.maven.plugins:maven-surefire-report-plugin dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]>

For example: `from X.Y.Z import *`.

This reverts commit 5d72128.

This reverts commit abc9b16.

Per wala#208 (comment).

…re.version-3.3.1 Bump maven.surefire.version from 3.3.0 to 3.3.1

Bumps [org.apache.maven.plugins:maven-shade-plugin](https://github.com/apache/maven-shade-plugin) from 3.4.1 to 3.6.0. - [Release notes](https://github.com/apache/maven-shade-plugin/releases) - [Commits](apache/maven-shade-plugin@maven-shade-plugin-3.4.1...maven-shade-plugin-3.6.0) --- updated-dependencies: - dependency-name: org.apache.maven.plugins:maven-shade-plugin dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]>

This can happen now since we continue processing after a parse error.

Bumps [black](https://github.com/psf/black) from 24.4.2 to 24.8.0. - [Release notes](https://github.com/psf/black/releases) - [Changelog](https://github.com/psf/black/blob/main/CHANGES.md) - [Commits](psf/black@24.4.2...24.8.0) --- updated-dependencies: - dependency-name: black dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]>

Bump black from 24.4.2 to 24.8.0

…maven-shade-plugin-3.6.0

…aven.plugins-maven-shade-plugin-3.6.0 Bump org.apache.maven.plugins:maven-shade-plugin from 3.4.1 to 3.6.0

msridhar

Gonna blind stamp this one, no way I'm going to have time to review anytime soon 🙂

khatchad · 2024-11-08T23:39:42Z

Thanks!

khatchad added 30 commits March 4, 2024 17:29

Add summary for tf.keras.Model.

92c19fa

Fail the build earlier.

ba95a29

Remove clean from build.

a2dcae0

Use better variable name.

80a3728

Make an internal method.

8f75e32

To prevent infinite recursion, only the "top-level" method established the "seen" set.

Formatting.

20c39f7

Apply spotless.

ed39bd8

Add javadoc.

72ca1f7

Remove unused variable.

1b772c1

Add iter() and next() preliminary built-ins.

f853e91

Apply spotless.

96d9912

next() on an iterator should return an object.

5a18a92

It shouldn't just pass-through it's argument. Otherwise, the PA doesn't look right.

Let's pass-through the dataset.

3c33cde

Handle dataset iterators (#88)

7ee2502

* Intraprocedural case for dataset iterators. * More tests. * Handle the intraprocedural case.

Prepare for release 0.29.0.

3c94382

Prepare next development release.

43df8c1

Revert "Remove processing of illegal Dataset case."

2717a52

This reverts commit 53aa471. It's failing test cases in our client but seems not to do any harm here.

Add summary for `tf.keras.preprocessing.image.ImageDataGenerator.flow…

e89b886

…_from_directory()`.

Add comment.

d2c6e17

New dataset APIs (#89)

ef62a4e

* New dataset APIs. * Add `from_tensors()`. * Add summary for `tf.data.Dataset.enumerate()`. * More APIs. * Apply spotless. * Add `list_files` summary. * Add random. * Sample from datasets. * Apply spotless.

Capitalize constant.

833a474

Add test for wala#168.

da06de2

Add a TensorFlow type.

6a6f14f

Suppress warning about unused logger.

bf94a5b

Let's keep it. We may use it at some point.

Use Maven instead of Gradle.

0bca179

Enhance test case.

5e19611

Increase logging.

43842b9

Verify assertions *after* the CG dump.

becec9e

khatchad and others added 24 commits July 23, 2024 10:09

Update javadoc.

205beee

Enhance local module lookup (#123)

099932d

Fix wala#209.

Prepare for release 0.37.0.

09c0e9c

Prepare next development release.

15cd279

Be a little more lenient on what constitutes a test case entrypoint.

4e80545

Handle the wildcard import property read case.

02366ec

For example: `from X.Y.Z import *`.

Issue a warning instead of throwing an exception.

5d72128

Revert "Issue a warning instead of throwing an exception."

abc9b16

This reverts commit 5d72128.

Revert "Revert "Issue a warning instead of throwing an exception.""

0f4ed4f

This reverts commit abc9b16.

Add TODO comment.

11993eb

Per wala#208 (comment).

Merge branch 'master' into dependabot/maven/maven.surefire.version-3.3.1

d16fc5b

Merge pull request #118 from ponder-lab/dependabot/maven/maven.surefi…

65525f9

…re.version-3.3.1 Bump maven.surefire.version from 3.3.0 to 3.3.1

Merge branch 'master' of https://github.com/ponder-lab/ML

a82a371

Don't assume number of parameters.

4e39344

This can happen now since we continue processing after a parse error.

Convert exception throw to warning.

4a349dd

Merge pull request #125 from ponder-lab/dependabot/pip/black-24.8.0

d287aba

Bump black from 24.4.2 to 24.8.0

Merge branch 'master' into dependabot/maven/org.apache.maven.plugins-…

dfe180a

…maven-shade-plugin-3.6.0

Merge pull request #117 from ponder-lab/dependabot/maven/org.apache.m…

a6fc045

…aven.plugins-maven-shade-plugin-3.6.0 Bump org.apache.maven.plugins:maven-shade-plugin from 3.4.1 to 3.6.0

Update black version.

f174c21

Decorator fixes.

0bcb5ab

Merge branch 'master' into contrib_sync_upstream

bd7284e

khatchad requested a review from msridhar November 8, 2024 21:49

khatchad marked this pull request as ready for review November 8, 2024 21:50

msridhar approved these changes Nov 8, 2024

View reviewed changes

msridhar merged commit 690337c into wala:master Nov 8, 2024
1 check passed

msridhar deleted the contrib_sync_upstream branch November 8, 2024 22:36

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Big upstream sync #217

Big upstream sync #217

khatchad commented Nov 8, 2024 •

edited

Loading

msridhar left a comment

khatchad commented Nov 8, 2024

Big upstream sync #217

Big upstream sync #217

Conversation

khatchad commented Nov 8, 2024 • edited Loading

msridhar left a comment

Choose a reason for hiding this comment

khatchad commented Nov 8, 2024

khatchad commented Nov 8, 2024 •

edited

Loading