Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Baseline set of fixes for release #10052

Open
wants to merge 64 commits into
base: master
Choose a base branch
from
Open

Baseline set of fixes for release #10052

wants to merge 64 commits into from

Conversation

agibsonccc
Copy link
Contributor

What changes were proposed in this pull request?

(Please fill in changes proposed in this fix)

How was this patch tested?

(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)

Quick checklist

The following checklist helps ensure your PR is complete:

  • Eclipse Contributor Agreement signed, and signed commits - see IP Requirements page for details
  • Reviewed the Contributing Guidelines and followed the steps within.
  • Created tests for any significant new code additions.
  • Relevant tests for your changes are passing.

Fix left over test issue
Add hack that configures surefire to use a wrapper that allows us to debug tests
Fix left over test issue
Add hack that configures surefire to use a wrapper that allows us to debug tests
Fix up deallocation race conditions with constants (removes random deallocation of constants)

Bring back some deallocations
… debugging of stack traces

when SD_GCC_FUNCTRACE is turned on and the right environment is set.
Remove old dependencies from tests
Ensure thread safety on deallocations in pointerwrapper,opaquebuffer
Fix up uniform dealocation and result propagation.
Remove commented code.
Remove old traceNew method
Removes old clionide exclusion in type_boilerplate.h
Remove unused scalar.cu
Misc fixes for scalar related shape descriptor creation
Update java build script
Remove some unused c++ tests
Improve debug statements in DeclarableOp.cpp
Add new FuncTracce developer doc explaining the functionality.
Add flag on environment to enable/disable delete special/primary buffers
Misc unused code cleanup
Empty flags fixes across various ops
Various flag fixes for each op
Remove various empty specific workarounds across different ops
Fix up solve for cuda
Add lup dimensions
Add databuffer print for cuda/cpu
Add softmax launch dimensions
Fix view write bug with assign and cast
Add validation for data type creation
Add validation for data type creation
Add ending statement to printIndexedBuffer for easier searching when large arrays are output
Remove im2col/col2im configurations in testing scripts
Fix bool data types
Fix squeeze and slice empty shapes
Port cumsum cpu implementation over to cuda as temp workaround
Fix broadcast_bool edge cases.
Remove prints statements
Automatically return c on 0 rank arrays
Misc formatting
Fix up rest of cuda tests
Add more cuda validation to  various kernel launches
Consolidate reflection based classloading for deserialization
and op loading
Remove more legacy helper related code
Fix various databuffer deallocations
Refactor related DifferentialFunctionClassHolder usage
Fix conv1d related undefined behavior/process hangs when a bias is null
@archenroot
Copy link

This is mega PR :-)

@agibsonccc
Copy link
Contributor Author

Thanks for checking folks! I'll be breaking this up in the next week or so

Adds array registry for tracking arrays in a central location mapped by id.
Adds event instrumentation to different parts of the nd4j api to track data at different parts of an array's lifecyle.
Fix view offset detection by omitting views from element wise stride based offset calculations.
Add new check input change which detects when an op changes an input and throws an exception when this is the case.
Add explicit destructor for ndarrays
Improve logging for ndarray constructors with separate environment variable
Update address sanitizer build to link correctly.
Revert op.z() caching due to eager mode.
Remove VEDA/VEDNN
Convert all smart pointer databuffers to normal pointers.
Due to external buffers they produce very inconnsistent results.
Rewrites conv2d to delegate to c++ while keeping the same logic.
Fix bias conv2d gradient
Fix sizes for locally connected 2d.
Fix NHWC case for new conv2d invocation.
when functrace is turned on.
Fix delete in constant shape helper when a shape descirptor exists.
Delete more aurora
Add validation for cache values that are being stored.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants