Skip to content

Internal changes in Jacobian generator, new features, new layers

Latest
Latest
Compare
Choose a tag to compare
@tfjgeorge tfjgeorge released this 23 May 20:03
· 51 commits to master since this release
v0.3
93897d9
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Internal changes:

  • The DataLoader is not part of the generator anymore
  • Full backward hooks in jacobian generator
  • Migrates gradient computation outside of Jacobian class to JacobianFactory
  • Adds efficient grads for convolution implementation, with switch to choose between 2 implementations
  • Changes solve implementation

New features

  • PVector add_to_model method
  • Matrix-matrix products for KFAC, Dense, BlockDiag; Diag representations
  • Solve for PMatLowRank
  • Dot between 2 PVector objects
  • Pickle for PMat and PVector objects
  • Grad method for PVector objects
  • MC Fisher helper for segmentation
  • Adds get_kfe method to PMatEKFAC

New layers

  • Custom layers: Cosine, Weightnorm, Affine
  • Support for additional layers: ConvTranspose2d
Assets 2
Loading