feat(optim): Adadelta RAdam Adamax optimizer support

[JieRen98]

Roadmap

• low-level alias
• high-level Optimizer
• high-level MetaOptimizer
• low-level test
• high-level Optimizer test
• CHANGELOG
• import test
• api docs

[codecov]

Codecov Report

Patch coverage: 96.58% and project coverage change: +0.28 🎉

Comparison is base (3f68378) 93.37% compared to head (3e90e72) 93.65%.

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #171      +/-   ##
==========================================
+ Coverage   93.37%   93.65%   +0.28%     
==========================================
  Files          71       83      +12     
  Lines        2683     2943     +260     
==========================================
+ Hits         2505     2756     +251     
- Misses        178      187       +9     

Flag	Coverage Δ
unittests	93.65% <96.58%> (+0.28%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
torchopt/alias/adagrad.py	100.00% <ø> (ø)
torchopt/optim/adagrad.py	100.00% <ø> (ø)
torchopt/optim/func/base.py	88.46% <ø> (ø)
torchopt/optim/meta/adagrad.py	90.91% <ø> (ø)
torchopt/transform/scale_by_radam.py	88.00% <88.00%> (ø)
torchopt/optim/meta/radam.py	90.00% <90.00%> (ø)
torchopt/optim/meta/adadelta.py	90.91% <90.91%> (ø)
torchopt/optim/meta/adamax.py	90.91% <90.91%> (ø)
torchopt/__init__.py	100.00% <100.00%> (ø)
torchopt/alias/__init__.py	100.00% <100.00%> (ø)
... and 11 more

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.