Skip to content

feat: add AdamW optimizer #44

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 33 commits into from
Sep 5, 2022
Merged
Changes from 1 commit
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
70b8a47
feat(torchopt): init adamw optimizer
Benjamin-eecs Jul 27, 2022
3300142
Merge remote-tracking branch 'upstream/main' into feature/adamw
Benjamin-eecs Aug 4, 2022
253cc2a
fix(torchopt): pass adamw tests
Benjamin-eecs Aug 4, 2022
17d5784
fix: force add adamw.py
Benjamin-eecs Aug 4, 2022
cdc3836
feat: add MetaAdamW test and pass lint
Benjamin-eecs Aug 5, 2022
cc3a3c7
feat: add MetaAdamW test and pass lint
Benjamin-eecs Aug 5, 2022
a071550
fix: pass lint and pass MetaAdamW tests
Benjamin-eecs Aug 5, 2022
89fac53
fix: rewrite MetaOptimizer test, pass MetaAdamW tests with error tol
Benjamin-eecs Aug 5, 2022
b50abe0
merge: resolve conflicts
Benjamin-eecs Aug 24, 2022
47ff9f3
merge: resolve conflicts
Benjamin-eecs Aug 24, 2022
476332e
fix: update adamw low level test
Benjamin-eecs Aug 26, 2022
8175181
merge: resolve conflicts
Benjamin-eecs Sep 1, 2022
bb82209
fix(tests): use new test
Benjamin-eecs Sep 4, 2022
4b01c7e
Merge remote-tracking branch 'upstream/main' into feature/adamw
Benjamin-eecs Sep 4, 2022
d935014
fix: pass lint
Benjamin-eecs Sep 4, 2022
47cfa45
fix: pass test
Benjamin-eecs Sep 4, 2022
9b32e7b
Merge remote-tracking branch 'upstream/main' into feature/adamw
Benjamin-eecs Sep 4, 2022
42ed8a5
fix: pass test
Benjamin-eecs Sep 4, 2022
1e64877
fix: pass test
Benjamin-eecs Sep 4, 2022
872b8d4
fix: update docstring
Benjamin-eecs Sep 4, 2022
824d1c5
fix: update docstring
Benjamin-eecs Sep 4, 2022
e920c74
fix: update docstring
Benjamin-eecs Sep 4, 2022
8ee3c41
fix: correct already_flattened
Benjamin-eecs Sep 4, 2022
0f129c0
fix: correct weight_decay range check
Benjamin-eecs Sep 4, 2022
e75671e
fix: already_flattened of mask
Benjamin-eecs Sep 4, 2022
c791bba
style: format code
XuehaiPan Sep 5, 2022
24690a0
feat: add shortcut
XuehaiPan Sep 5, 2022
fec6f99
chore: reorganize code structure
XuehaiPan Sep 5, 2022
d3ad838
feat: inplace support for AdamW
XuehaiPan Sep 5, 2022
c685954
docs: update docstrings
XuehaiPan Sep 5, 2022
8114286
docs(CHANGELOG): update CHANGELOG.md
XuehaiPan Sep 5, 2022
c075533
docs: update docstrings
XuehaiPan Sep 5, 2022
0f5c90a
docs: update docstrings
XuehaiPan Sep 5, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
docs(CHANGELOG): update CHANGELOG.md
  • Loading branch information
XuehaiPan committed Sep 5, 2022
commit 811428636fefb2972ce47842e96fac531f45b9b5
1 change: 1 addition & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0

### Added

- Implement AdamW optimizer with masking by [@Benjamin-eecs](https://github.com/Benjamin-eecs) and [@XuehaiPan](https://github.com/XuehaiPan) in [#44](https://github.com/metaopt/torchopt/pull/44).
- Add half float support for accelerated OPs by [@XuehaiPan](https://github.com/XuehaiPan) in [#67](https://github.com/metaopt/torchopt/pull/67).
- Add MAML example with TorchRL integration by [@vmoens](https://github.com/vmoens) and [@Benjamin-eecs](https://github.com/Benjamin-eecs) in [#12](https://github.com/metaopt/TorchOpt/pull/12).
- Add optional argument `params` to update function in gradient transformations by [@XuehaiPan](https://github.com/XuehaiPan) in [#65](https://github.com/metaopt/torchopt/pull/65).
Expand Down
pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy