Skip to content

fix(transform): prevent NaN in Adam-family optimizers on float16 zero-gradient steps - #1769

Open
somuai wants to merge 7 commits into
google-deepmind:mainfrom
somuai:fix-adam-family-float16-zero-grad-nan
Open

fix(transform): prevent NaN in Adam-family optimizers on float16 zero-gradient steps#1769
somuai wants to merge 7 commits into
google-deepmind:mainfrom
somuai:fix-adam-family-float16-zero-grad-nan

fix(transform): add _check_valid_eps to scale_by_amsgrad and scale_by…

fad1e0e
Select commit
Loading
Failed to load commit list.
Google CLA / cla/google succeeded Sep 3, 2026 in 9s

✅ All contributors are covered under a CLA with Google

See https://cla.developers.google.com/ for more info about Google's Contributor License Agreement (CLA).

ℹ️ Googlers: Go here to view more details and manage scans for this pull request.

Details

The following contributors were found for this pull request:

✅ fad1e0e Author: @somuai <jobs********6124​@gmail.com>

(Only the first commit for a unique contributor is listed.)

View more details on Google CLA