-
Update rmsnorm.py
Modifies the forward pass of RMSNorm to avoid mixed precision issues as described in https://github.com/chandar-lab/AMPLIFY/issues/19
-
Fix attention mask dtype issue
The attention mask in AMPLIFY should be additive. Adds an assert to check this condition.
-
Fix typo in the learning rate of Stage 2
-
Add support for CPU
-
Update amplify.py
-
Update README.md
-
Update links
-
initial commit
-
initial commit
