-
Update rmsnorm.py
Modifies the forward pass of RMSNorm to avoid mixed precision issues as described in https://github.com/chandar-lab/AMPLIFY/issues/19
-
Fix attention mask dtype issue
The attention mask in AMPLIFY should be additive. Checks that this condition is true.
-
Fix typo in the learning rate of Stage 2
-
Add support for CPU
-
Update amplify.py
-
Update amplify.py
-
Update links
-
Update links
-
initial commit
-
initial commit
