-
Update README.md
-
Update README.md
-
Create README.md
-
Fixed some issues and bugs .Finished trail training succesfully
-
Changed the attention mechanism to GQA in knn_attention and xl_attention
-
few errors and bug fixes,added knn db in gitignore
-
Completed training code and minor changes in dataloader
-
Minor changes
-
Atttention module and model module completed
-
xl_attention completed
-
Added knn memory.Added search,retrive,add functionality to memory
-
Rewrote the entire Dataloader
-
Repo before implementing concepts of the paper memorizing transformer