Commit History
-
Update tag
Verified signatureAs part of improving kernel integration with the Hub: https://github.com/huggingface/huggingface.js/pull/1822 , we are using the `kernels` tag in place of `kernel` from now on. This is a small PR to update the tag.3083319
-
Add built binary [skip-build]
github-actions[bot]f2471cd
-
fix(rms_norm.py): add assertion for input gradients to handle unsupported cases in backward pass
f19f8f4 -
feat: support sequence parallel with fused_add_rms_norm
151bb5a -
refactor(activation): change fused_add_rms_norm and fused_add_rms_norm_backward to out-place operations
7e4334d -
refactor(rms_norm): move RMS normalization logic to a new module for better organization and maintainability
66b3c5e
-
feat: support sequence parallel with rms_norm
06d6367 -
feat: add assert is_contiguous
a2a2501 -
feat: make rms_norm as out-place
9d0a235
-
feat(workflow): add Slack notifications for build start, success, and failure [skip-build]
ab05e35 -
Revert "fix typo in readme (#7)" (#8)
TaehyunKimUnverified signatureThis reverts commit 2d926c3d4773b82c5a5f03904780a40d25a1afee.ddd119c -
fix typo in readme (#7)
TaehyunKim +1: github-actions[bot]Unverified signature* fix typo in readme Signed-off-by: ca1207 <ca1207zzz@gmail.com> * Add built binary [skip-build] --------- Signed-off-by: ca1207 <ca1207zzz@gmail.com> Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>2d926c3
-
chore: add build action [skip-build]
5dde6fa
-
Fix fused add rms norm (#4)
TaehyunKim +1: TaehyunKimMotifUnverified signature* make fused add rms norm return 2 outputs * add builds * add plot --------- Co-authored-by: taehyun <taehyun.kim@motiftech.io>a1e5ca8
-
Add fusion (#3)
TaehyunKim +1: TaehyunKimMotifUnverified signature* vectorize and optimized block reduce * add benchmark test (w/o readme update) * implemented fused_mul_poly_norm Signed-off-by: taehyun <taehyun.kim@motiftech.io> * add_rms_norm added * deleted backward pass on fused add rms norm, split test and benchmarks Signed-off-by: taehyun <taehyun.kim@motiftech.io> * refactored benchmarks * add readme * fix readme * add build * fix readme * fix readme2 * add mi250 results * highlight used our kernel for baseline in fused performance * applied yapf --------- Signed-off-by: taehyun <taehyun.kim@motiftech.io> Co-authored-by: taehyun <taehyun.kim@motiftech.io>e5e2eeb
-
chore: add license
e677f62 -
chore: add push-to-hf workflow
269223c
-
Merge pull request #1 from MotifTechnologies/add_action
TaehyunKimUnverified signatureadd precommit action9c49e08 -
add more exclude files
f9f3398 -
add precommit acttion
294dbc1
-
Optimize kernel (#2)
Verified signature- add poly_norm_naive.cui for temp test (18ec195c33e9fc3d259cbef6b6e6cdaf077c4921) - optimize poly norm kernel (f8a7e6f9a378e4860688af1c856fc285f7fdb5bc) - add pre-commit (a73a0c0cfd8960f3041692d9e2b70e93550277a3) - add readme with precommit hooks and applied pre commit to all files (f517c97d5ea3aa5479d47cfb5a11ca070972aad4) - add build (56776acf3c7345b3a5b71ea5aec28ee8ee59d0fa)97825b8
-
torch 2.8 support (#1)
Verified signature- feat: upload torch28 build (7bc152adfb8413bf260a99b903dc0f90ec14d559)43629b7
-
feat: add cuda build
cf68df1
-
feat: support reset_parameters()
605f22e -
feat(rms-norm): Impl fused RMSNorm
f3b99fb
-
feat(poly-norm): add perf test
d14fd4d
-
fix(poly-norm): calc param grad explicitly
704692b -
fix(poly-norm): fix bug in reduce sum
883cc1c -
refactor(poly-norm): fix indentation
32c2bde
-
refactor(poly-norm): use const for immutable args
e85ecc9 -
chore(poly-norm): remove unnecessary file
552d415 -
chore: use latest build image and misc
f5a7d38
-
chore(poly-norm): update README and build artifacts
f72121c -
feat(poly-norm): add default value for eps argument
afd2a56 -
chore(poly-norm): add ROCm build artifacts
4b70498 -
feat(poly-norm): Add PolyNorm
44e9845 -
initial commit
Verified signature7a7d761