Khanin Udomchoksakul
Add optimized Mistral-7B-Instruct-v0.3 build (MistralRMSNorm + MistralMLP CUDA kernels)
e57527b verified | from setuptools import setup | |
| setup( | |
| name="mistralmlp_ext", | |
| packages=["mistralmlp_cuda"], | |
| package_data={"mistralmlp_cuda": ["*.so"]}, | |
| ) | |