liger-kernels / README.md
kernels-bot's picture
Uploaded using `kernel-builder`.
06219a5 verified
|
Raw History Blame
903 Bytes
metadata
library_name: kernels
license: bsd-2-clause

This is the repository card of kernels-community/liger-kernels that has been pushed on the Hub. It was built to be used with the kernels library. This card was automatically generated.

How to use

# make sure `kernels` is installed: `pip install -U kernels`
from kernels import get_kernel

kernel_module = get_kernel("kernels-community/liger-kernels", version=4)
LigerForCausalLMLoss = kernel_module.LigerForCausalLMLoss

LigerForCausalLMLoss(...)

Available functions

  • LigerForCausalLMLoss
  • liger_rotary_pos_emb

Available layers

  • LigerRMSNorm
  • LigerLinear
  • LigerSwiGLUMLP
  • LigerGEGLUMLP
  • LigerTiledSwiGLUMLP
  • LigerTiledGEGLUMLP
  • CrossEntropyOutput
  • liger_rotary_pos_emb_layer
  • LigerForCausalLMLossLayer

Benchmarks

No benchmark available yet.