ShadeEngine's picture
End of training
4ac8f3e verified
|
Raw
History Blame Contribute Delete
855 Bytes

Activation functions

Customized activation functions for supporting various models in 🤗 Diffusers.

GELU

[[autodoc]] models.activations.GELU

GEGLU

[[autodoc]] models.activations.GEGLU

ApproximateGELU

[[autodoc]] models.activations.ApproximateGELU