metadata
description: >-
Explore activation functions in Ultralytics, including the Unified activation
function and other custom implementations for neural networks.
keywords: >-
ultralytics, activation functions, neural networks, Unified activation, AGLU,
SiLU, ReLU, PyTorch, deep learning, custom activations
Reference for ultralytics/nn/modules/activation.py
!!! Note
This file is available at [https://github.com/ultralytics/ultralytics/blob/main/ultralytics/nn/modules/activation.py](https://github.com/ultralytics/ultralytics/blob/main/ultralytics/nn/modules/activation.py). If you spot a problem please help fix it by [contributing](https://docs.ultralytics.com/help/contributing/) a [Pull Request](https://github.com/ultralytics/ultralytics/edit/main/ultralytics/nn/modules/activation.py) 🛠️. Thank you 🙏!