INSTALLATION.md

Installing Both Ollama and Open WebUI Using Kustomize

For cpu-only pod

kubectl apply -f ./kubernetes/manifest/base

For gpu-enabled pod

kubectl apply -k ./kubernetes/manifest

Installing Both Ollama and Open WebUI Using Helm

Package Helm file first

helm package ./kubernetes/helm/

For cpu-only pod

helm install ollama-webui ./ollama-webui-*.tgz

For gpu-enabled pod

helm install ollama-webui ./ollama-webui-*.tgz --set ollama.resources.limits.nvidia.com/gpu="1"

Check the kubernetes/helm/values.yaml file to know which parameters are available for customization