Instructions to use ltoniazzi/reduce-llms-for-testing with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use ltoniazzi/reduce-llms-for-testing with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf ltoniazzi/reduce-llms-for-testing:F32 # Run inference directly in the terminal: llama cli -hf ltoniazzi/reduce-llms-for-testing:F32
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf ltoniazzi/reduce-llms-for-testing:F32 # Run inference directly in the terminal: llama cli -hf ltoniazzi/reduce-llms-for-testing:F32
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf ltoniazzi/reduce-llms-for-testing:F32 # Run inference directly in the terminal: ./build/bin/llama cli -hf ltoniazzi/reduce-llms-for-testing:F32
Use Docker
docker model run hf.co/ltoniazzi/reduce-llms-for-testing:F32
- Llama new
- LM Studio
- Jan
- Ollama
How to use ltoniazzi/reduce-llms-for-testing with Ollama:
ollama run hf.co/ltoniazzi/reduce-llms-for-testing:F32
- Unsloth Desktop
- Docker Model Runner
How to use ltoniazzi/reduce-llms-for-testing with Docker Model Runner:
docker model run hf.co/ltoniazzi/reduce-llms-for-testing:F32
- Lemonade
How to use ltoniazzi/reduce-llms-for-testing with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull ltoniazzi/reduce-llms-for-testing:F32
Run and chat with the model
lemonade run user.reduce-llms-for-testing-F32
List all available models
lemonade list
- Atomic Chat
Commit History
-
Upload 2 files
Verified signature3413e2d
-
Upload Gemma2ForCausalLM/hidden_size=64/lora/adapter_config.json with huggingface_hub
Verified signature6794a17 -
Upload Gemma2ForCausalLM/hidden_size=64/lora/training_args.bin with huggingface_hub
Verified signature3e8cc33 -
Upload Gemma2ForCausalLM/hidden_size=64/lora/adapter_model.safetensors with huggingface_hub
Verified signature33300cc -
Upload Gemma2ForCausalLM/hidden_size=64/base/training_args.bin with huggingface_hub
Verified signaturec9b7391 -
Upload Gemma2ForCausalLM/hidden_size=64/base/config.json with huggingface_hub
Verified signature6b47a26 -
Upload Gemma2ForCausalLM/hidden_size=64/base/model.safetensors with huggingface_hub
Verified signaturef919a8a -
Upload Gemma2ForCausalLM/hidden_size=64/lora/adapter_config.json with huggingface_hub
Verified signature79754bb -
Upload Gemma2ForCausalLM/hidden_size=64/lora/training_args.bin with huggingface_hub
Verified signature45bf6e4 -
Upload Gemma2ForCausalLM/hidden_size=64/lora/adapter_model.safetensors with huggingface_hub
Verified signature6f98316 -
Upload Gemma2ForCausalLM/hidden_size=64/base/training_args.bin with huggingface_hub
Verified signature6e87baa -
Upload Gemma2ForCausalLM/hidden_size=64/base/model.safetensors with huggingface_hub
Verified signature0642ee5 -
Delete LlamaForCausalLM/size=64
Verified signature9a8e4fe -
Delete Phi3ForCausalLM/size=64
Verified signature9238f1a -
Delete Gemma2ForCausalLM_hidden
Verified signatureb6352a9 -
Upload LlamaForCausalLM/hidden_size=64/lora/adapter_config.json with huggingface_hub
Verified signaturea1cb27c -
Upload LlamaForCausalLM/hidden_size=64/lora/training_args.bin with huggingface_hub
Verified signature4257ecd -
Upload LlamaForCausalLM/hidden_size=64/lora/README.md with huggingface_hub
Verified signatureb6ba758 -
Upload LlamaForCausalLM/hidden_size=64/lora/tokenizer.json with huggingface_hub
Verified signature6109c57 -
Upload LlamaForCausalLM/hidden_size=64/lora/special_tokens_map.json with huggingface_hub
Verified signature98408f8 -
Upload LlamaForCausalLM/hidden_size=64/lora/tokenizer_config.json with huggingface_hub
Verified signaturebd49082 -
Upload LlamaForCausalLM/hidden_size=64/lora/adapter_model.safetensors with huggingface_hub
Verified signatureb66b9e9 -
Upload LlamaForCausalLM/hidden_size=64/base/training_args.bin with huggingface_hub
Verified signaturee77fb7e -
Upload LlamaForCausalLM/hidden_size=64/base/generation_config.json with huggingface_hub
Verified signature556d3ab -
Upload LlamaForCausalLM/hidden_size=64/base/tokenizer.json with huggingface_hub
Verified signaturefe5e373 -
Upload LlamaForCausalLM/hidden_size=64/base/config.json with huggingface_hub
Verified signature270ec87 -
Upload LlamaForCausalLM/hidden_size=64/base/special_tokens_map.json with huggingface_hub
Verified signaturebd71af2 -
Upload LlamaForCausalLM/hidden_size=64/base/tokenizer_config.json with huggingface_hub
Verified signature2562636 -
Upload LlamaForCausalLM/hidden_size=64/base/model.safetensors with huggingface_hub
Verified signaturef8691ec -
Upload Phi3ForCausalLM/hidden_size=64/lora/adapter_config.json with huggingface_hub
Verified signature1918a01 -
Upload Phi3ForCausalLM/hidden_size=64/lora/training_args.bin with huggingface_hub
Verified signature0d859dc -
Upload Phi3ForCausalLM/hidden_size=64/lora/README.md with huggingface_hub
Verified signature89a51e9 -
Upload Phi3ForCausalLM/hidden_size=64/lora/tokenizer.json with huggingface_hub
Verified signature398c71f -
Upload Phi3ForCausalLM/hidden_size=64/lora/special_tokens_map.json with huggingface_hub
Verified signature612fd5a -
Upload Phi3ForCausalLM/hidden_size=64/lora/tokenizer_config.json with huggingface_hub
Verified signature7b24b77 -
Upload Phi3ForCausalLM/hidden_size=64/lora/adapter_model.safetensors with huggingface_hub
Verified signature7b62119 -
Upload Phi3ForCausalLM/hidden_size=64/base/training_args.bin with huggingface_hub
Verified signatureaf2955a -
Upload Phi3ForCausalLM/hidden_size=64/base/tokenizer.model with huggingface_hub
Verified signature5ba7159 -
Upload Phi3ForCausalLM/hidden_size=64/base/generation_config.json with huggingface_hub
Verified signaturea6066e8 -
Upload Phi3ForCausalLM/hidden_size=64/base/tokenizer.json with huggingface_hub
Verified signature8cc8ba6 -
Upload Phi3ForCausalLM/hidden_size=64/base/config.json with huggingface_hub
Verified signatureb264ffd -
Upload Phi3ForCausalLM/hidden_size=64/base/special_tokens_map.json with huggingface_hub
Verified signaturebf552b2 -
Upload Phi3ForCausalLM/hidden_size=64/base/tokenizer_config.json with huggingface_hub
Verified signature7823e4d -
Upload Phi3ForCausalLM/hidden_size=64/base/model.safetensors with huggingface_hub
Verified signature74568b8 -
Upload Gemma2ForCausalLM/hidden_size=64/lora/adapter_config.json with huggingface_hub
Verified signatured994d8f -
Upload Gemma2ForCausalLM/hidden_size=64/lora/training_args.bin with huggingface_hub
Verified signature74631c2 -
Upload Gemma2ForCausalLM/hidden_size=64/lora/adapter_model.safetensors with huggingface_hub
Verified signaturec8d77c2 -
Upload Gemma2ForCausalLM/hidden_size=64/base/training_args.bin with huggingface_hub
Verified signature876fc20 -
Upload Gemma2ForCausalLM/hidden_size=64/base/config.json with huggingface_hub
Verified signaturef76605c -
Upload Gemma2ForCausalLM/hidden_size=64/base/model.safetensors with huggingface_hub
Verified signaturebf8abbe