Instructions to use kammbo/HyperCLOVAX-SEED-Text-Instruct-1.5B-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use kammbo/HyperCLOVAX-SEED-Text-Instruct-1.5B-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf kammbo/HyperCLOVAX-SEED-Text-Instruct-1.5B-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf kammbo/HyperCLOVAX-SEED-Text-Instruct-1.5B-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf kammbo/HyperCLOVAX-SEED-Text-Instruct-1.5B-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf kammbo/HyperCLOVAX-SEED-Text-Instruct-1.5B-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf kammbo/HyperCLOVAX-SEED-Text-Instruct-1.5B-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf kammbo/HyperCLOVAX-SEED-Text-Instruct-1.5B-GGUF:Q4_K_M
Use Docker
docker model run hf.co/kammbo/HyperCLOVAX-SEED-Text-Instruct-1.5B-GGUF:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use kammbo/HyperCLOVAX-SEED-Text-Instruct-1.5B-GGUF with Ollama:
ollama run hf.co/kammbo/HyperCLOVAX-SEED-Text-Instruct-1.5B-GGUF:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use kammbo/HyperCLOVAX-SEED-Text-Instruct-1.5B-GGUF with Docker Model Runner:
docker model run hf.co/kammbo/HyperCLOVAX-SEED-Text-Instruct-1.5B-GGUF:Q4_K_M
- Lemonade
How to use kammbo/HyperCLOVAX-SEED-Text-Instruct-1.5B-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull kammbo/HyperCLOVAX-SEED-Text-Instruct-1.5B-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.HyperCLOVAX-SEED-Text-Instruct-1.5B-GGUF-Q4_K_M
List all available models
lemonade list
- Atomic Chat
HyperCLOVAX-SEED-Text-Instruct-1.5B-GGUF
1. κ°μ (Overview)
λ³Έ μ μ₯μλ λ€μ΄λ²μ νκ΅μ΄ νΉν κ²½λ λͺ¨λΈμΈ HyperCLOVA X SEED-Text-Instruct-1.5Bλ₯Ό λ‘컬 νκ²½(LM Studio, Ollama λ±)μμ μ½κ² μ¬μ©ν μ μλλ‘ GGUF νμμΌλ‘ λ³νν νμΌμ λλ€.
2. λͺ¨λΈ μ 보 (Model Details)
- μλ³Έ λͺ¨λΈ: naver-hyperclovax/HyperCLOVAX-SEED-Text-Instruct-1.5B
- λ³ν λꡬ:
llama.cpp - νμΌ νμ: GGUF (FP16) - μλ³Έμ μ λ°λλ₯Ό μ μ§ν λ²μ μ λλ€.
3. λΌμ΄μ μ€ (License)
λ³Έ λͺ¨λΈμ λ€μ΄λ²μ HyperCLOVA X SEED λͺ¨λΈ λΌμ΄μ μ€λ₯Ό λ°λ¦ λλ€.
- μμ μ μ΄μ©: κ°μΈ λ° κΈ°μ μ μκ° νμ± μ¬μ©μ(MAU) 1,000λ§ λͺ μ΄νμΈ κ²½μ° λ¬΄λ£λ‘ μμ μ μ΄μ©μ΄ κ°λ₯ν©λλ€.
- μ ν μ¬ν: MAU 1,000λ§ λͺ μ΄κ³Ό μ λ³λ νμκ° νμνλ©°, λ€μ΄λ²μ κ²½μ κ΄κ³μ μλ μλΉμ€μλ μ΄μ©μ΄ μ νλ μ μμ΅λλ€.
4. μ€ν λ°©λ² (How to use)
llama.cpp μ¬μ© μ
llama-cli -m hyper_clova_seed-1.5b-f16.gguf
5. μ 곡 νμΌ μ 보 (Provided Files)
λ³Έ μ μ₯μλ μ¬μ©μμ νλμ¨μ΄ νκ²½μ λ§μΆ° μ νν μ μλ λ κ°μ§ λ²μ μ μ 곡ν©λλ€.
| νμΌλͺ | μ©λ | νΉμ§ | μΆμ² νκ²½ |
|---|---|---|---|
| hyper_clova_seed-1.5b-f16.gguf | 3.17 GB | μλ³Έ νμ§ μ μ§ (FP16) | μΆ©λΆν VRAM/RAM 보μ μ |
| hyper_clova_seed-1.5b-Q4_K_M.gguf | 1.00 GB | 4λΉνΈ μμν (μΆμ²) | μΌλ° PC, λΉ λ₯Έ μλ νμ μ |
6. μμν κΈ°μ μ 보 (Technical Note)
- Q4_K_M μμνλ λͺ¨λΈμ μ±λ₯ μ νλ₯Ό μ΅μννλ©΄μ μ©λμ μ½ 1/3λ‘ μ€μΈ μ€μ μ λλ€.
- μ μ¬μ κΈ°κΈ°λ λͺ¨λ°μΌ νκ²½μμλ μνν νκ΅μ΄ μΆλ‘ μ΄ κ°λ₯νλλ‘ μ΅μ νλμμ΅λλ€.
- Downloads last month
- 47
Hardware compatibility
Log In to add your hardware
4-bit
16-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. π Ask for provider support