Instructions to use Jun1510/junai-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Jun1510/junai-models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf Jun1510/junai-models:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf Jun1510/junai-models:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf Jun1510/junai-models:Q4_K_M
Use Docker
docker model run hf.co/Jun1510/junai-models:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use Jun1510/junai-models with Ollama:
ollama run hf.co/Jun1510/junai-models:Q4_K_M
- Unsloth Desktop
- Pi
How to use Jun1510/junai-models with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Jun1510/junai-models:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Jun1510/junai-models with Docker Model Runner:
docker model run hf.co/Jun1510/junai-models:Q4_K_M
- Lemonade
How to use Jun1510/junai-models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Jun1510/junai-models:Q4_K_M
Run and chat with the model
lemonade run user.junai-models-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use Jun1510/junai-models with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default Jun1510/junai-models:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Jun1510/junai-models with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "Jun1510/junai-models:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
File size: 4,165 Bytes
622d2ce | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 | [
{"id": "gk_001", "domain": "gk", "topic": "what is the capital of India", "content": "New Delhi is the capital of India, serving as the seat of the country's government including Parliament, the President's residence, and major government offices. It's part of the larger National Capital Territory of Delhi."},
{"id": "gk_002", "domain": "gk", "topic": "how many continents are there", "content": "There are commonly considered to be seven continents: Asia, Africa, North America, South America, Antarctica, Europe, and Australia (Oceania). Some geographic models combine or split certain continents differently, but seven is the most widely taught count."},
{"id": "gk_003", "domain": "gk", "topic": "what is the largest planet in the solar system", "content": "Jupiter is the largest planet in the solar system, with a mass more than twice that of all other planets combined. It's a gas giant primarily made of hydrogen and helium, known for its Great Red Spot storm."},
{"id": "gk_004", "domain": "gk", "topic": "who wrote the Indian national anthem", "content": "India's national anthem, \"Jana Gana Mana,\" was written and composed by Nobel laureate Rabindranath Tagore, and was officially adopted as the national anthem in 1950."},
{"id": "gk_005", "domain": "gk", "topic": "what is the longest river in the world", "content": "The Nile River in Africa is generally considered the longest river in the world, stretching about 6,650 km, though some measurements consider the Amazon River in South America to be longer depending on the measurement method used."},
{"id": "gk_006", "domain": "gk", "topic": "what currency does India use", "content": "India's official currency is the Indian Rupee (INR), symbolized as ₹, issued and regulated by the Reserve Bank of India (RBI)."},
{"id": "gk_007", "domain": "gk", "topic": "how many states and union territories does India have", "content": "As of recent reorganization, India has 28 states and 8 union territories. This changed most recently in 2019 when Jammu & Kashmir was reorganized into two union territories."},
{"id": "gk_008", "domain": "gk", "topic": "what is the tallest mountain in the world", "content": "Mount Everest, located in the Himalayas on the border of Nepal and Tibet (China), is the tallest mountain above sea level at about 8,849 meters (29,032 feet)."},
{"id": "gk_009", "domain": "gk", "topic": "what are the primary colors", "content": "In traditional color theory (subtractive, used for paint/pigment), the primary colors are red, blue, and yellow. In light-based (additive) color theory, used for screens, the primaries are red, green, and blue (RGB)."},
{"id": "gk_010", "domain": "gk", "topic": "who is considered the father of the Indian nation", "content": "Mahatma Gandhi is widely referred to as the \"Father of the Nation\" in India, for his leadership of the non-violent independence movement against British colonial rule."},
{"id": "gk_011", "domain": "gk", "topic": "how many bones are in the human body", "content": "An adult human body typically has 206 bones. Babies are born with more (around 270), many of which fuse together as the body grows into adulthood."},
{"id": "gk_012", "domain": "gk", "topic": "what is the largest ocean on Earth", "content": "The Pacific Ocean is the largest and deepest ocean on Earth, covering more area than all of Earth's land combined."},
{"id": "gk_013", "domain": "gk", "topic": "what is the speed of light", "content": "The speed of light in a vacuum is approximately 299,792 kilometers per second (about 3 x 10^8 m/s), a fundamental constant in physics and the maximum speed at which information or matter can travel."},
{"id": "gk_014", "domain": "gk", "topic": "how many players are on a cricket team", "content": "A cricket team fields 11 players at a time during a match. A full squad may include additional players as reserves, but only 11 per side play on the field simultaneously."},
{"id": "gk_015", "domain": "gk", "topic": "what is the national animal and bird of India", "content": "The national animal of India is the Bengal Tiger, and the national bird is the Indian Peacock."}
]
|