Instructions to use Jun1510/junai-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Jun1510/junai-models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf Jun1510/junai-models:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf Jun1510/junai-models:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf Jun1510/junai-models:Q4_K_M
Use Docker
docker model run hf.co/Jun1510/junai-models:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use Jun1510/junai-models with Ollama:
ollama run hf.co/Jun1510/junai-models:Q4_K_M
- Unsloth Desktop
- Pi
How to use Jun1510/junai-models with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Jun1510/junai-models:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Jun1510/junai-models with Docker Model Runner:
docker model run hf.co/Jun1510/junai-models:Q4_K_M
- Lemonade
How to use Jun1510/junai-models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Jun1510/junai-models:Q4_K_M
Run and chat with the model
lemonade run user.junai-models-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use Jun1510/junai-models with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default Jun1510/junai-models:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Jun1510/junai-models with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "Jun1510/junai-models:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
File size: 5,450 Bytes
622d2ce | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 | [
{"id": "apps_001", "domain": "apps_games", "topic": "what is WhatsApp", "content": "WhatsApp is a free messaging app owned by Meta that allows text, voice, and video messaging along with voice and video calls over the internet. It uses end-to-end encryption by default for personal chats and calls."},
{"id": "apps_002", "domain": "apps_games", "topic": "what is the Google Play Store", "content": "The Google Play Store is the official app marketplace for Android devices, where users can browse, download, and update apps, games, movies, and books. Apps go through a review process before being listed."},
{"id": "apps_003", "domain": "apps_games", "topic": "what is battery optimization on Android", "content": "Battery optimization is an Android system feature that restricts background activity of apps to save power, sometimes limiting notifications or background tasks for apps not actively in use. Apps that need to run reliably in the background (like alarms or messaging apps) often need to be manually excluded from optimization."},
{"id": "apps_004", "domain": "apps_games", "topic": "what is cloud gaming", "content": "Cloud gaming lets users play video games streamed from remote servers instead of running them on local hardware, similar to how video streaming works. Services like Xbox Cloud Gaming or GeForce NOW require a stable internet connection since the actual processing happens remotely."},
{"id": "apps_005", "domain": "apps_games", "topic": "what is an APK file", "content": "An APK (Android Package Kit) is the file format used to distribute and install applications on Android devices. Apps can be installed via the Play Store or by manually installing an APK file from another trusted source."},
{"id": "apps_006", "domain": "apps_games", "topic": "what is multiplayer online battle arena (MOBA)", "content": "A MOBA is a video game genre where two teams of players each control a character and battle to destroy the opposing team's base, popularized by games like League of Legends, Dota 2, and Mobile Legends. Matches typically involve strategy, teamwork, and character progression during the match."},
{"id": "apps_007", "domain": "apps_games", "topic": "what is battle royale genre", "content": "Battle royale is a video game genre where many players compete on a shrinking map until only one player or team remains, popularized by games like PUBG, Fortnite, and Free Fire. Matches typically combine survival, resource-gathering, and combat elements."},
{"id": "apps_008", "domain": "apps_games", "topic": "what is app permissions on Android", "content": "App permissions are controls that let users decide what an app can access on their device, such as camera, microphone, contacts, or location. Since Android 6.0, apps must request these permissions at runtime rather than only at install time."},
{"id": "apps_009", "domain": "apps_games", "topic": "what is UPI in Indian payment apps", "content": "UPI (Unified Payments Interface) is a real-time payment system in India that allows instant bank-to-bank money transfers using a mobile app and a UPI ID or QR code, without needing to share bank account details. Popular UPI apps include Google Pay, PhonePe, and Paytm."},
{"id": "apps_010", "domain": "apps_games", "topic": "what is dark mode", "content": "Dark mode is a display setting available in most modern apps and operating systems that uses a dark color scheme instead of a light one, often to reduce eye strain in low light and save battery on OLED screens. It can usually be toggled system-wide or per app."},
{"id": "apps_011", "domain": "apps_games", "topic": "what is a rogue-like game", "content": "Roguelike (or roguelite) is a game genre characterized by procedurally generated levels, permanent death (losing progress on death), and high replayability, originally inspired by the 1980 game Rogue. Modern examples include Hades and Dead Cells."},
{"id": "apps_012", "domain": "apps_games", "topic": "what is an accessibility service on Android", "content": "Android's Accessibility Service is a system-level API originally designed to help users with disabilities interact with their device (e.g. screen readers), but it can also be used by apps to observe screen content and perform actions like tapping or typing on behalf of the user, with explicit permission."},
{"id": "apps_013", "domain": "apps_games", "topic": "what is cross-platform gaming", "content": "Cross-platform gaming allows players on different systems — like PC, PlayStation, Xbox, or mobile — to play together in the same multiplayer session. Not all games support this, and it often depends on the publisher enabling it."},
{"id": "apps_014", "domain": "apps_games", "topic": "what is app data backup on Android", "content": "Android offers built-in backup options (like Google's auto-backup) that save app data and settings to the cloud, so they can be restored on a new device. Individual apps may also offer their own backup or sync features, such as WhatsApp backing up chats to Google Drive."},
{"id": "apps_015", "domain": "apps_games", "topic": "what is offline mode in apps", "content": "Offline mode refers to an app's ability to function without an active internet connection, often by storing data locally on the device instead of relying on a server. This is common in note apps, some games, and increasingly in on-device AI apps to keep data private and usable anywhere."}
]
|