Instructions to use Jun1510/junai-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Jun1510/junai-models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf Jun1510/junai-models:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf Jun1510/junai-models:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf Jun1510/junai-models:Q4_K_M
Use Docker
docker model run hf.co/Jun1510/junai-models:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use Jun1510/junai-models with Ollama:
ollama run hf.co/Jun1510/junai-models:Q4_K_M
- Unsloth Desktop
- Pi
How to use Jun1510/junai-models with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Jun1510/junai-models:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Jun1510/junai-models with Docker Model Runner:
docker model run hf.co/Jun1510/junai-models:Q4_K_M
- Lemonade
How to use Jun1510/junai-models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Jun1510/junai-models:Q4_K_M
Run and chat with the model
lemonade run user.junai-models-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use Jun1510/junai-models with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default Jun1510/junai-models:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Jun1510/junai-models with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "Jun1510/junai-models:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Download knowledge/tech.json from Jun1510/junai-models: direct link, hf CLI and curl.
- Browser
- Download file 5.66 kB
-
https://huggingface.co/Jun1510/junai-models/resolve/main/knowledge/tech.json
- Command line
-
hf download hf://Jun1510/junai-models/knowledge/tech.json
-
curl -L -o tech.json https://huggingface.co/Jun1510/junai-models/resolve/main/knowledge/tech.json
5.66 kB
| [ | |
| {"id": "tech_001", "domain": "tech", "topic": "what is Android OS", "content": "Android is a mobile operating system developed by Google, based on a modified version of the Linux kernel, and is the most widely used mobile OS in the world. It's open-source at its core (AOSP) but most phones ship with additional proprietary Google services on top."}, | |
| {"id": "tech_002", "domain": "tech", "topic": "difference between RAM and storage", "content": "RAM (Random Access Memory) is fast, temporary memory used to actively run apps and processes, cleared when the device restarts. Storage (like internal storage or an SD card) holds data permanently, such as photos, apps, and files, even after a restart."}, | |
| {"id": "tech_003", "domain": "tech", "topic": "what is a firewall", "content": "A firewall is a security system, either hardware or software, that monitors and controls incoming and outgoing network traffic based on defined security rules, acting as a barrier between a trusted internal network and untrusted external networks like the internet."}, | |
| {"id": "tech_004", "domain": "tech", "topic": "what is Wi-Fi vs mobile data", "content": "Wi-Fi connects a device to the internet through a local wireless router, usually faster and without data-plan limits, but restricted to the router's range. Mobile data connects through a cellular network via a SIM card, giving internet access anywhere with signal but usually with a data usage limit."}, | |
| {"id": "tech_005", "domain": "tech", "topic": "what is phishing", "content": "Phishing is a cyberattack technique where attackers impersonate a trustworthy source (like a bank or company) via email, SMS, or fake websites to trick people into revealing sensitive information like passwords or card details. Being cautious of unexpected links and verifying sender identity helps prevent it."}, | |
| {"id": "tech_006", "domain": "tech", "topic": "what is two-factor authentication (2FA)", "content": "Two-factor authentication adds a second verification step beyond just a password when logging in, such as a code sent to a phone or generated by an authenticator app. It significantly reduces the risk of unauthorized account access even if a password is stolen."}, | |
| {"id": "tech_007", "domain": "tech", "topic": "what is the difference between Linux and Windows", "content": "Linux is an open-source operating system kernel with many free distributions (like Ubuntu, Debian, Fedora), popular for servers, development, and customization. Windows is a proprietary operating system developed by Microsoft, widely used on personal and business desktop computers with a more unified, closed-source experience."}, | |
| {"id": "tech_008", "domain": "tech", "topic": "what is a VPN", "content": "A VPN (Virtual Private Network) creates an encrypted connection between a device and the internet, routing traffic through a remote server to hide the user's real IP address and location, and protect data on public networks. It's commonly used for privacy, security, or accessing region-restricted content."}, | |
| {"id": "tech_009", "domain": "tech", "topic": "what is cloud storage", "content": "Cloud storage lets users save files on remote servers accessed over the internet (like Google Drive, iCloud, or Dropbox) instead of only on local device storage. This allows access from multiple devices and provides backup if the local device is lost or damaged."}, | |
| {"id": "tech_010", "domain": "tech", "topic": "what is malware", "content": "Malware is any software designed to damage, disrupt, or gain unauthorized access to a computer system, including viruses, ransomware, spyware, and trojans. It commonly spreads through malicious downloads, infected email attachments, or compromised websites."}, | |
| {"id": "tech_011", "domain": "tech", "topic": "what is an IP address", "content": "An IP address is a unique numerical label assigned to each device connected to a network, used to identify and locate it for sending and receiving data. IPv4 addresses look like 192.168.1.1, while the newer IPv6 format supports a vastly larger number of unique addresses."}, | |
| {"id": "tech_012", "domain": "tech", "topic": "what is Bluetooth used for", "content": "Bluetooth is a short-range wireless technology used to connect devices like headphones, speakers, smartwatches, and keyboards without cables, typically working within a range of about 10 meters. It uses less power than Wi-Fi, making it suitable for small battery-powered accessories."}, | |
| {"id": "tech_013", "domain": "tech", "topic": "what is app permission privacy risk", "content": "Granting unnecessary app permissions (like camera or location access for an app that doesn't need it) can expose personal data to misuse by that app or attackers if the app is compromised. Reviewing and restricting permissions periodically, especially for less-trusted apps, reduces this risk."}, | |
| {"id": "tech_014", "domain": "tech", "topic": "what is a software update / patch", "content": "A software update, or patch, is a release that fixes bugs, closes security vulnerabilities, or adds new features to existing software. Keeping devices and apps updated is one of the most effective ways to protect against known security exploits."}, | |
| {"id": "tech_015", "domain": "tech", "topic": "what is on-device AI vs cloud AI", "content": "On-device AI runs directly on a user's phone or computer without needing an internet connection, offering better privacy and offline availability but usually with less processing power than cloud servers. Cloud AI runs on remote servers, allowing larger, more capable models but requiring an internet connection and sending data off the device."} | |
| ] | |