Instructions to use Jun1510/junai-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Jun1510/junai-models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf Jun1510/junai-models:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf Jun1510/junai-models:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf Jun1510/junai-models:Q4_K_M
Use Docker
docker model run hf.co/Jun1510/junai-models:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use Jun1510/junai-models with Ollama:
ollama run hf.co/Jun1510/junai-models:Q4_K_M
- Unsloth Desktop
- Pi
How to use Jun1510/junai-models with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Jun1510/junai-models:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Jun1510/junai-models with Docker Model Runner:
docker model run hf.co/Jun1510/junai-models:Q4_K_M
- Lemonade
How to use Jun1510/junai-models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Jun1510/junai-models:Q4_K_M
Run and chat with the model
lemonade run user.junai-models-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use Jun1510/junai-models with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default Jun1510/junai-models:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Jun1510/junai-models with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "Jun1510/junai-models:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Download knowledge/programming.json from Jun1510/junai-models: direct link, hf CLI and curl.
- Browser
- Download file 5.79 kB
-
https://huggingface.co/Jun1510/junai-models/resolve/main/knowledge/programming.json
- Command line
-
hf download hf://Jun1510/junai-models/knowledge/programming.json
-
curl -L -o programming.json https://huggingface.co/Jun1510/junai-models/resolve/main/knowledge/programming.json
5.79 kB
| [ | |
| {"id": "prog_001", "domain": "programming", "topic": "what is Kotlin used for", "content": "Kotlin is a modern, statically-typed programming language that runs on the Java Virtual Machine (JVM) and is Google's preferred language for Android app development. It's designed to be fully interoperable with Java while offering more concise, safer syntax."}, | |
| {"id": "prog_002", "domain": "programming", "topic": "what is a variable in programming", "content": "A variable is a named storage location in a program that holds a value, which can often be changed while the program runs. Most languages require or allow specifying a data type (like integer, string, or boolean) for what kind of value a variable can hold."}, | |
| {"id": "prog_003", "domain": "programming", "topic": "what is a function in programming", "content": "A function is a reusable block of code that performs a specific task, often taking input values (parameters) and returning an output. Functions help organize code, avoid repetition, and make programs easier to read and maintain."}, | |
| {"id": "prog_004", "domain": "programming", "topic": "difference between Java and Kotlin", "content": "Java and Kotlin both run on the JVM and are largely interoperable, but Kotlin offers more concise syntax, built-in null-safety to reduce crashes, and modern features like coroutines for asynchronous code. Kotlin has become the preferred language for new Android development since Google announced it as first-class in 2017."}, | |
| {"id": "prog_005", "domain": "programming", "topic": "what is an API", "content": "An API (Application Programming Interface) is a defined set of rules that lets different software programs communicate with each other, such as an app fetching data from a server. APIs define what requests can be made and what responses to expect, without exposing the internal code."}, | |
| {"id": "prog_006", "domain": "programming", "topic": "what is Git used for", "content": "Git is a distributed version control system used to track changes in code over time, allowing multiple people to collaborate, revert changes, and manage different versions (branches) of a project. GitHub is a popular cloud platform for hosting Git repositories."}, | |
| {"id": "prog_007", "domain": "programming", "topic": "what is a bug vs a crash in software", "content": "A bug is any unintended behavior or error in a program's logic that causes it to act incorrectly. A crash is a more severe failure where the program stops running entirely, often due to an unhandled exception or a fatal error like accessing invalid memory."}, | |
| {"id": "prog_008", "domain": "programming", "topic": "what is object-oriented programming", "content": "Object-oriented programming (OOP) is a programming approach that organizes code around \"objects\" containing both data (properties) and behavior (methods), often modeled using classes. Core concepts include encapsulation, inheritance, and polymorphism."}, | |
| {"id": "prog_009", "domain": "programming", "topic": "what is a coroutine in Kotlin", "content": "A coroutine is a Kotlin feature for writing asynchronous, non-blocking code in a sequential style, commonly used for tasks like network calls or database operations without freezing the app's main thread. It's lighter weight than traditional threads, allowing many coroutines to run concurrently with less overhead."}, | |
| {"id": "prog_010", "domain": "programming", "topic": "what is JSON", "content": "JSON (JavaScript Object Notation) is a lightweight, human-readable text format for storing and exchanging structured data, using key-value pairs and arrays. It's widely used for sending data between apps and servers, and for configuration files, because it's easy for both humans and machines to parse."}, | |
| {"id": "prog_011", "domain": "programming", "topic": "what is an SDK", "content": "An SDK (Software Development Kit) is a collection of tools, libraries, and documentation that developers use to build applications for a specific platform, like the Android SDK for building Android apps. It typically includes APIs, sample code, and testing/debugging tools."}, | |
| {"id": "prog_012", "domain": "programming", "topic": "what is version control branching", "content": "Branching in version control (like Git) lets developers create a separate line of development from the main codebase, so new features or fixes can be worked on without affecting the stable version. Branches are typically merged back into the main branch once the work is tested and complete."}, | |
| {"id": "prog_013", "domain": "programming", "topic": "what is a null pointer / null safety", "content": "A null reference (or null pointer) error happens when code tries to use a variable that has no assigned value, often causing a crash. Kotlin has built-in null safety, requiring developers to explicitly mark variables as nullable, which helps catch many such errors at compile time rather than at runtime."}, | |
| {"id": "prog_014", "domain": "programming", "topic": "what is CI/CD", "content": "CI/CD stands for Continuous Integration and Continuous Deployment (or Delivery) — a practice of automatically building, testing, and sometimes deploying code changes whenever new code is pushed to a repository. GitHub Actions is a common tool used to set up CI/CD pipelines directly within a GitHub repository."}, | |
| {"id": "prog_015", "domain": "programming", "topic": "what is an IDE", "content": "An IDE (Integrated Development Environment) is software that combines a code editor, debugger, and build tools in one place to make writing and testing software easier. Android Studio is the official IDE for Android development, though developers can also work with lighter editors or, in constrained setups, directly through web-based tools like GitHub's mobile editor."} | |
| ] | |