Instructions to use Jun1510/junai-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Jun1510/junai-models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf Jun1510/junai-models:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf Jun1510/junai-models:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf Jun1510/junai-models:Q4_K_M
Use Docker
docker model run hf.co/Jun1510/junai-models:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use Jun1510/junai-models with Ollama:
ollama run hf.co/Jun1510/junai-models:Q4_K_M
- Unsloth Desktop
- Pi
How to use Jun1510/junai-models with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Jun1510/junai-models:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Jun1510/junai-models with Docker Model Runner:
docker model run hf.co/Jun1510/junai-models:Q4_K_M
- Lemonade
How to use Jun1510/junai-models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Jun1510/junai-models:Q4_K_M
Run and chat with the model
lemonade run user.junai-models-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use Jun1510/junai-models with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default Jun1510/junai-models:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Jun1510/junai-models with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "Jun1510/junai-models:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
File size: 5,515 Bytes
622d2ce | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 | [
{"id": "edu_001", "domain": "education", "topic": "what is Newton's first law of motion", "content": "Newton's first law states that an object at rest stays at rest, and an object in motion stays in motion at constant velocity, unless acted upon by an external force. It's also known as the law of inertia."},
{"id": "edu_002", "domain": "education", "topic": "what is photosynthesis", "content": "Photosynthesis is the process by which plants, algae, and some bacteria convert sunlight, water, and carbon dioxide into glucose (energy) and oxygen. It mainly takes place in the chloroplasts of plant cells using the pigment chlorophyll."},
{"id": "edu_003", "domain": "education", "topic": "what is the Pythagorean theorem", "content": "The Pythagorean theorem states that in a right-angled triangle, the square of the hypotenuse (the longest side) equals the sum of the squares of the other two sides: a² + b² = c². It's a fundamental relationship used throughout geometry and trigonometry."},
{"id": "edu_004", "domain": "education", "topic": "what are the three states of matter", "content": "The three classical states of matter are solid, liquid, and gas, distinguished by how tightly and freely their particles are arranged and how they move. A fourth state, plasma, also exists and is common in stars and lightning."},
{"id": "edu_005", "domain": "education", "topic": "what is the difference between an acid and a base", "content": "An acid is a substance that releases hydrogen ions (H+) in water and has a pH below 7, while a base releases hydroxide ions (OH-) and has a pH above 7. A pH of exactly 7 is considered neutral, like pure water."},
{"id": "edu_006", "domain": "education", "topic": "what caused World War I", "content": "World War I (1914-1918) was triggered by the assassination of Archduke Franz Ferdinand of Austria-Hungary in 1914, but underlying causes included militarism, alliance systems, imperial rivalries, and nationalism among European powers. It involved most of the world's great powers and ended with the Treaty of Versailles."},
{"id": "edu_007", "domain": "education", "topic": "what is DNA", "content": "DNA (deoxyribonucleic acid) is the molecule that carries genetic instructions for the development and functioning of living organisms, structured as a double helix made of nucleotide base pairs. It's found in nearly every cell and is passed from parents to offspring."},
{"id": "edu_008", "domain": "education", "topic": "what is the water cycle", "content": "The water cycle describes the continuous movement of water through evaporation (water turning to vapor), condensation (vapor forming clouds), precipitation (rain or snow falling), and collection (water gathering in rivers, lakes, and oceans). It's driven mainly by solar energy and gravity."},
{"id": "edu_009", "domain": "education", "topic": "what is India's freedom struggle briefly", "content": "India's independence movement against British colonial rule spanned roughly from the late 1800s to 1947, involving figures like Mahatma Gandhi, Jawaharlal Nehru, and Bhagat Singh, and methods ranging from non-violent civil disobedience to armed resistance. India gained independence on 15 August 1947."},
{"id": "edu_010", "domain": "education", "topic": "what is a chemical equation balancing", "content": "Balancing a chemical equation means adjusting the coefficients (numbers in front of compounds) so the number of atoms of each element is equal on both the reactant and product sides, following the law of conservation of mass. This ensures atoms are neither created nor destroyed in the reaction."},
{"id": "edu_011", "domain": "education", "topic": "what is the human circulatory system", "content": "The circulatory system pumps blood through the body via the heart, arteries, veins, and capillaries, delivering oxygen and nutrients to tissues and removing waste like carbon dioxide. The heart has four chambers and beats roughly 60-100 times per minute at rest in adults."},
{"id": "edu_012", "domain": "education", "topic": "what is a noun, verb, and adjective in grammar", "content": "A noun names a person, place, thing, or idea (e.g. \"dog\", \"city\"); a verb describes an action or state (e.g. \"run\", \"is\"); and an adjective describes or modifies a noun (e.g. \"happy\", \"blue\"). These are three of the basic parts of speech in English grammar."},
{"id": "edu_013", "domain": "education", "topic": "what is the periodic table", "content": "The periodic table organizes all known chemical elements by increasing atomic number, arranged so elements with similar properties fall into the same column (group). It was first proposed by Dmitri Mendeleev in 1869 and remains a foundational tool in chemistry."},
{"id": "edu_014", "domain": "education", "topic": "what is gravity in basic physics terms", "content": "Gravity is the force of attraction between any two masses, with strength depending on their mass and the distance between them, as described by Newton's law of universal gravitation. On Earth, gravity gives objects a constant acceleration of about 9.8 m/s²."},
{"id": "edu_015", "domain": "education", "topic": "what is the difference between mitosis and meiosis", "content": "Mitosis is cell division that produces two genetically identical daughter cells, used for growth and repair. Meiosis produces four genetically varied cells with half the chromosome number, used specifically for creating sperm and egg cells in sexual reproduction."}
]
|