Instructions to use Jun1510/junai-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Jun1510/junai-models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf Jun1510/junai-models:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf Jun1510/junai-models:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf Jun1510/junai-models:Q4_K_M
Use Docker
docker model run hf.co/Jun1510/junai-models:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use Jun1510/junai-models with Ollama:
ollama run hf.co/Jun1510/junai-models:Q4_K_M
- Unsloth Desktop
- Pi
How to use Jun1510/junai-models with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Jun1510/junai-models:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Jun1510/junai-models with Docker Model Runner:
docker model run hf.co/Jun1510/junai-models:Q4_K_M
- Lemonade
How to use Jun1510/junai-models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Jun1510/junai-models:Q4_K_M
Run and chat with the model
lemonade run user.junai-models-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use Jun1510/junai-models with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default Jun1510/junai-models:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Jun1510/junai-models with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "Jun1510/junai-models:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Download knowledge/finance.json from Jun1510/junai-models: direct link, hf CLI and curl.
- Browser
- Download file 5.22 kB
-
https://huggingface.co/Jun1510/junai-models/resolve/main/knowledge/finance.json
- Command line
-
hf download hf://Jun1510/junai-models/knowledge/finance.json
-
curl -L -o finance.json https://huggingface.co/Jun1510/junai-models/resolve/main/knowledge/finance.json
5.22 kB
| [ | |
| {"id": "finance_001", "domain": "finance", "topic": "what is a budget", "content": "A budget is a plan for how income will be spent or saved over a period of time, typically split across categories like essentials, savings, and discretionary spending. A common rule of thumb is the 50/30/20 approach: 50% needs, 30% wants, 20% savings."}, | |
| {"id": "finance_002", "domain": "finance", "topic": "what is compound interest", "content": "Compound interest is interest calculated on both the original amount and the interest already earned, causing savings or debt to grow faster over time compared to simple interest. The earlier money is invested or saved, the more time compounding has to work."}, | |
| {"id": "finance_003", "domain": "finance", "topic": "difference between saving and investing", "content": "Saving typically means putting money aside safely, like in a bank account, with low risk and low growth. Investing means putting money into assets like stocks, mutual funds, or property with the goal of higher growth, but with more risk of loss."}, | |
| {"id": "finance_004", "domain": "finance", "topic": "what is an emergency fund", "content": "An emergency fund is money set aside specifically to cover unexpected expenses like medical bills or job loss, commonly recommended to be around 3-6 months of essential living expenses. It's usually kept in an easily accessible account rather than invested."}, | |
| {"id": "finance_005", "domain": "finance", "topic": "what is a credit score", "content": "A credit score is a numerical rating of how likely a person is to repay borrowed money, based on factors like payment history, amount owed, and length of credit history. A higher score generally makes it easier to get loans at better interest rates."}, | |
| {"id": "finance_006", "domain": "finance", "topic": "what is a mutual fund", "content": "A mutual fund pools money from many investors to buy a diversified mix of stocks, bonds, or other assets, managed by a professional fund manager. This lets individual investors access diversification without having to pick every investment themselves."}, | |
| {"id": "finance_007", "domain": "finance", "topic": "what is inflation", "content": "Inflation is the general rise in prices of goods and services over time, which reduces the purchasing power of money. Moderate inflation is normal in most economies, but high inflation erodes savings and makes budgeting harder."}, | |
| {"id": "finance_008", "domain": "finance", "topic": "what is a SIP (systematic investment plan)", "content": "A SIP is a way of investing a fixed amount regularly (like monthly) into a mutual fund, rather than investing a lump sum at once. It's a popular method in India for building long-term wealth through disciplined, averaged-out investing."}, | |
| {"id": "finance_009", "domain": "finance", "topic": "what is the stock market", "content": "The stock market is where shares (small ownership pieces) of publicly listed companies are bought and sold. Prices move based on company performance, investor sentiment, and broader economic conditions."}, | |
| {"id": "finance_010", "domain": "finance", "topic": "what is a loan EMI", "content": "EMI stands for Equated Monthly Installment — a fixed payment amount a borrower pays each month toward a loan, covering both principal and interest, until the loan is fully repaid. EMI amount depends on loan size, interest rate, and repayment tenure."}, | |
| {"id": "finance_011", "domain": "finance", "topic": "what is tax saving investment", "content": "Tax-saving investments are financial instruments that offer deductions or exemptions under tax law, such as retirement funds, certain insurance policies, or specific savings schemes, depending on the country's tax rules. In India, common examples include PPF, ELSS mutual funds, and life insurance under Section 80C."}, | |
| {"id": "finance_012", "domain": "finance", "topic": "what is diversification in investing", "content": "Diversification means spreading investments across different assets, sectors, or geographies to reduce the risk of losing money if one investment performs poorly. The idea is that not everything is likely to fall in value at the same time."}, | |
| {"id": "finance_013", "domain": "finance", "topic": "what is a fixed deposit", "content": "A fixed deposit (FD) is a savings option where a lump sum is deposited with a bank for a fixed period at a fixed interest rate, generally offering safer but lower returns than market investments. Withdrawing early usually incurs a penalty."}, | |
| {"id": "finance_014", "domain": "finance", "topic": "what is net worth", "content": "Net worth is the total value of everything a person owns (assets like savings, property, investments) minus everything they owe (liabilities like loans and debts). It's a common way to track overall financial health over time."}, | |
| {"id": "finance_015", "domain": "finance", "topic": "what is a credit card vs debit card", "content": "A debit card spends money directly from a linked bank account, while a credit card lets the holder borrow money up to a limit, which must be repaid later, often with interest if not paid in full each cycle. Credit cards can help build credit history when used responsibly."} | |
| ] | |