Instructions to use Jun1510/junai-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Jun1510/junai-models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf Jun1510/junai-models:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf Jun1510/junai-models:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf Jun1510/junai-models:Q4_K_M
Use Docker
docker model run hf.co/Jun1510/junai-models:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use Jun1510/junai-models with Ollama:
ollama run hf.co/Jun1510/junai-models:Q4_K_M
- Unsloth Desktop
- Pi
How to use Jun1510/junai-models with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Jun1510/junai-models:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Jun1510/junai-models with Docker Model Runner:
docker model run hf.co/Jun1510/junai-models:Q4_K_M
- Lemonade
How to use Jun1510/junai-models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Jun1510/junai-models:Q4_K_M
Run and chat with the model
lemonade run user.junai-models-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use Jun1510/junai-models with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default Jun1510/junai-models:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Jun1510/junai-models with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "Jun1510/junai-models:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
File size: 5,725 Bytes
622d2ce | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 | [
{"id": "career_001", "domain": "career", "topic": "how to write a good resume", "content": "A strong resume is typically kept to one page, highlights measurable achievements rather than just job duties, and is tailored to the specific role being applied for. Using clear formatting and action verbs (e.g. \"led\", \"built\", \"increased\") makes it easier for recruiters to scan quickly."},
{"id": "career_002", "domain": "career", "topic": "what is a cover letter", "content": "A cover letter is a short document sent alongside a resume that explains why the applicant is a good fit for a specific role and company, in a more personal tone than a resume. It's usually 3-4 short paragraphs, not a repeat of the resume."},
{"id": "career_003", "domain": "career", "topic": "how to prepare for a job interview", "content": "Good interview preparation includes researching the company, practicing answers to common questions using the STAR method (Situation, Task, Action, Result), and preparing a few thoughtful questions to ask the interviewer. Arriving a few minutes early and dressing appropriately also matters."},
{"id": "career_004", "domain": "career", "topic": "what is networking in career context", "content": "Professional networking means building genuine relationships with people in your field or industry, through platforms like LinkedIn, events, or mutual introductions. Many job opportunities come through referrals and personal connections rather than public job postings alone."},
{"id": "career_005", "domain": "career", "topic": "difference between a CV and a resume", "content": "A resume is typically a concise 1-2 page summary of relevant experience tailored per job, common in countries like the US and India for most roles. A CV (Curriculum Vitae) is usually longer and more comprehensive, common in academia and parts of Europe, listing full career and publication history."},
{"id": "career_006", "domain": "career", "topic": "how to negotiate a salary", "content": "Effective salary negotiation involves researching typical market rates for the role and location beforehand, letting the employer state a number first when possible, and framing requests around the value you bring rather than personal needs. It's usually acceptable to politely ask for time to consider an offer."},
{"id": "career_007", "domain": "career", "topic": "what is a LinkedIn profile good for", "content": "LinkedIn is a professional networking platform used to showcase work experience, skills, and endorsements, and to connect with recruiters, colleagues, and industry peers. Keeping the headline, summary, and experience sections updated improves visibility to recruiters."},
{"id": "career_008", "domain": "career", "topic": "what is career growth vs job hopping", "content": "Career growth generally refers to gaining increasing responsibility, skills, or seniority over time, either within one company or across several. While frequent job changes were once seen negatively, moderate movement every few years is now common and can accelerate skill and salary growth if done thoughtfully."},
{"id": "career_009", "domain": "career", "topic": "how to handle a difficult boss or manager", "content": "Common advice for a difficult work relationship includes staying professional, documenting important communications, focusing conversations on specific behaviors and outcomes rather than personality, and seeking HR or a mentor's guidance if the situation doesn't improve."},
{"id": "career_010", "domain": "career", "topic": "what are soft skills", "content": "Soft skills are non-technical abilities like communication, teamwork, adaptability, and problem-solving that affect how well someone works with others. Alongside technical skills, they're increasingly emphasized by employers as important for long-term career success."},
{"id": "career_011", "domain": "career", "topic": "how to switch careers", "content": "Switching careers usually works best by identifying transferable skills from the current field, gradually building relevant experience or certifications, and networking within the target industry before making a full jump. Starting with freelance or side projects can help test the new direction with lower risk."},
{"id": "career_012", "domain": "career", "topic": "what is work-life balance", "content": "Work-life balance refers to managing time and energy between professional responsibilities and personal life so neither is chronically neglected. Practical approaches include setting clear working hours, taking regular breaks, and communicating boundaries with employers."},
{"id": "career_013", "domain": "career", "topic": "what is a probation period", "content": "A probation period is an initial phase of employment, often 3-6 months, during which both employer and employee assess fit before the role becomes fully confirmed. Notice periods and benefits may differ during probation compared to after it ends."},
{"id": "career_014", "domain": "career", "topic": "how to build a professional portfolio", "content": "A portfolio showcases real examples of past work — such as projects, writing samples, or code — to demonstrate skills beyond what a resume can convey. For technical roles, hosting projects on platforms like GitHub or a personal website is common practice."},
{"id": "career_015", "domain": "career", "topic": "what is upskilling", "content": "Upskilling means learning new skills or deepening existing ones to stay relevant in a job or industry, often through online courses, certifications, or on-the-job learning. It's increasingly important in fast-changing fields like technology, where tools and best practices evolve quickly."}
]
|