Instructions to use Jun1510/junai-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Jun1510/junai-models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf Jun1510/junai-models:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf Jun1510/junai-models:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Jun1510/junai-models:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf Jun1510/junai-models:Q4_K_M
Use Docker
docker model run hf.co/Jun1510/junai-models:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use Jun1510/junai-models with Ollama:
ollama run hf.co/Jun1510/junai-models:Q4_K_M
- Unsloth Desktop
- Pi
How to use Jun1510/junai-models with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Jun1510/junai-models:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Jun1510/junai-models with Docker Model Runner:
docker model run hf.co/Jun1510/junai-models:Q4_K_M
- Lemonade
How to use Jun1510/junai-models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Jun1510/junai-models:Q4_K_M
Run and chat with the model
lemonade run user.junai-models-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use Jun1510/junai-models with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default Jun1510/junai-models:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Jun1510/junai-models with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Jun1510/junai-models:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "Jun1510/junai-models:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
File size: 5,338 Bytes
622d2ce | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 | [
{"id": "films_001", "domain": "films", "topic": "what is Bollywood", "content": "Bollywood is the informal name for the Hindi-language film industry based in Mumbai, India, known for its blend of drama, music, and dance. It's one of the largest film industries in the world by number of films produced annually."},
{"id": "films_002", "domain": "films", "topic": "what are the major film award ceremonies", "content": "Major film award ceremonies include the Academy Awards (Oscars) in the US, the Filmfare Awards for Hindi cinema in India, the Cannes Film Festival awards in France, and the BAFTAs in the UK. Each recognizes achievements in acting, directing, writing, and technical filmmaking."},
{"id": "films_003", "domain": "films", "topic": "what is a film genre", "content": "A film genre is a category defined by shared storytelling elements, tone, or style — common examples include action, comedy, drama, horror, romance, thriller, and science fiction. Many films blend multiple genres, like a romantic comedy or an action-thriller."},
{"id": "films_004", "domain": "films", "topic": "difference between a director and a producer", "content": "A director is responsible for the creative and artistic vision of a film — guiding actors, camera work, and overall storytelling. A producer generally oversees the business side, including financing, budgeting, scheduling, and coordinating the production."},
{"id": "films_005", "domain": "films", "topic": "what is a box office collection", "content": "Box office collection refers to the total revenue a film earns from ticket sales in theaters, often tracked separately by opening weekend, domestic market, and worldwide totals. It's a common way to measure a film's commercial success."},
{"id": "films_006", "domain": "films", "topic": "what is an OTT platform", "content": "OTT (Over-The-Top) platforms are streaming services that deliver film and TV content directly over the internet, bypassing traditional cable or satellite TV. Examples include Netflix, Amazon Prime Video, Disney+ Hotstar, and JioCinema."},
{"id": "films_007", "domain": "films", "topic": "what is a film franchise", "content": "A film franchise is a series of related movies that share characters, settings, or a continuing story, often released over many years. Well-known examples include the Marvel Cinematic Universe, Star Wars, and in Indian cinema, series built around recurring characters or universes."},
{"id": "films_008", "domain": "films", "topic": "what does IMDb rating mean", "content": "IMDb (Internet Movie Database) is a widely used online database of films, TV shows, and their cast/crew, and its user rating is an average score out of 10 given by registered users. It's a popular general reference but reflects audience opinion rather than professional critical consensus alone."},
{"id": "films_009", "domain": "films", "topic": "what is a biopic", "content": "A biopic (biographical picture) is a film that dramatizes the life of a real person, often a historical, public, or notable figure. Biopics may take creative liberties with events for storytelling purposes while being based on real history."},
{"id": "films_010", "domain": "films", "topic": "what is VFX in filmmaking", "content": "VFX (Visual Effects) refers to imagery created or manipulated digitally, outside of live-action filming, used for things like creatures, explosions, or environments that would be impractical or impossible to film directly. It's distinct from practical effects, which are done physically on set."},
{"id": "films_011", "domain": "films", "topic": "what is a film's runtime significance", "content": "A film's runtime is its total length, which varies widely — most feature films run roughly 90 to 180 minutes. Runtime alone doesn't indicate quality, but pacing relative to story content is often discussed by critics."},
{"id": "films_012", "domain": "films", "topic": "what is a sequel vs a prequel", "content": "A sequel is a film that continues the story after the events of an earlier film, while a prequel tells a story set before the events of the original, often explaining backstory. Both are common ways studios expand a popular film into a larger series."},
{"id": "films_013", "domain": "films", "topic": "what is playback singing in Indian cinema", "content": "Playback singing is a technique in Indian cinema where a professional singer records a song that an on-screen actor then lip-syncs to during filming. This has been a defining feature of Bollywood and other Indian film industries for decades."},
{"id": "films_014", "domain": "films", "topic": "what is a film adaptation", "content": "A film adaptation is a movie based on material originally created in another medium, such as a novel, play, true story, or video game. Adaptations often change details from the source material to fit the film format and runtime."},
{"id": "films_015", "domain": "films", "topic": "what does a film certificate/rating mean", "content": "Film certification ratings (like U, U/A, A in India, or G, PG, PG-13, R in the US) indicate the suitability of a film's content for different age groups, based on factors like violence, language, or adult themes. Ratings are typically assigned by a national or regional certification board before release."}
]
|