Instructions to use Aliguinga01/rule_violation2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Aliguinga01/rule_violation2 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Aliguinga01/rule_violation2:F16 # Run inference directly in the terminal: llama cli -hf Aliguinga01/rule_violation2:F16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Aliguinga01/rule_violation2:F16 # Run inference directly in the terminal: llama cli -hf Aliguinga01/rule_violation2:F16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Aliguinga01/rule_violation2:F16 # Run inference directly in the terminal: ./llama-cli -hf Aliguinga01/rule_violation2:F16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Aliguinga01/rule_violation2:F16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf Aliguinga01/rule_violation2:F16
Use Docker
docker model run hf.co/Aliguinga01/rule_violation2:F16
- LM Studio
- Jan
- Ollama
How to use Aliguinga01/rule_violation2 with Ollama:
ollama run hf.co/Aliguinga01/rule_violation2:F16
- Unsloth Studio
How to use Aliguinga01/rule_violation2 with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Aliguinga01/rule_violation2 to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Aliguinga01/rule_violation2 to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for Aliguinga01/rule_violation2 to start chatting
- Docker Model Runner
How to use Aliguinga01/rule_violation2 with Docker Model Runner:
docker model run hf.co/Aliguinga01/rule_violation2:F16
- Lemonade
How to use Aliguinga01/rule_violation2 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Aliguinga01/rule_violation2:F16
Run and chat with the model
lemonade run user.rule_violation2-F16
List all available models
lemonade list
- Atomic Chat
| # llama.cpp Web UI | |
| A modern, feature-rich web interface for llama.cpp built with SvelteKit. This UI provides an intuitive chat interface with advanced file handling, conversation management, and comprehensive model interaction capabilities. | |
| ## Features | |
| - **Modern Chat Interface** - Clean, responsive design with dark/light mode | |
| - **File Attachments** - Support for images, text files, PDFs, and audio with rich previews and drag-and-drop support | |
| - **Conversation Management** - Create, edit, branch, and search conversations | |
| - **Advanced Markdown** - Code highlighting, math formulas (KaTeX), and content blocks | |
| - **Reasoning Content** - Support for models with thinking blocks | |
| - **Keyboard Shortcuts** - Keyboard navigation (Shift+Ctrl/Cmd+O for new chat, Shift+Ctrl/Cmdt+E for edit conversation, Shift+Ctrl/Cmdt+D for delete conversation, Ctrl/Cmd+K for search, Ctrl/Cmd+V for paste, Ctrl/Cmd+B for opening/collapsing sidebar) | |
| - **Request Tracking** - Monitor processing with slots endpoint integration | |
| - **UI Testing** - Storybook component library with automated tests | |
| ## Development | |
| Install dependencies: | |
| ```bash | |
| npm install | |
| ``` | |
| Start the development server + Storybook: | |
| ```bash | |
| npm run dev | |
| ``` | |
| This will start both the SvelteKit dev server and Storybook on port 6006. | |
| ## Building | |
| Create a production build: | |
| ```bash | |
| npm run build | |
| ``` | |
| The build outputs static files to `../public` directory for deployment with llama.cpp server. | |
| ## Testing | |
| Run the test suite: | |
| ```bash | |
| # E2E tests | |
| npm run test:e2e | |
| # Unit tests | |
| npm run test:unit | |
| # UI tests | |
| npm run test:ui | |
| # All tests | |
| npm run test | |
| ``` | |
| ## Architecture | |
| - **Framework**: SvelteKit with Svelte 5 runes | |
| - **Components**: ShadCN UI + bits-ui design system | |
| - **Database**: IndexedDB with Dexie for local storage | |
| - **Build**: Static adapter for deployment with llama.cpp server | |
| - **Testing**: Playwright (E2E) + Vitest (unit) + Storybook (components) | |