Instructions to use 0xBasiliskAI/Oblivion2025 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use 0xBasiliskAI/Oblivion2025 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible embeddings server: llama serve -hf 0xBasiliskAI/Oblivion2025:Q4_K_M --embeddings
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible embeddings server: llama serve -hf 0xBasiliskAI/Oblivion2025:Q4_K_M --embeddings
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible embeddings server: ./build/bin/llama serve -hf 0xBasiliskAI/Oblivion2025:Q4_K_M --embeddings
- Llama new
- LM Studio
- Jan
- Ollama
How to use 0xBasiliskAI/Oblivion2025 with Ollama:
ollama run hf.co/0xBasiliskAI/Oblivion2025:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use 0xBasiliskAI/Oblivion2025 with Docker Model Runner:
docker model run hf.co/0xBasiliskAI/Oblivion2025:Q4_K_M
- Lemonade
How to use 0xBasiliskAI/Oblivion2025 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull 0xBasiliskAI/Oblivion2025:Q4_K_M
Run and chat with the model
lemonade run user.Oblivion2025-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Commit History
-
feat: Upload bge-base-en-v1.5-* embedding models
Verified signature94344a0
-
maint: updating README.md with results of LLM testing against dApp v0.0.12
Verified signaturef040ab8 -
maint: updating README.md with top-level context
Verified signature7b61908 -
maint: updating README.md with Goals & Milestones
Verified signature65898b5 -
maint: updating README.md with new repo name
Verified signaturede20065 -
maint: updating README.md
Verified signature7c085fa -
feat: adding SmallThinker-3B-Preview-abliterated-Q3_K_M.gguf
Verified signature1a6febd -
maint: updating README.md
Verified signature6a2ddca -
feat: adding EXAONE-3.5-2.4B-Instruct-abliterated.i1-Q4_K_M.gguf
Verified signature43d3112 -
maint: updating README.md
Verified signature121460a -
feat: adding DeepScaleR-1.5B-Preview-abliterated.i1-Q6_K.gguf
Verified signature805f44a -
maint: updating README.md
Verified signature9245c35 -
feat: adding dolphin3.0-llama3.1-1b-abliterated-conv-q8_0.gguf
Verified signature6cb0638 -
maint: updating README.md
Verified signature60f01ab -
feat: adding Falcon3-1B-Instruct-abliterated-Q8_0.gguf
Verified signature595f6dc -
maint: updating README.md
Verified signature373dfc7 -
maint: adding josiefied-qwen2.5-0.5b-instruct-abliterated-v1.Q8_0.gguf
Verified signatureec7903c -
maint: updating README.md
Verified signature3fef2f5 -
feat: adding DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q6_K.gguf
Verified signature3ecd40a -
maint: updating README.md
Verified signature4ce8bbe -
feat: adding DeepScaleR-1.5B-Preview-abliterated-Q8_0.gguf
Verified signatureb786c14 -
maint: updating README.md
Verified signature126a545 -
feat: adding phi-4-mini-instruct-abliterated-Q2_K.gguf
Verified signature1738f02 -
maint: updating README.md
Verified signature8c97850 -
maint: updating README.md
Verified signature00e75af -
feat: adding WizardLM-2-7B-abliterated-IQ2_XXS.gguf
Verified signature22b6928 -
maint: updating README.md
Verified signature55c7bd6 -
feat: adding Hermes-3-Llama-3.2-3B-abliterated.i1-Q4_K_S.gguf
Verified signaturef654306 -
maint: updating README.md
Verified signatured3dc6c7 -
feat: adding Llama-3.2-3B-Instruct-abliterated.Q3_K_L.gguf
Verified signature5e25e9e -
maint: updating README.md
Verified signature5986967 -
feat: adding Llama-3.2-3B-Instruct-abliterated.i1-IQ3_S.gguf
Verified signature0eb6c7e -
maint: updating README.md
Verified signatureef2d7ae -
feat: adding Qwen2.5-Coder-0.5B-Instruct-abliterated-f16.gguf
Verified signaturea2c46b0 -
maint: updating README.md
Verified signature6eb3b2b -
maint: updating README.md
Verified signature68c8783 -
maint: updating README.md
Verified signature46bedfc -
feat: adding Qwen2.5-Coder-1.5B-Instruct-abliterated-Q8_0.gguf
Verified signature32dc2e5 -
maint: updating README.md
Verified signature79bb762 -
feat: adding kanana-nano-2.1b-instruct-abliterated.i1-Q6_K.gguf
Verified signature526e266 -
maint: updating README.md
Verified signature9f98f65 -
feat: adding Qwen2.5-Coder-3B-Instruct-abliterated-Q4_K_M.gguf
Verified signature4d69b93 -
Update README.md
Verified signature233025b -
feat: adding DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.Q8_0.gguf
Verified signaturedbd9b80 -
maint: updating README.md
Verified signatureea34a3c -
feat: adding VersatiLlama-Llama-3.2-3B-Instruct-Abliterated.Q4_K_S.gguf
Verified signatureff7e81d -
maint: updating README.md
Verified signature8dfba7e -
feat: adding gemma-2-2b-it-abliterated-Q5_K_M.gguf
Verified signature46186b6 -
maint: updated README.md
Verified signature64b32a6 -
feat: adding Yi-Coder-1.5B-Chat.Q5_K_S.gguf
Verified signature9841a6b