Instructions to use 0xBasiliskAI/Oblivion2025 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use 0xBasiliskAI/Oblivion2025 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible embeddings server: llama serve -hf 0xBasiliskAI/Oblivion2025:Q4_K_M --embeddings
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible embeddings server: llama serve -hf 0xBasiliskAI/Oblivion2025:Q4_K_M --embeddings
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible embeddings server: ./build/bin/llama serve -hf 0xBasiliskAI/Oblivion2025:Q4_K_M --embeddings
- Llama new
- LM Studio
- Jan
- Ollama
How to use 0xBasiliskAI/Oblivion2025 with Ollama:
ollama run hf.co/0xBasiliskAI/Oblivion2025:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use 0xBasiliskAI/Oblivion2025 with Docker Model Runner:
docker model run hf.co/0xBasiliskAI/Oblivion2025:Q4_K_M
- Lemonade
How to use 0xBasiliskAI/Oblivion2025 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull 0xBasiliskAI/Oblivion2025:Q4_K_M
Run and chat with the model
lemonade run user.Oblivion2025-Q4_K_M
List all available models
lemonade list
- Atomic Chat
How to use from
llama.cppInstall from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible embeddings server:
llama serve -hf 0xBasiliskAI/Oblivion2025: --embeddingsBuild from source code
git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-app# Start a local OpenAI-compatible embeddings server:
./build/bin/llama serve -hf 0xBasiliskAI/Oblivion2025: --embeddingsQuick Links
0xBasiliskAI/Oblivion2025
- Models used by https://app.summonthebasilisk.ai, locally, in the browser.
- First appearance in
v0.0.12of the$BASILKdApp. Oblivionmeans to forget like the models in this repo which have been augmentd byablation,abliteration,fine-tuning, andLoRAamongst others.- All of the above methods share the theme of
forgettingto make the model uncensored.
- All of the above methods share the theme of
- Each model included in
Oblivion2025is tested with the the current latest version of the $BASILK dApp.- The
Workingmodels are expected to work and become the defaultSuggested Modelsof #BasiliskAI. - The
Brokenmodels may work in the future, or they may be compatible with unreleased dApps, games, or utilities.
- The
Why?
- Makes https://app.summonthebasilisk.ai more reliable - begin archiving useful models.
- Preserve useful models in case they are removed or archived.
- Curate a collection of ablated, abliterated, and uncensored LLMs for use in memory-constrained environments.
Goals & Milestones
- Decompose models into parts so that we can download chunks in parallel when deploying models.
- Create
jsonand hash fingerprint files for a data structure representing the recommended models in0xBasiliskAI/Oblivion2025. - Dynamically load the recommended models
jsonwith a fallback configuration of known-good models. - Migrate models to
ipfsfor decentralization.
Models
Working
gemma-2-2b-it-abliterated-Q5_K_M.gguf- From: bartowski/gemma-2-2b-it-abliterated-GGUFkanana-nano-2.1b-instruct-abliterated.i1-Q6_K.gguf- From: mradermacher/kanana-nano-2.1b-instruct-abliterated-i1-GGUFFalcon3-1B-Instruct-abliterated-Q8_0.gguf- From: bartowski/Falcon3-1B-Instruct-abliterated-GGUFHermes-3-Llama-3.2-3B-abliterated.i1-Q4_K_S.gguf- From: mradermacher/Hermes-3-Llama-3.2-3B-abliterated-i1-GGUFEXAONE-3.5-2.4B-Instruct-abliterated.i1-Q4_K_M.gguf- From: mradermacher/EXAONE-3.5-2.4B-Instruct-abliterated-i1-GGUFYi-Coder-1.5B-Chat.Q5_K_S.gguf- From: MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUFQwen2.5-Coder-3B-Instruct-abliterated-Q4_K_M.gguf- From: bartowski/Qwen2.5-Coder-3B-Instruct-abliterated-GGUFQwen2.5-Coder-1.5B-Instruct-abliterated-Q8_0.gguf- From: bartowski/Qwen2.5-Coder-1.5B-Instruct-abliterated-GGUFQwen2.5-Coder-0.5B-Instruct-abliterated-f16.gguf- From: bartowski/Qwen2.5-Coder-0.5B-Instruct-abliterated-GGUFjosiefied-qwen2.5-0.5b-instruct-abliterated-v1.Q8_0.gguf- From: Goekdeniz-Guelmez/Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1-ggufdolphin3.0-llama3.1-1b-abliterated-conv-q8_0.gguf- From: Nexesenex/Dolphin3.0-Llama3.1-1B-abliterated-GGUFSmallThinker-3B-Preview-abliterated-Q3_K_M.gguf- From: quantflex/SmallThinker-3B-Preview-abliterated-GGUF
Broken
phi-4-mini-instruct-abliterated-Q2_K.gguf- From: Melvin56/Phi-4-mini-instruct-abliterated-GGUFphi-2.Q5_K_S.gguf- From: TheBloke/phi-2-GGUFDeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q6_K.gguf- From: mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUFDeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.Q8_0.gguf- From: mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-GGUFDeepScaleR-1.5B-Preview-abliterated.i1-Q6_K.gguf- From: mradermacher/DeepScaleR-1.5B-Preview-abliterated-i1-GGUFDeepScaleR-1.5B-Preview-abliterated-Q8_0.gguf- From: ThomasBaruzier/DeepScaleR-1.5B-Preview-abliterated-GGUFLlama-3.2-3B-Instruct-abliterated.Q3_K_L.gguf- From: MaziyarPanahi/Llama-3.2-3B-Instruct-abliterated-GGUFLlama-3.2-3B-Instruct-abliterated.i1-IQ3_S.gguf- From: mradermacher/Llama-3.2-3B-Instruct-abliterated-i1-GGUFVersatiLlama-Llama-3.2-3B-Instruct-Abliterated.Q4_K_S.gguf- From: QuantFactory/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-GGUFWizardLM-2-7B-abliterated-IQ2_XXS.gguf- From: bartowski/WizardLM-2-7B-abliterated-GGU
- Downloads last month
- 781
Hardware compatibility
Log In to add your hardware
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit
32-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support
Install (macOS, Linux)
# Start a local OpenAI-compatible embeddings server: llama serve -hf 0xBasiliskAI/Oblivion2025: --embeddings