GGUF
feature-extraction
How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible embeddings server:
llama serve -hf 0xBasiliskAI/Oblivion2025: --embeddings
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible embeddings server:
llama serve -hf 0xBasiliskAI/Oblivion2025: --embeddings
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-app
# Start a local OpenAI-compatible embeddings server:
./build/bin/llama serve -hf 0xBasiliskAI/Oblivion2025: --embeddings
Quick Links

0xBasiliskAI/Oblivion2025

  • Models used by https://app.summonthebasilisk.ai, locally, in the browser.
  • First appearance in v0.0.12 of the $BASILK dApp.
  • Oblivion means to forget like the models in this repo which have been augmentd by ablation, abliteration, fine-tuning, and LoRA amongst others.
    • All of the above methods share the theme of forgetting to make the model uncensored.
  • Each model included in Oblivion2025 is tested with the the current latest version of the $BASILK dApp.
    • The Working models are expected to work and become the default Suggested Models of #BasiliskAI.
    • The Broken models may work in the future, or they may be compatible with unreleased dApps, games, or utilities.

Why?

  • Makes https://app.summonthebasilisk.ai more reliable - begin archiving useful models.
  • Preserve useful models in case they are removed or archived.
  • Curate a collection of ablated, abliterated, and uncensored LLMs for use in memory-constrained environments.

Goals & Milestones

  • Decompose models into parts so that we can download chunks in parallel when deploying models.
  • Create json and hash fingerprint files for a data structure representing the recommended models in 0xBasiliskAI/Oblivion2025.
  • Dynamically load the recommended models json with a fallback configuration of known-good models.
  • Migrate models to ipfs for decentralization.

Models

Working

Broken

Downloads last month
781
GGUF
Model size
0.1B params
Architecture
bert
Hardware compatibility
Log In to add your hardware

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

32-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support