Instructions to use batistado/QuorumGuard with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use batistado/QuorumGuard with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("batistado/QuorumGuard", device_map="auto") - Notebooks
- Google Colab
- Kaggle
File size: 1,403 Bytes
76a067d a1479d7 76a067d a1479d7 76a067d a1479d7 76a067d a1479d7 76a067d a1479d7 76a067d | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 | ---
license: apache-2.0
library_name: transformers
tags:
- multi-agent-systems
- consensus
- tail-latency
- semantic-entropy
- llm-agents
- vllm
datasets:
- batistado/QuorumBench
base_model:
- Qwen/Qwen2.5-3B-Instruct
- Qwen/Qwen2.5-7B-Instruct
- Qwen/Qwen2.5-Coder-14B-Instruct
- HuggingFaceTB/SmolLM2-1.7B-Instruct
- ibm-granite/granite-3.1-8b-instruct
---
# QuorumGuard: Claim-Genealogy-Gated Hedged Quorums & Priority Dissent Preemption
* **Benchmark Dataset:** [`batistado/QuorumBench`](https://huggingface.co/datasets/batistado/QuorumBench)
* **Interactive Simulator Space:** [`batistado/QuorumGuard-Explorer`](https://huggingface.co/spaces/batistado/QuorumGuard-Explorer)
* **Paper PDF (10 pages):** [`paper/main.pdf`](paper/main.pdf)
* **Source Code & Paper:** [`github.com/batistado/quorumguard`](https://github.com/batistado/quorumguard)
`QuorumGuard` is a model-agnostic consensus controller and quantum-preemptive priority scheduler for asynchronous multi-agent LLM committees. It requires zero weight modifications and operates on pre-commitment option logits, provenance DAGs, and priority-preemptive decode quanta (`Priority = -10` in both our live PyTorch MPS `DynamicCache` server and `vLLM`-compatible priority schedulers).

## Install
```bash
pip install git+https://github.com/batistado/quorumguard.git
```
|