QuorumGuard / README.md
batistado's picture
Publish QuorumGuard controller & vLLM priority-preemption package
a1479d7 verified
|
Raw History Blame Contribute Delete
1.4 kB
---
license: apache-2.0
library_name: transformers
tags:
- multi-agent-systems
- consensus
- tail-latency
- semantic-entropy
- llm-agents
- vllm
datasets:
- batistado/QuorumBench
base_model:
- Qwen/Qwen2.5-3B-Instruct
- Qwen/Qwen2.5-7B-Instruct
- Qwen/Qwen2.5-Coder-14B-Instruct
- HuggingFaceTB/SmolLM2-1.7B-Instruct
- ibm-granite/granite-3.1-8b-instruct
---
# QuorumGuard: Claim-Genealogy-Gated Hedged Quorums & Priority Dissent Preemption
* **Benchmark Dataset:** [`batistado/QuorumBench`](https://huggingface.co/datasets/batistado/QuorumBench)
* **Interactive Simulator Space:** [`batistado/QuorumGuard-Explorer`](https://huggingface.co/spaces/batistado/QuorumGuard-Explorer)
* **Paper PDF (10 pages):** [`paper/main.pdf`](paper/main.pdf)
* **Source Code & Paper:** [`github.com/batistado/quorumguard`](https://github.com/batistado/quorumguard)
`QuorumGuard` is a model-agnostic consensus controller and quantum-preemptive priority scheduler for asynchronous multi-agent LLM committees. It requires zero weight modifications and operates on pre-commitment option logits, provenance DAGs, and priority-preemptive decode quanta (`Priority = -10` in both our live PyTorch MPS `DynamicCache` server and `vLLM`-compatible priority schedulers).
![QuorumGuard Overview](fig0_architecture.png)
## Install
```bash
pip install git+https://github.com/batistado/quorumguard.git
```