QuorumGuard / README.md
batistado's picture
Publish QuorumGuard controller & vLLM priority-preemption package
a1479d7 verified
|
Raw History Blame Contribute Delete
1.4 kB
metadata
license: apache-2.0
library_name: transformers
tags:
  - multi-agent-systems
  - consensus
  - tail-latency
  - semantic-entropy
  - llm-agents
  - vllm
datasets:
  - batistado/QuorumBench
base_model:
  - Qwen/Qwen2.5-3B-Instruct
  - Qwen/Qwen2.5-7B-Instruct
  - Qwen/Qwen2.5-Coder-14B-Instruct
  - HuggingFaceTB/SmolLM2-1.7B-Instruct
  - ibm-granite/granite-3.1-8b-instruct

QuorumGuard: Claim-Genealogy-Gated Hedged Quorums & Priority Dissent Preemption

QuorumGuard is a model-agnostic consensus controller and quantum-preemptive priority scheduler for asynchronous multi-agent LLM committees. It requires zero weight modifications and operates on pre-commitment option logits, provenance DAGs, and priority-preemptive decode quanta (Priority = -10 in both our live PyTorch MPS DynamicCache server and vLLM-compatible priority schedulers).

QuorumGuard Overview

Install

pip install git+https://github.com/batistado/quorumguard.git