Text Generation
Transformers
ONNX
GGUF
PyTorch
English
qtensorformer
tensor-networks
model-compression
adaptive-computation
kv-cache-compression
hardware-aware
energy-aware
green-ai
custom-code
multimodal
ollama
webgpu
triton
low-rank-adaptation
mixture-of-depths
edge-ai
custom_code
Instructions to use Premchan369/Q-TensorFormer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Premchan369/Q-TensorFormer with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Premchan369/Q-TensorFormer", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("Premchan369/Q-TensorFormer", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Premchan369/Q-TensorFormer with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Premchan369/Q-TensorFormer" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Premchan369/Q-TensorFormer", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/Premchan369/Q-TensorFormer
- SGLang
How to use Premchan369/Q-TensorFormer with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Premchan369/Q-TensorFormer" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Premchan369/Q-TensorFormer", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Premchan369/Q-TensorFormer" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Premchan369/Q-TensorFormer", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use Premchan369/Q-TensorFormer with Docker Model Runner:
docker model run hf.co/Premchan369/Q-TensorFormer
Premchandyadav369
Transform Q-TensorFormer into an Information-Value Adaptive Resource Allocation Architecture
eaeea8f Download tests/test_quantum_backend.py from Premchan369/Q-TensorFormer: direct link, hf CLI and curl.
- Browser
- Download file 1.88 kB
-
https://huggingface.co/Premchan369/Q-TensorFormer/resolve/main/tests/test_quantum_backend.py
- Command line
-
hf download hf://Premchan369/Q-TensorFormer/tests/test_quantum_backend.py
-
curl -L -o test_quantum_backend.py https://huggingface.co/Premchan369/Q-TensorFormer/resolve/main/tests/test_quantum_backend.py
1.88 kB
| """ | |
| Tests for Quantum Backend Module. | |
| """ | |
| import sys | |
| import os | |
| sys.path.insert(0, os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) | |
| import torch | |
| import pytest | |
| from src.quantum_backend import QuantumBackend, BackendType, ClassicalSurrogateUnitary | |
| def test_classical_surrogate_unitary(): | |
| surrogate = ClassicalSurrogateUnitary(n_qubits=4, n_layers=2, n_outputs=4) | |
| x = torch.randn(2, 6, 4) | |
| out = surrogate(x) | |
| assert out.shape == (2, 6, 4) | |
| # Pauli-Z expectation values bounded in [-1, 1] | |
| assert out.min() >= -1.01 | |
| assert out.max() <= 1.01 | |
| print("✓ test_classical_surrogate_unitary passed") | |
| def test_quantum_backend_execution(): | |
| backend = QuantumBackend( | |
| backend_type=BackendType.CLASSICAL_SURROGATE, | |
| n_qubits=4, | |
| n_layers=2, | |
| d_model=64, | |
| ) | |
| x = torch.randn(2, 8, 64) | |
| out, meta = backend(x) | |
| assert out.shape == (2, 8, 64) | |
| assert meta["classification"] in ["MEASURED", "SIMULATED"] | |
| print("✓ test_quantum_backend_execution passed") | |
| def test_quantum_kernel_fidelity(): | |
| backend = QuantumBackend( | |
| backend_type=BackendType.CLASSICAL_SURROGATE, | |
| n_qubits=4, | |
| n_layers=2, | |
| d_model=32, | |
| ) | |
| B, H, T_q, T_k, D = 1, 2, 4, 4, 8 | |
| q = torch.randn(B, H, T_q, D) | |
| k = torch.randn(B, H, T_k, D) | |
| K = backend.compute_kernel_matrix(q, k) | |
| assert K.shape == (B, H, T_q, T_k) | |
| # Self-fidelity K(q, q) should be close to 1.0 | |
| K_self = backend.compute_kernel_matrix(q, q) | |
| diag = torch.diagonal(K_self[0, 0]) | |
| assert torch.all(diag > 0.8), f"Self-fidelity diagonal should be near 1.0, got {diag}" | |
| print("✓ test_quantum_kernel_fidelity passed") | |
| if __name__ == "__main__": | |
| test_classical_surrogate_unitary() | |
| test_quantum_backend_execution() | |
| test_quantum_kernel_fidelity() | |
| print("All Quantum Backend tests passed!") | |