Spaces:

Alovestocode
/

ZeroGPU-LLM-Inference

Sleeping

App Files Files Community

ZeroGPU-LLM-Inference

76.5 kB

Ctrl+K

Ctrl+K

1 contributor

History: 27 commits

Alikestocode's picture

Add Cloud Build deployment script and permission setup helper

fd26b3d 12 months ago

.dockerignore
104 Bytes
Add Google Cloud Platform deployment configurations 12 months ago
.gitattributes
1.52 kB
Initial commit: ZeroGPU LLM Inference Space 12 months ago
.gitignore
27 Bytes
Add .gitignore and remove cache files 12 months ago
Dockerfile
680 Bytes
Add Google Cloud Platform deployment configurations 12 months ago
QUICK_DEPLOY.md
2.86 kB
Add Cloud Build deployment script and permission setup helper 12 months ago
README.md
4.23 kB
Implement vLLM with LLM Compressor and performance optimizations 12 months ago
app.py
34.8 kB
Add Cloud Run PORT environment variable support 12 months ago
apt.txt
11 Bytes
Initial commit: ZeroGPU LLM Inference Space 12 months ago
cloudbuild.yaml
1.36 kB
Add Cloud Build deployment script and permission setup helper 12 months ago
deploy-cloud-build.sh
3.31 kB
Add Cloud Build deployment script and permission setup helper 12 months ago
deploy-compute-engine.sh
4.23 kB
Add Google Cloud Platform deployment configurations 12 months ago
deploy-gcp.sh
2.67 kB
Add Google Cloud Platform deployment configurations 12 months ago
gcp-deployment.md
5.32 kB
Add Google Cloud Platform deployment configurations 12 months ago
requirements.txt
197 Bytes
Implement vLLM with LLM Compressor and performance optimizations 12 months ago
setup-gcp-permissions.sh
1.8 kB
Add Cloud Build deployment script and permission setup helper 12 months ago
style.css
2.84 kB
Initial commit: ZeroGPU LLM Inference Space 12 months ago
test_api.py
3.43 kB
Migrate to AWQ quantization with FlashAttention-2 12 months ago
test_api_gradio_client.py
7.2 kB
Implement vLLM with LLM Compressor and performance optimizations 12 months ago