AI & ML interests

Self-hosted, GPU-pooling LLM inference run your own model fleet on your own hardware. One streaming, OpenAI-compatible API over transformers & llama.cpp. Inference you own.

Recent Activity

putkoff  updated a Space 29 days ago
hugpy-ai/hugpy-chat
putkoff  updated a Space 29 days ago
hugpy-ai/hugpy-console
putkoff  updated a Space 29 days ago
hugpy-ai/hugpy
View all activity

Organization Card
hugpy
inference you own

Self-hosted, GPU-pooling LLM inference — pool a workstation GPU, an idle laptop, even a phone, behind one streaming, OpenAI-compatible API.

A model registry with on-demand load/unload, streaming chat, Whisper transcription, embeddings & summarization — 40+ models from a single console, on hardware you own.

GitHub· PyPI· npm· X· Instagram· Threads· Reddit· Minds © 2026 · source-available

models 0

None public yet

datasets 0

None public yet