README.md

metadata

title: Sign Language To Text Streaming
emoji: 🤟
colorFrom: blue
colorTo: purple
sdk: docker
app_port: 7860
pinned: false

Real-Time Sign Language to Text

Streaming sign-language-to-text translation API. Browser webcam frames are sent over a WebSocket, processed frame-by-frame (MediaPipe landmarks + DINOv2 hand/face embeddings), segmented into phrases by wrist motion, and translated by a SHuBERT encoder + fine-tuned ByT5 decoder once each phrase ends.

This is an API-only Space -- no production frontend is served from here.