Arseniy Savin commited on
Commit
5217f76
·
1 Parent(s): 95086c6

Update Dockerfile to enable flash attention in Whisper.cpp server command

Browse files
Files changed (1) hide show
  1. Dockerfile +1 -1
Dockerfile CHANGED
@@ -32,4 +32,4 @@ WORKDIR /app
32
  COPY --from=builder /build/whisper.cpp/build/ /build/whisper.cpp/build/
33
  COPY --from=builder /build/whisper.cpp/models/ ./models/
34
 
35
- CMD sh -c "/build/whisper.cpp/build/bin/whisper-server -m /app/models/ggml-${MODEL}.bin --host 0.0.0.0 --port ${PORT:-7860}"
 
32
  COPY --from=builder /build/whisper.cpp/build/ /build/whisper.cpp/build/
33
  COPY --from=builder /build/whisper.cpp/models/ ./models/
34
 
35
+ CMD sh -c "/build/whisper.cpp/build/bin/whisper-server -m /app/models/ggml-${MODEL}.bin --host 0.0.0.0 --port ${PORT:-7860} --flash-attn"