How to use Tensormorph/distillgpt2 with Keras:
# !pip install -U keras tensorflow huggingface_hub # Keras needs TensorFlow installed to read "hf://" paths, so the tensorflow backend is selected here; # "jax" and "torch" also work for computation once TensorFlow is installed. import os os.environ["KERAS_BACKEND"] = "tensorflow" import keras model = keras.saving.load_model("hf://Tensormorph/distillgpt2")
How to use Tensormorph/distillgpt2 with llama.cpp:
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Tensormorph/distillgpt2:F16 # Run inference directly in the terminal: llama cli -hf Tensormorph/distillgpt2:F16
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Tensormorph/distillgpt2:F16 # Run inference directly in the terminal: llama cli -hf Tensormorph/distillgpt2:F16
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Tensormorph/distillgpt2:F16 # Run inference directly in the terminal: ./build/bin/llama cli -hf Tensormorph/distillgpt2:F16
docker model run hf.co/Tensormorph/distillgpt2:F16
How to use Tensormorph/distillgpt2 with Ollama:
ollama run hf.co/Tensormorph/distillgpt2:F16
How to use Tensormorph/distillgpt2 with Docker Model Runner:
How to use Tensormorph/distillgpt2 with Lemonade:
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Tensormorph/distillgpt2:F16
lemonade run user.distillgpt2-F16
lemonade list
This model has 6 files scanned as suspicious.
