Text Generation
Transformers
Safetensors
English
philolm
philosophy
base-model
trained-from-scratch
small-language-model
n-gram-embedding
muon
webassembly
custom_code
Instructions to use gustavecortal/PhiloLM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use gustavecortal/PhiloLM with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="gustavecortal/PhiloLM", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("gustavecortal/PhiloLM", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use gustavecortal/PhiloLM with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "gustavecortal/PhiloLM" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "gustavecortal/PhiloLM", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/gustavecortal/PhiloLM
- SGLang
How to use gustavecortal/PhiloLM with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "gustavecortal/PhiloLM" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "gustavecortal/PhiloLM", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "gustavecortal/PhiloLM" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "gustavecortal/PhiloLM", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use gustavecortal/PhiloLM with Docker Model Runner:
docker model run hf.co/gustavecortal/PhiloLM
Commit History
Yesterday
-
Model card: remove the training-mix figure
Verified signature8a92cc7 -
Model card: the two-panel architecture figure, without the paragraph it replaces
Verified signature45d5cc1 -
Shorten the architecture paragraph
Verified signaturef08a584 -
Link the web demo
Verified signature9020b4c -
Card: shorter usage section
Verified signature2a814e5 -
Card: training data mix and context length by pass
Verified signature529ede9 -
decode.py: fused weights computed once (18% faster on CPU, identical output); card: PyTorch speed corrected to about 55 tokens/s
Verified signaturee13520d -
Card: architecture figure and short architecture section; generate_fast.py runs the web page's engine (about 150 tokens/s on one CPU thread)
Verified signature63805f8 -
Card: shorter introduction
Verified signature74bf4c6 -
Load with transformers (trust_remote_code): config, generation defaults, tokenizer settings, wrapper
Verified signaturemodeling_philolm.py wraps model.py unchanged; one-prompt generation uses decode.py's cache. Checked: identical logits to model.py, identical greedy tokens to decode.py, padding-neutral batches, pipeline. The tokenizer now adds the end-of-text token when add_special_tokens is on; generate.py encodes without special tokens, so its output is unchanged.4e3ea40 -
Card: drop the Beauty example
Verified signature56bec11 -
Card: three examples on everyday concepts before the philosophers
Verified signatureb21ba01 -
Card: drop the invented-facts example and the seed note
Verified signature94f4b0f -
Card: 112M parameters, example continuations in place of the evaluation table
Verified signaturea5c2cbb -
Card: name PhiloText beside its open philosophy data
Verified signatureb5ed030 -
Card: language model with 61M parameters, trained from scratch on open philosophy data
Verified signaturef263102
2 days ago
-
Model card: comparison with recent small base models by kind of text
Verified signatureb543067 -
Model card: comparison with Pythia-160M and SmolLM2-135M by parameters and training tokens
Verified signaturec7b1780 -
Model card: link PhiloText, CPU speed, intended uses, Python loading, corrected context length
Verified signature25b83b2 -
PhiloLM: the model card under its name
Verified signature5a139b5 -
Model card: highlights and model overview, parameters counted as for n-gram models
Verified signaturec538c43 -
Model card: non-embedding and total parameter counts
Verified signaturea743ed7 -
philosophy-lm: model card, code, tokenizer and browser files
Verified signatureb9ee6b4