Instructions to use KeisukeMiyamoto/lambda-1-160m-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use KeisukeMiyamoto/lambda-1-160m-base with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="KeisukeMiyamoto/lambda-1-160m-base")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("KeisukeMiyamoto/lambda-1-160m-base", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use KeisukeMiyamoto/lambda-1-160m-base with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "KeisukeMiyamoto/lambda-1-160m-base"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "KeisukeMiyamoto/lambda-1-160m-base",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/KeisukeMiyamoto/lambda-1-160m-base

SGLang

How to use KeisukeMiyamoto/lambda-1-160m-base with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "KeisukeMiyamoto/lambda-1-160m-base" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "KeisukeMiyamoto/lambda-1-160m-base",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "KeisukeMiyamoto/lambda-1-160m-base" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "KeisukeMiyamoto/lambda-1-160m-base",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use KeisukeMiyamoto/lambda-1-160m-base with Docker Model Runner:
```
docker model run hf.co/KeisukeMiyamoto/lambda-1-160m-base
```

KeisukeMiyamoto commited on Aug 22

Commit

0082ecf

verified ·

1 Parent(s): b9932ea

Simplify support section

Browse files

Files changed (1) hide show

README.md +7 -11

README.md CHANGED Viewed

@@ -63,23 +63,19 @@ The model was trained on a limited Japanese corpus mixture and has not been eval
 ## Support Lambda
-[Lambda](https://github.com/KeisukeMiyamoto1324/lambda) is a project I am developing as a student to build small Japanese language models from scratch. The datasets, source code, and model weights are publicly available.
-Training language models is very expensive, and I have funded the project with income from my part-time job. As the models grow, the cost is becoming too high for me to maintain the current development pace.
-You can support Lambda in two ways: use the Vast.ai referral link when purchasing GPU credits or make a donation through Ko-fi. Thank you for helping Lambda continue to grow.
-### PR: vast.ai
-Vast.ai is a GPU cloud platform that lets you rent powerful GPUs from providers around the world. It is often more affordable than major cloud providers, with **NVIDIA H100 SXM GPUs available from around $1.54 per hour**. Check out Vast.ai for a lower-cost way to train language models.
-When you sign up and purchase credits through the link below, I receive GPU credits equal to 3% of your purchase. This does not reduce your credits or add any extra cost. Using this link directly supports the development of Lambda.
-Link: https://cloud.vast.ai/?ref_id=521936
-### Donate
-You can support the project with a donation starting from $5 through Ko-fi. Your support helps cover GPU costs and allows me to continue developing larger models.
 <a href="https://ko-fi.com/lambda_llm">
   <img src="assets/support_me_on_kofi_badge_blue.png" alt="Support Lambda on Ko-fi" width="240">

 ## Support Lambda
+Lambda is an open-source project for building small Japanese language models from scratch. As a student, I have funded this project with income from my part-time job, but the growing training costs are becoming difficult to cover.
+Your support helps cover GPU costs and develop larger models. Thank you for helping Lambda continue to grow.
+### Vast.ai
+Vast.ai offers affordable cloud GPUs for AI training. If you purchase credits through the link below, I receive 3% in GPU credits at no extra cost to you.
+https://cloud.vast.ai/?ref_id=521936
+### Ko-fi
+Support Lambda with a donation starting from $5.
 <a href="https://ko-fi.com/lambda_llm">
   <img src="assets/support_me_on_kofi_badge_blue.png" alt="Support Lambda on Ko-fi" width="240">