Text Generation
Transformers
Safetensors
GGUF
PEFT
English
falcon_h1
falcon-h1
qlora
cyber-security
conversational
Instructions to use sourcepirate/falcon-h1-tiny-cyber with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use sourcepirate/falcon-h1-tiny-cyber with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="sourcepirate/falcon-h1-tiny-cyber") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("sourcepirate/falcon-h1-tiny-cyber") model = AutoModelForCausalLM.from_pretrained("sourcepirate/falcon-h1-tiny-cyber", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - PEFT
How to use sourcepirate/falcon-h1-tiny-cyber with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use sourcepirate/falcon-h1-tiny-cyber with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf sourcepirate/falcon-h1-tiny-cyber:Q8_0 # Run inference directly in the terminal: llama cli -hf sourcepirate/falcon-h1-tiny-cyber:Q8_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf sourcepirate/falcon-h1-tiny-cyber:Q8_0 # Run inference directly in the terminal: llama cli -hf sourcepirate/falcon-h1-tiny-cyber:Q8_0
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf sourcepirate/falcon-h1-tiny-cyber:Q8_0 # Run inference directly in the terminal: ./build/bin/llama cli -hf sourcepirate/falcon-h1-tiny-cyber:Q8_0
Use Docker
docker model run hf.co/sourcepirate/falcon-h1-tiny-cyber:Q8_0
- Llama new
- LM Studio
- Jan
- vLLM
How to use sourcepirate/falcon-h1-tiny-cyber with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "sourcepirate/falcon-h1-tiny-cyber" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "sourcepirate/falcon-h1-tiny-cyber", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/sourcepirate/falcon-h1-tiny-cyber:Q8_0
- SGLang
How to use sourcepirate/falcon-h1-tiny-cyber with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "sourcepirate/falcon-h1-tiny-cyber" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "sourcepirate/falcon-h1-tiny-cyber", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "sourcepirate/falcon-h1-tiny-cyber" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "sourcepirate/falcon-h1-tiny-cyber", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Ollama
How to use sourcepirate/falcon-h1-tiny-cyber with Ollama:
ollama run hf.co/sourcepirate/falcon-h1-tiny-cyber:Q8_0
- Unsloth Desktop
- Pi
How to use sourcepirate/falcon-h1-tiny-cyber with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf sourcepirate/falcon-h1-tiny-cyber:Q8_0
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "sourcepirate/falcon-h1-tiny-cyber:Q8_0" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use sourcepirate/falcon-h1-tiny-cyber with Docker Model Runner:
docker model run hf.co/sourcepirate/falcon-h1-tiny-cyber:Q8_0
- Lemonade
How to use sourcepirate/falcon-h1-tiny-cyber with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull sourcepirate/falcon-h1-tiny-cyber:Q8_0
Run and chat with the model
lemonade run user.falcon-h1-tiny-cyber-Q8_0
List all available models
lemonade list
- Hermes Agent
How to use sourcepirate/falcon-h1-tiny-cyber with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf sourcepirate/falcon-h1-tiny-cyber:Q8_0
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default sourcepirate/falcon-h1-tiny-cyber:Q8_0
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use sourcepirate/falcon-h1-tiny-cyber with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf sourcepirate/falcon-h1-tiny-cyber:Q8_0
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "sourcepirate/falcon-h1-tiny-cyber:Q8_0" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Download tokenizer_config.json from sourcepirate/falcon-h1-tiny-cyber: direct link, hf CLI and curl.
- Browser
- Download file 7.54 kB
-
https://huggingface.co/sourcepirate/falcon-h1-tiny-cyber/resolve/main/tokenizer_config.json
- Command line
-
hf download hf://sourcepirate/falcon-h1-tiny-cyber/tokenizer_config.json
-
curl -L -o tokenizer_config.json https://huggingface.co/sourcepirate/falcon-h1-tiny-cyber/resolve/main/tokenizer_config.json
7.54 kB
| { | |
| "backend": "tokenizers", | |
| "bos_token": "<|begin_of_text|>", | |
| "clean_up_tokenization_spaces": true, | |
| "eos_token": "<|end_of_text|>", | |
| "extra_special_tokens": [ | |
| "<|pad|>", | |
| ">>ABSTRACT<<", | |
| ">>INTRODUCTION<<", | |
| ">>SUMMARY<<", | |
| ">>COMMENT<<", | |
| ">>ANSWER<<", | |
| ">>QUESTION<<", | |
| ">>DOMAIN<<", | |
| ">>PREFIX<<", | |
| ">>SUFFIX<<", | |
| ">>MIDDLE<<", | |
| "<|finetune_right_pad_id|>", | |
| "<|start_header_id|>", | |
| "<|end_header_id|>", | |
| "<|eom_id|>", | |
| "<|eot_id|>", | |
| "<|begin_of_text|>", | |
| ">>TITLE<<", | |
| "<tool_response>", | |
| "</tool_response>", | |
| "<tool_call>", | |
| "</tool_call>", | |
| "<schema>", | |
| "</schema>", | |
| "<scratch_pad>", | |
| "</scratch_pad>", | |
| "<thinking>", | |
| "</thinking>", | |
| "<explanation>", | |
| "</explanation>", | |
| "<file_sep>", | |
| "<repo_name>", | |
| "<|im_end|>", | |
| "<|im_start|>", | |
| "<|system|>", | |
| "<|file_sep|>", | |
| "<|repo_name|>", | |
| "<|repo_tree|>", | |
| ">>UNUSED_221<<", | |
| ">>UNUSED_222<<", | |
| ">>UNUSED_223<<", | |
| ">>UNUSED_224<<", | |
| ">>UNUSED_225<<", | |
| ">>UNUSED_226<<", | |
| ">>UNUSED_227<<", | |
| ">>UNUSED_228<<", | |
| ">>UNUSED_229<<", | |
| ">>UNUSED_230<<", | |
| ">>UNUSED_231<<", | |
| ">>UNUSED_232<<", | |
| ">>UNUSED_233<<", | |
| ">>UNUSED_234<<", | |
| ">>UNUSED_235<<", | |
| ">>UNUSED_236<<", | |
| ">>UNUSED_237<<", | |
| ">>UNUSED_238<<", | |
| ">>UNUSED_239<<", | |
| ">>UNUSED_240<<", | |
| ">>UNUSED_241<<", | |
| ">>UNUSED_242<<", | |
| ">>UNUSED_243<<", | |
| ">>UNUSED_244<<", | |
| ">>UNUSED_245<<", | |
| ">>UNUSED_246<<", | |
| ">>UNUSED_247<<", | |
| ">>UNUSED_248<<", | |
| ">>UNUSED_249<<", | |
| ">>UNUSED_250<<", | |
| ">>UNUSED_251<<", | |
| ">>UNUSED_252<<", | |
| ">>UNUSED_253<<", | |
| ">>UNUSED_254<<", | |
| ">>UNUSED_255<<", | |
| ">>UNUSED_256<<", | |
| ">>UNUSED_257<<", | |
| ">>UNUSED_258<<", | |
| ">>UNUSED_259<<", | |
| ">>UNUSED_260<<", | |
| ">>UNUSED_261<<", | |
| ">>UNUSED_262<<", | |
| ">>UNUSED_263<<", | |
| ">>UNUSED_264<<", | |
| ">>UNUSED_265<<", | |
| ">>UNUSED_266<<", | |
| ">>UNUSED_267<<", | |
| ">>UNUSED_268<<", | |
| ">>UNUSED_269<<", | |
| ">>UNUSED_270<<", | |
| ">>UNUSED_271<<", | |
| ">>UNUSED_272<<", | |
| ">>UNUSED_273<<", | |
| ">>UNUSED_274<<", | |
| ">>UNUSED_275<<", | |
| ">>UNUSED_276<<", | |
| ">>UNUSED_277<<", | |
| ">>UNUSED_278<<", | |
| ">>UNUSED_279<<", | |
| ">>UNUSED_280<<", | |
| ">>UNUSED_281<<", | |
| ">>UNUSED_282<<", | |
| ">>UNUSED_283<<", | |
| ">>UNUSED_284<<", | |
| ">>UNUSED_285<<", | |
| ">>UNUSED_286<<", | |
| ">>UNUSED_287<<", | |
| ">>UNUSED_288<<", | |
| ">>UNUSED_289<<", | |
| ">>UNUSED_290<<", | |
| ">>UNUSED_291<<", | |
| ">>UNUSED_292<<", | |
| ">>UNUSED_293<<", | |
| ">>UNUSED_294<<", | |
| ">>UNUSED_295<<", | |
| ">>UNUSED_296<<", | |
| ">>UNUSED_297<<", | |
| ">>UNUSED_298<<", | |
| ">>UNUSED_299<<", | |
| ">>UNUSED_300<<", | |
| ">>UNUSED_301<<", | |
| ">>UNUSED_302<<", | |
| ">>UNUSED_303<<", | |
| ">>UNUSED_304<<", | |
| ">>UNUSED_305<<", | |
| ">>UNUSED_306<<", | |
| ">>UNUSED_307<<", | |
| ">>UNUSED_308<<", | |
| ">>UNUSED_309<<", | |
| ">>UNUSED_310<<", | |
| ">>UNUSED_311<<", | |
| ">>UNUSED_312<<", | |
| ">>UNUSED_313<<", | |
| ">>UNUSED_314<<", | |
| ">>UNUSED_315<<", | |
| ">>UNUSED_316<<", | |
| ">>UNUSED_317<<", | |
| ">>UNUSED_318<<", | |
| ">>UNUSED_319<<", | |
| ">>UNUSED_320<<", | |
| ">>UNUSED_321<<", | |
| ">>UNUSED_322<<", | |
| ">>UNUSED_323<<", | |
| ">>UNUSED_324<<", | |
| ">>UNUSED_325<<", | |
| ">>UNUSED_326<<", | |
| ">>UNUSED_327<<", | |
| ">>UNUSED_328<<", | |
| ">>UNUSED_329<<", | |
| ">>UNUSED_330<<", | |
| ">>UNUSED_331<<", | |
| ">>UNUSED_332<<", | |
| ">>UNUSED_333<<", | |
| ">>UNUSED_334<<", | |
| ">>UNUSED_335<<", | |
| ">>UNUSED_336<<", | |
| ">>UNUSED_337<<", | |
| ">>UNUSED_338<<", | |
| ">>UNUSED_339<<", | |
| ">>UNUSED_340<<", | |
| ">>UNUSED_341<<", | |
| ">>UNUSED_342<<", | |
| ">>UNUSED_343<<", | |
| ">>UNUSED_344<<", | |
| ">>UNUSED_345<<", | |
| ">>UNUSED_346<<", | |
| ">>UNUSED_347<<", | |
| ">>UNUSED_348<<", | |
| ">>UNUSED_349<<", | |
| ">>UNUSED_350<<", | |
| ">>UNUSED_351<<", | |
| ">>UNUSED_352<<", | |
| ">>UNUSED_353<<", | |
| ">>UNUSED_354<<", | |
| ">>UNUSED_355<<", | |
| ">>UNUSED_356<<", | |
| ">>UNUSED_357<<", | |
| ">>UNUSED_358<<", | |
| ">>UNUSED_359<<", | |
| ">>UNUSED_360<<", | |
| ">>UNUSED_361<<", | |
| ">>UNUSED_362<<", | |
| ">>UNUSED_363<<", | |
| ">>UNUSED_364<<", | |
| ">>UNUSED_365<<", | |
| ">>UNUSED_366<<", | |
| ">>UNUSED_367<<", | |
| ">>UNUSED_368<<", | |
| ">>UNUSED_369<<", | |
| ">>UNUSED_370<<", | |
| ">>UNUSED_371<<", | |
| ">>UNUSED_372<<", | |
| ">>UNUSED_373<<", | |
| ">>UNUSED_374<<", | |
| ">>UNUSED_375<<", | |
| ">>UNUSED_376<<", | |
| ">>UNUSED_377<<", | |
| ">>UNUSED_378<<", | |
| ">>UNUSED_379<<", | |
| ">>UNUSED_380<<", | |
| ">>UNUSED_381<<", | |
| ">>UNUSED_382<<", | |
| ">>UNUSED_383<<", | |
| ">>UNUSED_384<<", | |
| ">>UNUSED_385<<", | |
| ">>UNUSED_386<<", | |
| ">>UNUSED_387<<", | |
| ">>UNUSED_388<<", | |
| ">>UNUSED_389<<", | |
| ">>UNUSED_390<<", | |
| ">>UNUSED_391<<", | |
| ">>UNUSED_392<<", | |
| ">>UNUSED_393<<", | |
| ">>UNUSED_394<<", | |
| ">>UNUSED_395<<", | |
| ">>UNUSED_396<<", | |
| ">>UNUSED_397<<", | |
| ">>UNUSED_398<<", | |
| ">>UNUSED_399<<", | |
| ">>UNUSED_400<<", | |
| ">>UNUSED_401<<", | |
| ">>UNUSED_402<<", | |
| ">>UNUSED_403<<", | |
| ">>UNUSED_404<<", | |
| ">>UNUSED_405<<", | |
| ">>UNUSED_406<<", | |
| ">>UNUSED_407<<", | |
| ">>UNUSED_408<<", | |
| ">>UNUSED_409<<", | |
| ">>UNUSED_410<<", | |
| ">>UNUSED_411<<", | |
| ">>UNUSED_412<<", | |
| ">>UNUSED_413<<", | |
| ">>UNUSED_414<<", | |
| ">>UNUSED_415<<", | |
| ">>UNUSED_416<<", | |
| ">>UNUSED_417<<", | |
| ">>UNUSED_418<<", | |
| ">>UNUSED_419<<", | |
| ">>UNUSED_420<<", | |
| ">>UNUSED_421<<", | |
| ">>UNUSED_422<<", | |
| ">>UNUSED_423<<", | |
| ">>UNUSED_424<<", | |
| ">>UNUSED_425<<", | |
| ">>UNUSED_426<<", | |
| ">>UNUSED_427<<", | |
| ">>UNUSED_428<<", | |
| ">>UNUSED_429<<", | |
| ">>UNUSED_430<<", | |
| ">>UNUSED_431<<", | |
| ">>UNUSED_432<<", | |
| ">>UNUSED_433<<", | |
| ">>UNUSED_434<<", | |
| ">>UNUSED_435<<", | |
| ">>UNUSED_436<<", | |
| ">>UNUSED_437<<", | |
| ">>UNUSED_438<<", | |
| ">>UNUSED_439<<", | |
| ">>UNUSED_440<<", | |
| ">>UNUSED_441<<", | |
| ">>UNUSED_442<<", | |
| ">>UNUSED_443<<", | |
| ">>UNUSED_444<<", | |
| ">>UNUSED_445<<", | |
| ">>UNUSED_446<<", | |
| ">>UNUSED_447<<", | |
| ">>UNUSED_448<<", | |
| ">>UNUSED_449<<", | |
| ">>UNUSED_450<<", | |
| ">>UNUSED_451<<", | |
| ">>UNUSED_452<<", | |
| ">>UNUSED_453<<", | |
| ">>UNUSED_454<<", | |
| ">>UNUSED_455<<", | |
| ">>UNUSED_456<<", | |
| ">>UNUSED_457<<", | |
| ">>UNUSED_458<<", | |
| ">>UNUSED_459<<", | |
| ">>UNUSED_460<<", | |
| ">>UNUSED_461<<", | |
| ">>UNUSED_462<<", | |
| ">>UNUSED_463<<", | |
| ">>UNUSED_464<<", | |
| ">>UNUSED_465<<", | |
| ">>UNUSED_466<<", | |
| ">>UNUSED_467<<", | |
| ">>UNUSED_468<<", | |
| ">>UNUSED_469<<", | |
| ">>UNUSED_470<<", | |
| ">>UNUSED_471<<", | |
| ">>UNUSED_472<<", | |
| ">>UNUSED_473<<", | |
| ">>UNUSED_474<<", | |
| ">>UNUSED_475<<", | |
| ">>UNUSED_476<<", | |
| ">>UNUSED_477<<", | |
| ">>UNUSED_478<<", | |
| ">>UNUSED_479<<", | |
| ">>UNUSED_480<<", | |
| ">>UNUSED_481<<", | |
| ">>UNUSED_482<<", | |
| ">>UNUSED_483<<", | |
| ">>UNUSED_484<<", | |
| ">>UNUSED_485<<", | |
| ">>UNUSED_486<<", | |
| ">>UNUSED_487<<", | |
| ">>UNUSED_488<<", | |
| ">>UNUSED_489<<", | |
| ">>UNUSED_490<<", | |
| ">>UNUSED_491<<", | |
| ">>UNUSED_492<<", | |
| ">>UNUSED_493<<", | |
| ">>UNUSED_494<<", | |
| ">>UNUSED_495<<", | |
| ">>UNUSED_496<<", | |
| ">>UNUSED_497<<", | |
| ">>UNUSED_498<<", | |
| ">>UNUSED_499<<", | |
| ">>UNUSED_500<<", | |
| ">>UNUSED_501<<", | |
| ">>UNUSED_502<<", | |
| ">>UNUSED_503<<", | |
| ">>UNUSED_504<<", | |
| ">>UNUSED_505<<", | |
| ">>UNUSED_506<<", | |
| ">>UNUSED_507<<", | |
| ">>UNUSED_508<<", | |
| ">>UNUSED_509<<", | |
| ">>UNUSED_510<<", | |
| ">>UNUSED_511<<" | |
| ], | |
| "is_local": false, | |
| "local_files_only": false, | |
| "model_max_length": 1000000000000000019884624838656, | |
| "pad_token": "<|pad|>", | |
| "pad_token_id": 0, | |
| "tokenizer_class": "TokenizersBackend" | |
| } | |