Text Generation
Transformers
Safetensors
English
phi3
conversational
custom_code
text-generation-inference
Instructions to use numind/NuExtract with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use numind/NuExtract with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="numind/NuExtract", trust_remote_code=True) messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("numind/NuExtract", trust_remote_code=True) model = AutoModelForCausalLM.from_pretrained("numind/NuExtract", trust_remote_code=True, device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use numind/NuExtract with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "numind/NuExtract" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "numind/NuExtract", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/numind/NuExtract
- SGLang
How to use numind/NuExtract with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "numind/NuExtract" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "numind/NuExtract", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "numind/NuExtract" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "numind/NuExtract", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use numind/NuExtract with Docker Model Runner:
docker model run hf.co/numind/NuExtract
Commit History
-
add AIBOM
Verified signatureDear numind, We are a group of researchers investigating the usefulness of sharing AIBOMs (Artificial Intelligence Bill of Materials) to document AI models and to improve transparency in AI model supply chains. AIBOMs are machine-readable, structured inventories of components—such as datasets and models—used in the development of AI-powered systems. We would like to emphasize that we have no financial or competing interests related to AIBOMs. Our sole interest is to advance the collective understanding of AIBOMs within both academia and industry. As part of this effort, we are contributing to randomly selected open and popular models on Hugging Face (like yours) and are happy to offer support to you and the maintainers of your model if needed. Based on your model card (and some configuration information available in Hugging Face), we generated the AIBOM according to the CyclonDX (v1.6) standard (see https://cyclonedx.org/docs/1.6/json/). This AIBOM is generated as a JSON file by us…c13d27f
-
add metadata for new version (#12)
Verified signature- add metadata for new version (d690e4e81879fff48ff1e5b0d6a4548db2ccd96b) Co-authored-by: Daniel van Strien <davanstrien@users.noreply.huggingface.co>1b6c9d9
-
Update README.md
Verified signature669cf37
-
Add base_model metadata (#11)
Verified signature- Add base_model metadata (05c490c0d9378245e10ea2567f9db0f5897f7e6c) Co-authored-by: Daniel van Strien <davanstrien@users.noreply.huggingface.co>b270761
-
Update README.md
Verified signaturef9b15f3 -
Update README.md
Verified signature590025b
-
Update README.md
Verified signature452f304 -
Update README.md
Verified signature34d374e -
Upload result.png
Verified signature5cfd71c -
Delete result.png
Verified signature0d923bf -
Update README.md
Verified signature53bb8c5 -
Update README.md
Verified signature0bf8048 -
Update generation_config.json
Verified signature09be9ca -
Update README.md
Verified signatured25c898 -
Upload 2 files
Verified signaturee3f5235 -
Delete result_ft.png
Verified signaturea8be0fa -
Delete result.png
Verified signaturec06ad8b -
Upload 2 files
Verified signature353addb -
Delete result.png
Verified signatureed20a2e -
Delete result_ft.png
Verified signature79e5612
-
Upload result_ft.png
Verified signaturedd7c08a -
Delete result_ft.png
Verified signaturea358d0a -
Update README.md
Verified signature409b58c -
Upload result_ft.png
Verified signatureeb15bfb -
Update README.md
Verified signature6904da6 -
Upload result.png
Verified signaturecdd8a2a -
Update README.md
Verified signature4819954
-
Update generation_config.json
Verified signatureaa73f7f -
Update tokenizer_config.json
Verified signature7c67b1e -
Update README.md
Verified signatureacf7388 -
Create README.md
Verified signaturefac7b94
-
Upload 5 files
Verified signature01c3b83 -
Upload 7 files
Verified signaturea70f0fd -
initial commit
Verified signature0c8062d