|
Download README.md from liodon-ai/sqlcoder-7b-2-ONNX: direct link, hf CLI and curl.
- Browser
- Download file 1.89 kB
-
https://huggingface.co/liodon-ai/sqlcoder-7b-2-ONNX/resolve/main/README.md
- Command line
-
hf download hf://liodon-ai/sqlcoder-7b-2-ONNX/README.md
-
curl -L -o README.md https://huggingface.co/liodon-ai/sqlcoder-7b-2-ONNX/resolve/main/README.md
1.89 kB
| license: other | |
| base_model: defog/sqlcoder-7b-2 | |
| base_model_relation: quantized | |
| library_name: onnx | |
| pipeline_tag: text-generation | |
| tags: | |
| - onnx | |
| - onnxruntime | |
| - quantized | |
| quantized_by: liodon-ai | |
| # sqlcoder-7b-2 — ONNX | |
| ONNX export of [defog/sqlcoder-7b-2](https://huggingface.co/defog/sqlcoder-7b-2), published by [Liodon AI](https://huggingface.co/liodon-ai). | |
| Exported with [optimum](https://github.com/huggingface/optimum) (`optimum.exporters.onnx.main_export`, | |
| task `text-generation-with-past`, so the graph exposes past-key-value inputs/outputs for KV-cached | |
| autoregressive decoding). | |
| ## Files | |
| | File | Size | Notes | | |
| |------|------|-------| | |
| | `model.onnx` | 26.96 GB | FP32, full precision | | |
| | `model_fp16.onnx` | 14.55 GB | FP16, for GPU execution providers | | |
| ## Quick Start | |
| ```python | |
| import onnxruntime as ort | |
| from transformers import AutoTokenizer | |
| tok = AutoTokenizer.from_pretrained("liodon-ai/sqlcoder-7b-2-ONNX") | |
| sess = ort.InferenceSession("model_quantized.onnx", providers=["CPUExecutionProvider"]) | |
| # past_key_values.*.key / .value inputs must be supplied (zero-length tensors | |
| # for the first forward pass) -- see optimum's ORTModelForCausalLM for a | |
| # ready-made wrapper that handles KV-cache bookkeeping automatically: | |
| # from optimum.onnxruntime import ORTModelForCausalLM | |
| # model = ORTModelForCausalLM.from_pretrained("liodon-ai/sqlcoder-7b-2-ONNX", file_name="model_quantized.onnx") | |
| ``` | |
| ## Source | |
| - **Model**: [defog/sqlcoder-7b-2](https://huggingface.co/defog/sqlcoder-7b-2) | |
| - **License**: other | |
| ## Citation | |
| ```bibtex | |
| @misc{liodonai_sqlcoder_7b_2_onnx, | |
| title = {sqlcoder-7b-2 — ONNX}, | |
| author = {{Liodon AI}}, | |
| year = {2026}, | |
| howpublished = {\url{https://huggingface.co/liodon-ai/sqlcoder-7b-2-ONNX}}, | |
| note = {ONNX export of defog/sqlcoder-7b-2} | |
| } | |
| ``` | |
| --- | |
| *Exported by [Liodon AI](https://huggingface.co/liodon-ai)* | |