Instructions to use Frankenstein-Labs/cortex.6.sol with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Frankenstein-Labs/cortex.6.sol with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Frankenstein-Labs/cortex.6.sol")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Frankenstein-Labs/cortex.6.sol")
model = AutoModelForCausalLM.from_pretrained("Frankenstein-Labs/cortex.6.sol", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Frankenstein-Labs/cortex.6.sol with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Frankenstein-Labs/cortex.6.sol"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Frankenstein-Labs/cortex.6.sol",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/Frankenstein-Labs/cortex.6.sol

SGLang

How to use Frankenstein-Labs/cortex.6.sol with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Frankenstein-Labs/cortex.6.sol" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Frankenstein-Labs/cortex.6.sol",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Frankenstein-Labs/cortex.6.sol" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Frankenstein-Labs/cortex.6.sol",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use Frankenstein-Labs/cortex.6.sol with Docker Model Runner:
```
docker model run hf.co/Frankenstein-Labs/cortex.6.sol
```

Frankenstein-Labs commited on Sep 16

Commit

df3d15e

verified ·

1 Parent(s): f9c4a89

Update README.md

Browse files

Files changed (1) hide show

README.md +13 -14

README.md CHANGED Viewed

@@ -2,16 +2,15 @@
 license: mit
 library_name: transformers
 pipeline_tag: text-generation
-base_model: deepseek-ai/DeepSeek-V4-Pro-0813
 tags:
-  - cortex-ai
-  - text-generation
-  - safetensors
-  - fp8
-  - fp4
-  - moe
-  - deepseek_v4
-  - arxiv:2606.19348
 ---
 # CORTEX AI
@@ -70,7 +69,7 @@ The following capabilities are part of the intended CORTEX ecosystem direction a
 ```text
 CORTEX AI distribution
-├── DeepSeek V4 causal language model
 ├── 66 safetensors weight shards
 ├── model.safetensors.index.json
 ├── tokenizer.json / tokenizer_config.json
@@ -101,7 +100,7 @@ This is an integration vision, not a description of files currently present in t
 | Property | Audited value |
 |---|---|
 | Model identity | CORTEX AI distribution of `deepseek-ai/DeepSeek-V4-Pro-0813` |
-| Architecture | `DeepseekV4ForCausalLM` / `deepseek_v4` |
 | Parameters | `1,650,497.9M` (Hugging Face repository metadata) |
 | Hidden layers | 61 |
 | Hidden size | 7,168 |
@@ -234,9 +233,9 @@ This repository is a distribution of the upstream model and is **not a new model
 | Item | Verified information |
 |---|---|
-| Upstream model | [`deepseek-ai/DeepSeek-V4-Pro-0813`](https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro-0813) |
 | Upstream revision recorded in the previous model card | `72e1d3230f6c080a530b0a1d46f8eb4602340597` |
-| Original author | DeepSeek AI |
 | License | MIT, Copyright (c) 2023 DeepSeek |
 | Technical report | [arXiv:2606.19348](https://arxiv.org/abs/2606.19348) |
@@ -260,4 +259,4 @@ For authoritative upstream model details, benchmarks and runtime guidance, consu
 ## Disclaimer
-The checkpoint is extremely large and requires specialized hardware and software support. Always validate the selected runtime, GPU memory, driver stack and license obligations before deployment.

 license: mit
 library_name: transformers
 pipeline_tag: text-generation
 tags:
+- cortex-ai
+- text-generation
+- safetensors
+- fp8
+- fp4
+- moe
+- Cortex ai
+- arxiv:2606.19348
 ---
 # CORTEX AI
 ```text
 CORTEX AI distribution
+├── Cortex-ai causal language model
 ├── 66 safetensors weight shards
 ├── model.safetensors.index.json
 ├── tokenizer.json / tokenizer_config.json
 | Property | Audited value |
 |---|---|
 | Model identity | CORTEX AI distribution of `deepseek-ai/DeepSeek-V4-Pro-0813` |
+| Architecture | ` Cortex-ai. v.0.1 ForCausalLM` / `deepseek_v4` |
 | Parameters | `1,650,497.9M` (Hugging Face repository metadata) |
 | Hidden layers | 61 |
 | Hidden size | 7,168 |
 | Item | Verified information |
 |---|---|
+| Upstream model | Cortex-ai  v.1|
 | Upstream revision recorded in the previous model card | `72e1d3230f6c080a530b0a1d46f8eb4602340597` |
+| Original author | Cortex-ai |
 | License | MIT, Copyright (c) 2023 DeepSeek |
 | Technical report | [arXiv:2606.19348](https://arxiv.org/abs/2606.19348) |
 ## Disclaimer
+The checkpoint is extremely large and requires specialized hardware and software support. Always validate the selected runtime, GPU memory, driver stack and license obligations before deployment.