Instructions to use Frankenstein-Labs/cortex.6.sol with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Frankenstein-Labs/cortex.6.sol with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Frankenstein-Labs/cortex.6.sol")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Frankenstein-Labs/cortex.6.sol")
model = AutoModelForCausalLM.from_pretrained("Frankenstein-Labs/cortex.6.sol", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Frankenstein-Labs/cortex.6.sol with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Frankenstein-Labs/cortex.6.sol"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Frankenstein-Labs/cortex.6.sol",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/Frankenstein-Labs/cortex.6.sol

SGLang

How to use Frankenstein-Labs/cortex.6.sol with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Frankenstein-Labs/cortex.6.sol" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Frankenstein-Labs/cortex.6.sol",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Frankenstein-Labs/cortex.6.sol" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Frankenstein-Labs/cortex.6.sol",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use Frankenstein-Labs/cortex.6.sol with Docker Model Runner:
```
docker model run hf.co/Frankenstein-Labs/cortex.6.sol
```

Frankenstein-Labs commited on Sep 16

Commit

afef00e

verified ·

1 Parent(s): df3d15e

Update README.md

Browse files

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -13,13 +13,13 @@ tags:
 - arxiv:2606.19348
 ---
-# CORTEX AI
 > **Next-generation AI for reasoning, mathematics, programming and intelligent software development.**
 CORTEX AI is the intelligence layer of the CORTEX ecosystem: a developer-oriented distribution and integration surface for advanced language-model capabilities. The project is created by **Abdoulaye**, young developer and founder of **Frankenstein-Labs**.
-This repository does **not** contain a newly trained model. It is a Hugging Face distribution of the upstream [`deepseek-ai/DeepSeek-V4-Pro-0813`](https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro-0813) checkpoint under the CORTEX AI identity. CORTEX provides the project identity, documentation, integration direction and ecosystem around the model; the upstream model design, training and evaluation remain attributable to DeepSeek AI.
 ## CORTEX at a glance
@@ -142,7 +142,7 @@ The audited requirement file specifies `torch>=2.10.0`, `transformers>=5.0.0`, `
 The repository contains a Transformers-compatible model configuration and tokenizer metadata. However, a complete `AutoModelForCausalLM.from_pretrained(...)` load was **not executed** during this audit because doing so would require downloading and materializing the full checkpoint. Consequently, no unverified Python loading snippet is provided here.
-For an implementation that supports `deepseek_v4`, use the repository identifier:
 ```text
 Frankenstein-Labs/Cortex-ai

 - arxiv:2606.19348
 ---
+# CORTEX AI pro max
 > **Next-generation AI for reasoning, mathematics, programming and intelligent software development.**
 CORTEX AI is the intelligence layer of the CORTEX ecosystem: a developer-oriented distribution and integration surface for advanced language-model capabilities. The project is created by **Abdoulaye**, young developer and founder of **Frankenstein-Labs**.
+This repository does **not** contain a newly trained model. It is a Hugging Face distribution of the upstream [`Cortex-ai checkpoint under the CORTEX AI identity. CORTEX provides the project identity, documentation, integration direction and ecosystem around the model; the upstream model design, training and evaluation remain attributable to DeepSeek AI.
 ## CORTEX at a glance
 The repository contains a Transformers-compatible model configuration and tokenizer metadata. However, a complete `AutoModelForCausalLM.from_pretrained(...)` load was **not executed** during this audit because doing so would require downloading and materializing the full checkpoint. Consequently, no unverified Python loading snippet is provided here.
+For an implementation that supports `Cortex.pro.max`, use the repository identifier:
 ```text
 Frankenstein-Labs/Cortex-ai