Text Generation
Transformers
Safetensors
French
English
Chinese
deepseek_v4
cortex
code-generation
web-development
software-engineering
Mixture of Experts
8-bit precision
fp8
Instructions to use Frankenstein-Labs/cortex.6.sol with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Frankenstein-Labs/cortex.6.sol with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Frankenstein-Labs/cortex.6.sol")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Frankenstein-Labs/cortex.6.sol") model = AutoModelForCausalLM.from_pretrained("Frankenstein-Labs/cortex.6.sol", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Frankenstein-Labs/cortex.6.sol with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Frankenstein-Labs/cortex.6.sol" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Frankenstein-Labs/cortex.6.sol", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/Frankenstein-Labs/cortex.6.sol
- SGLang
How to use Frankenstein-Labs/cortex.6.sol with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Frankenstein-Labs/cortex.6.sol" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Frankenstein-Labs/cortex.6.sol", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Frankenstein-Labs/cortex.6.sol" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Frankenstein-Labs/cortex.6.sol", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use Frankenstein-Labs/cortex.6.sol with Docker Model Runner:
docker model run hf.co/Frankenstein-Labs/cortex.6.sol
Commit History
22 days ago
-
Update README.md (#1)
- docs(cortex): drop base_model key from card frontmatter (f3389a6b126b12ff6f8d795f3427600477fa0a7a)d7eb9bc -
feat(cortex): add CORTEX training pipeline and model audit
openhands +1: openhandsFrankenstein-Labs' own CORTEX weights need a training pipeline. This adds one, strictly separate from the distributed 1.65T checkpoint, which no script here reads or modifies. Pipeline: - model/cortex_model.py decoder-only Transformer (RMSNorm, RoPE, GQA, SwiGLU) - model/init.py weight init and checkpoint I/O - tokenizer/ loads the shipped tokenizer, validates vocab_size - training/train.py training loop with a dataset licence gate - datasets/ code datasets with declared source and licence - evaluation/evaluate.py loss, perplexity, generation - configs/cortex/ cortex-dev-1, ~174,803,712 params Correctness details found while building it: - safetensors refuses to save storage-sharing keys, which tied embeddings are. The tied matrix is stored once, aliased in provenance.json, and re-expanded on load, so checkpoints stay lossless. - Cross-entropy over full 129280-wide fp32 logits restarted the sandbox, so the softmax is compute…6fbe100 -
docs(cortex): trim redundant model card tags
openhands +1: openhandsDrop tags that duplicate Hub metadata or each other (cortex-ai, frankenstein-labs, reasoning, long-context, fp8). Keep base_model and license: mit because the weights are still the byte-identical upstream files, so the parent relation and the MIT attribution remain factually and legally required. Co-authored-by: openhands <openhands@all-hands.dev>e1985ae -
docs(cortex): center public presentation on CORTEX and Frankenstein-Labs
openhands +1: openhandsRewrite the model card around CORTEX as the product: identity block (Model/Developer/Focus), the ten capabilities, an international vision section and the founder's statement. The base model and its legal attribution stay in a dedicated provenance/license section instead of the opening. No technical claim was changed; parameter counts, context size, quantization and the unverified-checkpoint disclaimer are intact. Co-authored-by: openhands <openhands@all-hands.dev>f7ae039
29 days ago
-
feat: update creator identity attribution
43fd0d0
30 days ago
-
docs(cortex-ai): correct provenance attribution and add French documentation
- name deepseek-ai/DeepSeek-V4-Pro-0813 as the upstream model and DeepSeek-AI as its author, replacing the incorrect Cortex-ai attribution in the provenance table - fix the copyright notice to match the retained LICENSE file (2023 DeepSeek) - replace the two dead upstream links with the working vLLM and SGLang pages - restore the real architecture name (DeepseekV4ForCausalLM / deepseek_v4) - restore the upstream BibTeX entry - rewrite the model card in French, centred on the CORTEX AI project - reword identity.py so the system prompt no longer claims the base model was created by Frankenstein-Labs; also fix accent/apostrophe matching in is_identity_question, which previously failed on 'Qui t a cree ?' - add docs/: getting started, message encoding and tool calling, distributed inference, and the real state of the vision layer The weight files are unchanged.2763f1c
-
Update README.md
Verified signature6214f10 -
docs(cortex-ai): remove base model tree link
Frankenstein-Labs0afd8ee -
docs(cortex-ai): emphasize project identity in model card
Frankenstein-Labs1895cec
-
feat(cortex-ai): add native vision fusion prototype
Frankenstein-Labsa82e5d8 -
feat(cortex-ai): add executable vision bridge
Frankenstein-Labs66e3394 -
feat(cortex-ai): establish identity and vision architecture
Verified signaturef5eae9c -
Cortex AI: rewrite model card (audited specs, verified provenance)
Verified signaturebe2363b -
Update README.md
Verified signatureafef00e -
Update README.md
Verified signaturedf3d15e -
Rewrite README as CORTEX AI model card
Frankenstein-Labsf9c4a89 -
Cortex AI: model card with DeepSeek provenance and attribution
Verified signature41a5f51 -
initial commit
Verified signaturef480d8b