Instructions to use RecursiveSI/flint with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use RecursiveSI/flint with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="RecursiveSI/flint")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("RecursiveSI/flint")
model = AutoModelForCausalLM.from_pretrained("RecursiveSI/flint", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use RecursiveSI/flint with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "RecursiveSI/flint"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "RecursiveSI/flint",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/RecursiveSI/flint

SGLang

How to use RecursiveSI/flint with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "RecursiveSI/flint" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "RecursiveSI/flint",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "RecursiveSI/flint" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "RecursiveSI/flint",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use RecursiveSI/flint with Docker Model Runner:
```
docker model run hf.co/RecursiveSI/flint
```

Why SI and not AI?

by PotatoSniffer - opened 1 day ago

Discussion

PotatoSniffer

1 day ago

Nobody will ever call it SI, seems like a terrible choice.

drmcbride

about 23 hours ago

stfu we dont care let them get money/good attention from the government

jtobin-recursive

Recursive Superintelligence, Inc. org about 22 hours ago

it's been our name since we started the company

KlondikeDev

about 22 hours ago

•

edited about 22 hours ago

Nobody will ever call it SI, seems like a terrible choice.

Yeah, SI is a real term, outside of the Trump thing. It is very possible that the mission is ASI, rather than something like that. I really don't think it matters either way, even if it is the Trump thing. It's just a name.

Also "RecursiveAI" sounds generally more like a type of AI than a company. If somebody told me they were running a "RecursiveAI model" I would think that they were running a AI model that is recursive.

inikishev

about 21 hours ago

•

edited about 21 hours ago

Nobody will ever call it SI, seems like a terrible choice.

its just a company name, the model is still called AGI

rollercoasterX

about 21 hours ago

stfu we dont care let them get money/good attention from the government

So we should name things the way the governments wants us too, and suck up to them just so we can get money? How is that working out for you?

rob-x-ai

about 21 hours ago

if someday something happens and i have to rename i'll also use SI.

drmcbride

about 15 hours ago

stfu we dont care let them get money/good attention from the government

So we should name things the way the governments wants us too, and suck up to them just so we can get money? How is that working out for you?

im sorry do you manage anything or understand how incentives work? in the real world you compromise and dont just be a social justice warrior 24/7

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment