Instructions to use Raymond-dev-546730/MaterialsAnalyst-AI-7B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries
PEFT
How to use Raymond-dev-546730/MaterialsAnalyst-AI-7B with PEFT:
```
Task type is invalid.
```
Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use Raymond-dev-546730/MaterialsAnalyst-AI-7B with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M
# Run inference directly in the terminal:
./llama-cli -hf Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama-cli -hf Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M

Use Docker

docker model run hf.co/Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M

LM Studio
Jan

vLLM

How to use Raymond-dev-546730/MaterialsAnalyst-AI-7B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Raymond-dev-546730/MaterialsAnalyst-AI-7B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Raymond-dev-546730/MaterialsAnalyst-AI-7B",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M

Ollama
How to use Raymond-dev-546730/MaterialsAnalyst-AI-7B with Ollama:
```
ollama run hf.co/Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M
```
Unsloth Desktop
Docker Model Runner
How to use Raymond-dev-546730/MaterialsAnalyst-AI-7B with Docker Model Runner:
```
docker model run hf.co/Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M
```

Lemonade

How to use Raymond-dev-546730/MaterialsAnalyst-AI-7B with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M

Run and chat with the model

lemonade run user.MaterialsAnalyst-AI-7B-Q4_K_M

List all available models

lemonade list

Atomic Chat

MaterialsAnalyst-AI-7B

Commit History

Aug 1

07:46
Update README.md

Raymond-dev-546730

Verified signature
807657d

Jul 2

06:11
Update README.md

Raymond-dev-546730

Verified signature
47d3767

Jun 1

20:33
Update README.md

Raymond-dev-546730

Verified signature
71873d9
20:27
Update README.md

Raymond-dev-546730

Verified signature
db7141f

Jan 27

09:53
Update Training/Training_Documentation.txt

Raymond-dev-546730

Verified signature
11a4806

Dec 15, 2025

09:53
Update README.md

Raymond-dev-546730

Verified signature
9a5583e
09:32
Update README.md

Raymond-dev-546730

Verified signature
867cd5c

Dec 12, 2025

18:12
Update README.md

Raymond-dev-546730

Verified signature
ec5c3e0

Dec 5, 2025

10:13
Update README.md

Raymond-dev-546730

Verified signature
994247b

Nov 29, 2025

19:53
Update README.md

Raymond-dev-546730

Verified signature
1702fd2

Nov 15, 2025

05:30
Update README.md

Raymond-dev-546730

Verified signature
a4dbbac

Nov 2, 2025

01:04
Update README.md

Raymond-dev-546730

Verified signature
bcf73d4

Oct 19, 2025

21:00
Update README.md

Raymond-dev-546730

Verified signature
8280cdf

Oct 10, 2025

19:25
Update README.md

Raymond-dev-546730

Verified signature
52fa213

Oct 7, 2025

17:11
Update README.md

Raymond-dev-546730

Verified signature
fede6b7

Oct 6, 2025

16:34
Update README.md

Raymond-dev-546730

Verified signature
b8637df

Oct 1, 2025

17:07
Update README.md

Raymond-dev-546730

Verified signature
9d7ef30
16:27
Update README.md

Raymond-dev-546730

Verified signature
bb55b4c

Sep 1, 2025

17:14
Update README.md

Raymond-dev-546730

Verified signature
90bf4d1

Aug 25, 2025

17:03
Update README.md

Raymond-dev-546730

Verified signature
d929215
17:03
Update README.md

Raymond-dev-546730

Verified signature
c93375e

Aug 24, 2025

23:12
Update README.md

Raymond-dev-546730

Verified signature
5ea9a06
05:55
Update README.md

Raymond-dev-546730

Verified signature
019e298

Aug 22, 2025

18:49
Upload Model_Logo.png

Raymond-dev-546730

Verified signature
faf4e3a
18:48
Delete Model_Logo.png

Raymond-dev-546730

Verified signature
1115b6c

Aug 20, 2025

17:14
Update Training/Training_Documentation.txt

Raymond-dev-546730

Verified signature
537c331
16:37
Update README.md

Raymond-dev-546730

Verified signature
f138bd3
16:37
Update README.md

Raymond-dev-546730

Verified signature
4fa1576
05:12
Upload 2 files

Raymond-dev-546730

Verified signature
e2e37c0
02:14
Delete Model_Weights/llama.cpp/MaterialsAnalyst-AI-7B-Q3_K.gguf

Raymond-dev-546730

Verified signature
5949521
02:13
Delete Model_Weights/llama.cpp/MaterialsAnalyst-AI-7B-Q4_K.gguf

Raymond-dev-546730

Verified signature
f694801
02:13
Delete Model_Weights/llama.cpp/MaterialsAnalyst-AI-7B-Q5_K.gguf

Raymond-dev-546730

Verified signature
7abfa56

Aug 17, 2025

22:24
Update README.md

Raymond-dev-546730

Verified signature
255e1c5
19:19
Update Training/Training_Logs.txt

Raymond-dev-546730

Verified signature
85fc5c3
19:17
Update README.md

Raymond-dev-546730

Verified signature
b4f9d3f
19:17
Rename Data/Train-Ready.jsonl to Data/Dataset.jsonl

Raymond-dev-546730

Verified signature
b9fb739

Aug 15, 2025

16:58
Update README.md

Raymond-dev-546730

Verified signature
9bdd4b8

Aug 10, 2025

18:21
Update README.md

Raymond-dev-546730

Verified signature
3221384

Aug 5, 2025

21:08
Update README.md

Raymond-dev-546730

Verified signature
640992f

Jul 31, 2025

05:06
Update README.md

Raymond-dev-546730

Verified signature
c88ede9

Jul 30, 2025

16:38
Update README.md

Raymond-dev-546730

Verified signature
59c0f04

Jul 25, 2025

17:02
Update README.md

Raymond-dev-546730

Verified signature
bd786b6

Jul 20, 2025

21:46
Update README.md

Raymond-dev-546730

Verified signature
4724de2

Jul 15, 2025

21:35
Update README.md

Raymond-dev-546730

Verified signature
3125dd9

Jul 10, 2025

18:29
Update README.md

Raymond-dev-546730

Verified signature
a560714

Jul 6, 2025

00:03
Update README.md

Raymond-dev-546730

Verified signature
1edea24
00:02
Update README.md

Raymond-dev-546730

Verified signature
cd55440
00:02
Delete Model_Weights/LoRA_adapter/text.txt

Raymond-dev-546730

Verified signature
27729b1
00:01
Upload 9 files

Raymond-dev-546730

Verified signature
3d8e09e
00:01
Create LoRA_adapter/text.txt

Raymond-dev-546730

Verified signature
57962e0

Commit History

Aug 1

Update README.md

Jul 2

Update README.md

Jun 1

Update README.md

Update README.md

Jan 27

Update Training/Training_Documentation.txt

Dec 15, 2025

Update README.md

Update README.md

Dec 12, 2025

Update README.md

Dec 5, 2025

Update README.md

Nov 29, 2025

Update README.md

Nov 15, 2025

Update README.md

Nov 2, 2025

Update README.md

Oct 19, 2025

Update README.md

Oct 10, 2025

Update README.md

Oct 7, 2025

Update README.md

Oct 6, 2025

Update README.md

Oct 1, 2025

Update README.md

Update README.md

Sep 1, 2025

Update README.md

Aug 25, 2025

Update README.md

Update README.md

Aug 24, 2025

Update README.md

Update README.md

Aug 22, 2025

Upload Model_Logo.png

Delete Model_Logo.png

Aug 20, 2025

Update Training/Training_Documentation.txt

Update README.md

Update README.md

Upload 2 files

Delete Model_Weights/llama.cpp/MaterialsAnalyst-AI-7B-Q3_K.gguf

Delete Model_Weights/llama.cpp/MaterialsAnalyst-AI-7B-Q4_K.gguf

Delete Model_Weights/llama.cpp/MaterialsAnalyst-AI-7B-Q5_K.gguf

Aug 17, 2025

Update README.md

Update Training/Training_Logs.txt

Update README.md

Rename Data/Train-Ready.jsonl to Data/Dataset.jsonl

Aug 15, 2025

Update README.md

Aug 10, 2025

Update README.md

Aug 5, 2025

Update README.md

Jul 31, 2025

Update README.md

Jul 30, 2025

Update README.md

Jul 25, 2025

Update README.md

Jul 20, 2025

Update README.md

Jul 15, 2025

Update README.md

Jul 10, 2025

Update README.md

Jul 6, 2025

Update README.md

Update README.md

Delete Model_Weights/LoRA_adapter/text.txt