Instructions to use Rahspide/MNN-Pocket-0.3B-RU-Chat with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Rahspide/MNN-Pocket-0.3B-RU-Chat with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Rahspide/MNN-Pocket-0.3B-RU-Chat")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Rahspide/MNN-Pocket-0.3B-RU-Chat")
model = AutoModelForCausalLM.from_pretrained("Rahspide/MNN-Pocket-0.3B-RU-Chat", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use Rahspide/MNN-Pocket-0.3B-RU-Chat with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Rahspide/MNN-Pocket-0.3B-RU-Chat:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf Rahspide/MNN-Pocket-0.3B-RU-Chat:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Rahspide/MNN-Pocket-0.3B-RU-Chat:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf Rahspide/MNN-Pocket-0.3B-RU-Chat:Q4_K_M

Build from source code

git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-app
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama serve -hf Rahspide/MNN-Pocket-0.3B-RU-Chat:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama cli -hf Rahspide/MNN-Pocket-0.3B-RU-Chat:Q4_K_M

Use Docker

docker model run hf.co/Rahspide/MNN-Pocket-0.3B-RU-Chat:Q4_K_M

Llama new
LM Studio
Jan

vLLM

How to use Rahspide/MNN-Pocket-0.3B-RU-Chat with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Rahspide/MNN-Pocket-0.3B-RU-Chat"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Rahspide/MNN-Pocket-0.3B-RU-Chat",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Rahspide/MNN-Pocket-0.3B-RU-Chat:Q4_K_M

SGLang

How to use Rahspide/MNN-Pocket-0.3B-RU-Chat with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Rahspide/MNN-Pocket-0.3B-RU-Chat" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Rahspide/MNN-Pocket-0.3B-RU-Chat",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Rahspide/MNN-Pocket-0.3B-RU-Chat" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Rahspide/MNN-Pocket-0.3B-RU-Chat",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Ollama
How to use Rahspide/MNN-Pocket-0.3B-RU-Chat with Ollama:
```
ollama run hf.co/Rahspide/MNN-Pocket-0.3B-RU-Chat:Q4_K_M
```
Unsloth Desktop

How to use Rahspide/MNN-Pocket-0.3B-RU-Chat with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf Rahspide/MNN-Pocket-0.3B-RU-Chat:Q4_K_M

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "Rahspide/MNN-Pocket-0.3B-RU-Chat:Q4_K_M"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Docker Model Runner
How to use Rahspide/MNN-Pocket-0.3B-RU-Chat with Docker Model Runner:
```
docker model run hf.co/Rahspide/MNN-Pocket-0.3B-RU-Chat:Q4_K_M
```

Lemonade

How to use Rahspide/MNN-Pocket-0.3B-RU-Chat with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull Rahspide/MNN-Pocket-0.3B-RU-Chat:Q4_K_M

Run and chat with the model

lemonade run user.MNN-Pocket-0.3B-RU-Chat-Q4_K_M

List all available models

lemonade list

Hermes Agent

How to use Rahspide/MNN-Pocket-0.3B-RU-Chat with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf Rahspide/MNN-Pocket-0.3B-RU-Chat:Q4_K_M

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default Rahspide/MNN-Pocket-0.3B-RU-Chat:Q4_K_M

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use Rahspide/MNN-Pocket-0.3B-RU-Chat with OpenClaw:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf Rahspide/MNN-Pocket-0.3B-RU-Chat:Q4_K_M

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "Rahspide/MNN-Pocket-0.3B-RU-Chat:Q4_K_M" \
  --custom-provider-id llama-cpp \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

Rahspide commited on 4 days ago

Commit

08b3232

verified ·

1 Parent(s): 57377ef

review: 60-prompt A/B sheet and auto metrics

Browse files

Files changed (1) hide show

review/metrics.json +1224 -0

review/metrics.json ADDED Viewed

	@@ -0,0 +1,1224 @@

+{
+ "summary": {
+  "ours": {
+   "items": 60,
+   "empty": 0,
+   "echo": 2,
+   "avg_words": 26.1,
+   "avg_cyr_share": 0.934,
+   "avg_distinct2": 0.899,
+   "russian_answers": 57
+  },
+  "official": {
+   "items": 60,
+   "empty": 0,
+   "echo": 0,
+   "avg_words": 31.9,
+   "avg_cyr_share": 0.754,
+   "avg_distinct2": 0.823,
+   "russian_answers": 47
+  }
+ },
+ "items": [
+  {
+   "chars": 17,
+   "words": 3,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 0,
+   "model": "ours"
+  },
+  {
+   "chars": 191,
+   "words": 22,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 0,
+   "model": "official"
+  },
+  {
+   "chars": 56,
+   "words": 7,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 1,
+   "model": "ours"
+  },
+  {
+   "chars": 225,
+   "words": 23,
+   "cyr_share": 0.94,
+   "distinct2": 0.818,
+   "echo": false,
+   "empty": false,
+   "i": 1,
+   "model": "official"
+  },
+  {
+   "chars": 197,
+   "words": 28,
+   "cyr_share": 1.0,
+   "distinct2": 0.963,
+   "echo": false,
+   "empty": false,
+   "i": 2,
+   "model": "ours"
+  },
+  {
+   "chars": 214,
+   "words": 28,
+   "cyr_share": 0.958,
+   "distinct2": 0.926,
+   "echo": false,
+   "empty": false,
+   "i": 2,
+   "model": "official"
+  },
+  {
+   "chars": 185,
+   "words": 25,
+   "cyr_share": 1.0,
+   "distinct2": 0.958,
+   "echo": false,
+   "empty": false,
+   "i": 3,
+   "model": "ours"
+  },
+  {
+   "chars": 165,
+   "words": 24,
+   "cyr_share": 1.0,
+   "distinct2": 0.435,
+   "echo": false,
+   "empty": false,
+   "i": 3,
+   "model": "official"
+  },
+  {
+   "chars": 226,
+   "words": 34,
+   "cyr_share": 1.0,
+   "distinct2": 0.667,
+   "echo": false,
+   "empty": false,
+   "i": 4,
+   "model": "ours"
+  },
+  {
+   "chars": 243,
+   "words": 25,
+   "cyr_share": 0.938,
+   "distinct2": 0.833,
+   "echo": false,
+   "empty": false,
+   "i": 4,
+   "model": "official"
+  },
+  {
+   "chars": 211,
+   "words": 46,
+   "cyr_share": 1.0,
+   "distinct2": 0.489,
+   "echo": false,
+   "empty": false,
+   "i": 5,
+   "model": "ours"
+  },
+  {
+   "chars": 155,
+   "words": 23,
+   "cyr_share": 1.0,
+   "distinct2": 0.5,
+   "echo": false,
+   "empty": false,
+   "i": 5,
+   "model": "official"
+  },
+  {
+   "chars": 205,
+   "words": 24,
+   "cyr_share": 1.0,
+   "distinct2": 0.957,
+   "echo": false,
+   "empty": false,
+   "i": 6,
+   "model": "ours"
+  },
+  {
+   "chars": 430,
+   "words": 64,
+   "cyr_share": 0.0,
+   "distinct2": 0.952,
+   "echo": false,
+   "empty": false,
+   "i": 6,
+   "model": "official"
+  },
+  {
+   "chars": 175,
+   "words": 30,
+   "cyr_share": 1.0,
+   "distinct2": 0.966,
+   "echo": false,
+   "empty": false,
+   "i": 7,
+   "model": "ours"
+  },
+  {
+   "chars": 211,
+   "words": 20,
+   "cyr_share": 1.0,
+   "distinct2": 0.737,
+   "echo": false,
+   "empty": false,
+   "i": 7,
+   "model": "official"
+  },
+  {
+   "chars": 226,
+   "words": 28,
+   "cyr_share": 1.0,
+   "distinct2": 0.963,
+   "echo": false,
+   "empty": false,
+   "i": 8,
+   "model": "ours"
+  },
+  {
+   "chars": 338,
+   "words": 54,
+   "cyr_share": 0.07,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 8,
+   "model": "official"
+  },
+  {
+   "chars": 176,
+   "words": 25,
+   "cyr_share": 1.0,
+   "distinct2": 0.833,
+   "echo": false,
+   "empty": false,
+   "i": 9,
+   "model": "ours"
+  },
+  {
+   "chars": 198,
+   "words": 28,
+   "cyr_share": 1.0,
+   "distinct2": 0.778,
+   "echo": false,
+   "empty": false,
+   "i": 9,
+   "model": "official"
+  },
+  {
+   "chars": 209,
+   "words": 28,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 10,
+   "model": "ours"
+  },
+  {
+   "chars": 197,
+   "words": 22,
+   "cyr_share": 0.958,
+   "distinct2": 0.905,
+   "echo": false,
+   "empty": false,
+   "i": 10,
+   "model": "official"
+  },
+  {
+   "chars": 47,
+   "words": 6,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 11,
+   "model": "ours"
+  },
+  {
+   "chars": 141,
+   "words": 16,
+   "cyr_share": 0.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 11,
+   "model": "official"
+  },
+  {
+   "chars": 53,
+   "words": 7,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 12,
+   "model": "ours"
+  },
+  {
+   "chars": 169,
+   "words": 22,
+   "cyr_share": 1.0,
+   "distinct2": 0.714,
+   "echo": false,
+   "empty": false,
+   "i": 12,
+   "model": "official"
+  },
+  {
+   "chars": 225,
+   "words": 29,
+   "cyr_share": 0.967,
+   "distinct2": 0.929,
+   "echo": false,
+   "empty": false,
+   "i": 13,
+   "model": "ours"
+  },
+  {
+   "chars": 297,
+   "words": 51,
+   "cyr_share": 0.0,
+   "distinct2": 0.78,
+   "echo": false,
+   "empty": false,
+   "i": 13,
+   "model": "official"
+  },
+  {
+   "chars": 192,
+   "words": 29,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": true,
+   "empty": false,
+   "i": 14,
+   "model": "ours"
+  },
+  {
+   "chars": 191,
+   "words": 22,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 14,
+   "model": "official"
+  },
+  {
+   "chars": 47,
+   "words": 8,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 15,
+   "model": "ours"
+  },
+  {
+   "chars": 193,
+   "words": 25,
+   "cyr_share": 0.908,
+   "distinct2": 0.667,
+   "echo": false,
+   "empty": false,
+   "i": 15,
+   "model": "official"
+  },
+  {
+   "chars": 210,
+   "words": 29,
+   "cyr_share": 1.0,
+   "distinct2": 0.964,
+   "echo": false,
+   "empty": false,
+   "i": 16,
+   "model": "ours"
+  },
+  {
+   "chars": 193,
+   "words": 30,
+   "cyr_share": 1.0,
+   "distinct2": 0.517,
+   "echo": false,
+   "empty": false,
+   "i": 16,
+   "model": "official"
+  },
+  {
+   "chars": 231,
+   "words": 28,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 17,
+   "model": "ours"
+  },
+  {
+   "chars": 176,
+   "words": 26,
+   "cyr_share": 1.0,
+   "distinct2": 0.4,
+   "echo": false,
+   "empty": false,
+   "i": 17,
+   "model": "official"
+  },
+  {
+   "chars": 138,
+   "words": 10,
+   "cyr_share": 0.736,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 18,
+   "model": "ours"
+  },
+  {
+   "chars": 370,
+   "words": 67,
+   "cyr_share": 0.0,
+   "distinct2": 0.939,
+   "echo": false,
+   "empty": false,
+   "i": 18,
+   "model": "official"
+  },
+  {
+   "chars": 211,
+   "words": 30,
+   "cyr_share": 1.0,
+   "distinct2": 0.931,
+   "echo": false,
+   "empty": false,
+   "i": 19,
+   "model": "ours"
+  },
+  {
+   "chars": 454,
+   "words": 69,
+   "cyr_share": 0.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 19,
+   "model": "official"
+  },
+  {
+   "chars": 105,
+   "words": 15,
+   "cyr_share": 0.907,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 20,
+   "model": "ours"
+  },
+  {
+   "chars": 195,
+   "words": 28,
+   "cyr_share": 0.931,
+   "distinct2": 0.889,
+   "echo": false,
+   "empty": false,
+   "i": 20,
+   "model": "official"
+  },
+  {
+   "chars": 46,
+   "words": 8,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 21,
+   "model": "ours"
+  },
+  {
+   "chars": 39,
+   "words": 9,
+   "cyr_share": 0.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 21,
+   "model": "official"
+  },
+  {
+   "chars": 213,
+   "words": 30,
+   "cyr_share": 1.0,
+   "distinct2": 0.862,
+   "echo": false,
+   "empty": false,
+   "i": 22,
+   "model": "ours"
+  },
+  {
+   "chars": 202,
+   "words": 25,
+   "cyr_share": 1.0,
+   "distinct2": 0.875,
+   "echo": false,
+   "empty": false,
+   "i": 22,
+   "model": "official"
+  },
+  {
+   "chars": 165,
+   "words": 25,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 23,
+   "model": "ours"
+  },
+  {
+   "chars": 195,
+   "words": 28,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 23,
+   "model": "official"
+  },
+  {
+   "chars": 214,
+   "words": 33,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 24,
+   "model": "ours"
+  },
+  {
+   "chars": 214,
+   "words": 31,
+   "cyr_share": 0.94,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 24,
+   "model": "official"
+  },
+  {
+   "chars": 219,
+   "words": 29,
+   "cyr_share": 0.994,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 25,
+   "model": "ours"
+  },
+  {
+   "chars": 207,
+   "words": 29,
+   "cyr_share": 1.0,
+   "distinct2": 0.964,
+   "echo": false,
+   "empty": false,
+   "i": 25,
+   "model": "official"
+  },
+  {
+   "chars": 198,
+   "words": 31,
+   "cyr_share": 1.0,
+   "distinct2": 0.767,
+   "echo": false,
+   "empty": false,
+   "i": 26,
+   "model": "ours"
+  },
+  {
+   "chars": 202,
+   "words": 28,
+   "cyr_share": 1.0,
+   "distinct2": 0.778,
+   "echo": false,
+   "empty": false,
+   "i": 26,
+   "model": "official"
+  },
+  {
+   "chars": 181,
+   "words": 33,
+   "cyr_share": 1.0,
+   "distinct2": 0.469,
+   "echo": false,
+   "empty": false,
+   "i": 27,
+   "model": "ours"
+  },
+  {
+   "chars": 182,
+   "words": 16,
+   "cyr_share": 1.0,
+   "distinct2": 0.867,
+   "echo": false,
+   "empty": false,
+   "i": 27,
+   "model": "official"
+  },
+  {
+   "chars": 67,
+   "words": 12,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 28,
+   "model": "ours"
+  },
+  {
+   "chars": 205,
+   "words": 27,
+   "cyr_share": 0.972,
+   "distinct2": 0.846,
+   "echo": false,
+   "empty": false,
+   "i": 28,
+   "model": "official"
+  },
+  {
+   "chars": 225,
+   "words": 34,
+   "cyr_share": 0.961,
+   "distinct2": 0.97,
+   "echo": false,
+   "empty": false,
+   "i": 29,
+   "model": "ours"
+  },
+  {
+   "chars": 196,
+   "words": 27,
+   "cyr_share": 0.933,
+   "distinct2": 0.885,
+   "echo": false,
+   "empty": false,
+   "i": 29,
+   "model": "official"
+  },
+  {
+   "chars": 191,
+   "words": 34,
+   "cyr_share": 1.0,
+   "distinct2": 0.97,
+   "echo": false,
+   "empty": false,
+   "i": 30,
+   "model": "ours"
+  },
+  {
+   "chars": 235,
+   "words": 33,
+   "cyr_share": 0.657,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 30,
+   "model": "official"
+  },
+  {
+   "chars": 199,
+   "words": 25,
+   "cyr_share": 1.0,
+   "distinct2": 0.958,
+   "echo": false,
+   "empty": false,
+   "i": 31,
+   "model": "ours"
+  },
+  {
+   "chars": 193,
+   "words": 33,
+   "cyr_share": 1.0,
+   "distinct2": 0.719,
+   "echo": false,
+   "empty": false,
+   "i": 31,
+   "model": "official"
+  },
+  {
+   "chars": 213,
+   "words": 25,
+   "cyr_share": 0.969,
+   "distinct2": 0.667,
+   "echo": false,
+   "empty": false,
+   "i": 32,
+   "model": "ours"
+  },
+  {
+   "chars": 444,
+   "words": 61,
+   "cyr_share": 0.029,
+   "distinct2": 0.967,
+   "echo": false,
+   "empty": false,
+   "i": 32,
+   "model": "official"
+  },
+  {
+   "chars": 212,
+   "words": 29,
+   "cyr_share": 1.0,
+   "distinct2": 0.964,
+   "echo": false,
+   "empty": false,
+   "i": 33,
+   "model": "ours"
+  },
+  {
+   "chars": 208,
+   "words": 36,
+   "cyr_share": 0.717,
+   "distinct2": 0.914,
+   "echo": false,
+   "empty": false,
+   "i": 33,
+   "model": "official"
+  },
+  {
+   "chars": 111,
+   "words": 17,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 34,
+   "model": "ours"
+  },
+  {
+   "chars": 195,
+   "words": 31,
+   "cyr_share": 0.933,
+   "distinct2": 0.933,
+   "echo": false,
+   "empty": false,
+   "i": 34,
+   "model": "official"
+  },
+  {
+   "chars": 204,
+   "words": 26,
+   "cyr_share": 1.0,
+   "distinct2": 0.92,
+   "echo": false,
+   "empty": false,
+   "i": 35,
+   "model": "ours"
+  },
+  {
+   "chars": 160,
+   "words": 22,
+   "cyr_share": 0.929,
+   "distinct2": 0.952,
+   "echo": false,
+   "empty": false,
+   "i": 35,
+   "model": "official"
+  },
+  {
+   "chars": 215,
+   "words": 33,
+   "cyr_share": 0.851,
+   "distinct2": 0.969,
+   "echo": false,
+   "empty": false,
+   "i": 36,
+   "model": "ours"
+  },
+  {
+   "chars": 213,
+   "words": 29,
+   "cyr_share": 0.765,
+   "distinct2": 0.857,
+   "echo": false,
+   "empty": false,
+   "i": 36,
+   "model": "official"
+  },
+  {
+   "chars": 204,
+   "words": 33,
+   "cyr_share": 1.0,
+   "distinct2": 0.875,
+   "echo": false,
+   "empty": false,
+   "i": 37,
+   "model": "ours"
+  },
+  {
+   "chars": 204,
+   "words": 22,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 37,
+   "model": "official"
+  },
+  {
+   "chars": 425,
+   "words": 79,
+   "cyr_share": 0.0,
+   "distinct2": 0.654,
+   "echo": false,
+   "empty": false,
+   "i": 38,
+   "model": "ours"
+  },
+  {
+   "chars": 490,
+   "words": 67,
+   "cyr_share": 0.0,
+   "distinct2": 0.97,
+   "echo": false,
+   "empty": false,
+   "i": 38,
+   "model": "official"
+  },
+  {
+   "chars": 106,
+   "words": 14,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 39,
+   "model": "ours"
+  },
+  {
+   "chars": 193,
+   "words": 25,
+   "cyr_share": 1.0,
+   "distinct2": 0.542,
+   "echo": false,
+   "empty": false,
+   "i": 39,
+   "model": "official"
+  },
+  {
+   "chars": 204,
+   "words": 35,
+   "cyr_share": 1.0,
+   "distinct2": 0.971,
+   "echo": false,
+   "empty": false,
+   "i": 40,
+   "model": "ours"
+  },
+  {
+   "chars": 185,
+   "words": 31,
+   "cyr_share": 1.0,
+   "distinct2": 0.733,
+   "echo": false,
+   "empty": false,
+   "i": 40,
+   "model": "official"
+  },
+  {
+   "chars": 99,
+   "words": 11,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 41,
+   "model": "ours"
+  },
+  {
+   "chars": 208,
+   "words": 28,
+   "cyr_share": 1.0,
+   "distinct2": 0.333,
+   "echo": false,
+   "empty": false,
+   "i": 41,
+   "model": "official"
+  },
+  {
+   "chars": 204,
+   "words": 27,
+   "cyr_share": 1.0,
+   "distinct2": 0.846,
+   "echo": false,
+   "empty": false,
+   "i": 42,
+   "model": "ours"
+  },
+  {
+   "chars": 187,
+   "words": 26,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 42,
+   "model": "official"
+  },
+  {
+   "chars": 231,
+   "words": 36,
+   "cyr_share": 1.0,
+   "distinct2": 0.371,
+   "echo": false,
+   "empty": false,
+   "i": 43,
+   "model": "ours"
+  },
+  {
+   "chars": 206,
+   "words": 24,
+   "cyr_share": 0.962,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 43,
+   "model": "official"
+  },
+  {
+   "chars": 140,
+   "words": 19,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 44,
+   "model": "ours"
+  },
+  {
+   "chars": 216,
+   "words": 33,
+   "cyr_share": 0.941,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 44,
+   "model": "official"
+  },
+  {
+   "chars": 78,
+   "words": 8,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 45,
+   "model": "ours"
+  },
+  {
+   "chars": 203,
+   "words": 30,
+   "cyr_share": 1.0,
+   "distinct2": 0.69,
+   "echo": false,
+   "empty": false,
+   "i": 45,
+   "model": "official"
+  },
+  {
+   "chars": 216,
+   "words": 35,
+   "cyr_share": 0.0,
+   "distinct2": 0.618,
+   "echo": false,
+   "empty": false,
+   "i": 46,
+   "model": "ours"
+  },
+  {
+   "chars": 360,
+   "words": 75,
+   "cyr_share": 0.0,
+   "distinct2": 0.959,
+   "echo": false,
+   "empty": false,
+   "i": 46,
+   "model": "official"
+  },
+  {
+   "chars": 203,
+   "words": 29,
+   "cyr_share": 0.958,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 47,
+   "model": "ours"
+  },
+  {
+   "chars": 190,
+   "words": 32,
+   "cyr_share": 0.944,
+   "distinct2": 0.516,
+   "echo": false,
+   "empty": false,
+   "i": 47,
+   "model": "official"
+  },
+  {
+   "chars": 231,
+   "words": 31,
+   "cyr_share": 0.876,
+   "distinct2": 0.967,
+   "echo": false,
+   "empty": false,
+   "i": 48,
+   "model": "ours"
+  },
+  {
+   "chars": 328,
+   "words": 56,
+   "cyr_share": 0.019,
+   "distinct2": 0.964,
+   "echo": false,
+   "empty": false,
+   "i": 48,
+   "model": "official"
+  },
+  {
+   "chars": 197,
+   "words": 26,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 49,
+   "model": "ours"
+  },
+  {
+   "chars": 219,
+   "words": 19,
+   "cyr_share": 0.927,
+   "distinct2": 0.556,
+   "echo": false,
+   "empty": false,
+   "i": 49,
+   "model": "official"
+  },
+  {
+   "chars": 183,
+   "words": 28,
+   "cyr_share": 0.933,
+   "distinct2": 0.407,
+   "echo": false,
+   "empty": false,
+   "i": 50,
+   "model": "ours"
+  },
+  {
+   "chars": 130,
+   "words": 29,
+   "cyr_share": 1.0,
+   "distinct2": 0.393,
+   "echo": false,
+   "empty": false,
+   "i": 50,
+   "model": "official"
+  },
+  {
+   "chars": 206,
+   "words": 27,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 51,
+   "model": "ours"
+  },
+  {
+   "chars": 258,
+   "words": 46,
+   "cyr_share": 0.0,
+   "distinct2": 0.822,
+   "echo": false,
+   "empty": false,
+   "i": 51,
+   "model": "official"
+  },
+  {
+   "chars": 367,
+   "words": 72,
+   "cyr_share": 0.0,
+   "distinct2": 0.901,
+   "echo": false,
+   "empty": false,
+   "i": 52,
+   "model": "ours"
+  },
+  {
+   "chars": 261,
+   "words": 49,
+   "cyr_share": 0.0,
+   "distinct2": 0.979,
+   "echo": false,
+   "empty": false,
+   "i": 52,
+   "model": "official"
+  },
+  {
+   "chars": 237,
+   "words": 28,
+   "cyr_share": 1.0,
+   "distinct2": 0.815,
+   "echo": false,
+   "empty": false,
+   "i": 53,
+   "model": "ours"
+  },
+  {
+   "chars": 201,
+   "words": 24,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 53,
+   "model": "official"
+  },
+  {
+   "chars": 152,
+   "words": 21,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": true,
+   "empty": false,
+   "i": 54,
+   "model": "ours"
+  },
+  {
+   "chars": 74,
+   "words": 10,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 54,
+   "model": "official"
+  },
+  {
+   "chars": 34,
+   "words": 6,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 55,
+   "model": "ours"
+  },
+  {
+   "chars": 187,
+   "words": 35,
+   "cyr_share": 1.0,
+   "distinct2": 0.824,
+   "echo": false,
+   "empty": false,
+   "i": 55,
+   "model": "official"
+  },
+  {
+   "chars": 210,
+   "words": 30,
+   "cyr_share": 0.963,
+   "distinct2": 0.793,
+   "echo": false,
+   "empty": false,
+   "i": 56,
+   "model": "ours"
+  },
+  {
+   "chars": 196,
+   "words": 21,
+   "cyr_share": 1.0,
+   "distinct2": 0.6,
+   "echo": false,
+   "empty": false,
+   "i": 56,
+   "model": "official"
+  },
+  {
+   "chars": 217,
+   "words": 28,
+   "cyr_share": 0.928,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 57,
+   "model": "ours"
+  },
+  {
+   "chars": 192,
+   "words": 25,
+   "cyr_share": 1.0,
+   "distinct2": 0.75,
+   "echo": false,
+   "empty": false,
+   "i": 57,
+   "model": "official"
+  },
+  {
+   "chars": 124,
+   "words": 20,
+   "cyr_share": 1.0,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 58,
+   "model": "ours"
+  },
+  {
+   "chars": 192,
+   "words": 27,
+   "cyr_share": 1.0,
+   "distinct2": 0.423,
+   "echo": false,
+   "empty": false,
+   "i": 58,
+   "model": "official"
+  },
+  {
+   "chars": 170,
+   "words": 27,
+   "cyr_share": 1.0,
+   "distinct2": 0.577,
+   "echo": false,
+   "empty": false,
+   "i": 59,
+   "model": "ours"
+  },
+  {
+   "chars": 204,
+   "words": 28,
+   "cyr_share": 0.855,
+   "distinct2": 1.0,
+   "echo": false,
+   "empty": false,
+   "i": 59,
+   "model": "official"
+  }
+ ]
+}