File size: 66,396 Bytes
55499ad
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
{
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "# 🕵️‍♂️ Global Syndicate Taskforce: RL Training Loop\n",
        "\n",
        "**Training a model to overcome 'Collective Delusion' using OpenEnv, TRL (GRPO), and Unsloth.**\n",
        "\n",
        "This notebook represents the core pipeline of our project. Current LLMs suffer from 'sycophancy'—if another agent tells them something, they believe it. In our Anti-Money Laundering environment, an LLM must learn to stop trusting hallucinating Tier 1 Analysts, interrogate Bank Liaisons with correct policy mandates, and construct an airtight evidence chain for the Legal Officer.\n",
        "\n",
        "### 🏆 Our Stack:\n",
        "- **Environment:** OpenEnv (FastAPI)\n",
        "- **Base Model:** `unsloth/Qwen2.5-3B-Instruct`\n",
        "- **RL Framework:** TRL (GRPO - Group Relative Policy Optimization)\n",
        "- **Compiler:** Unsloth (for extremely fast, memory-efficient LoRA adapters)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "## ⚙️ 1. Local Jupyter / Mac Setup\n",
        "This notebook is now configured for **local Jupyter on Mac** (no Colab required).\n",
        "\n",
        "It assumes you are running from the repository root. We install the minimal dependencies for the Mac training path (`train_grpo_mac.py`) and plotting artifacts for submission."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 1,
      "metadata": {},
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Using project root: /Users/md.kamranalam/Programming/hackathon/global_syndicate_taskforce_env\n",
            "/Users/md.kamranalam/Programming/hackathon/global_syndicate_taskforce_env/.venv/bin/python: No module named pip\n",
            "Note: you may need to restart the kernel to use updated packages.\n",
            "/Users/md.kamranalam/Programming/hackathon/global_syndicate_taskforce_env/.venv/bin/python: No module named pip\n",
            "Note: you may need to restart the kernel to use updated packages.\n",
            "✅ Environment setup complete.\n"
          ]
        }
      ],
      "source": [
        "from pathlib import Path\n",
        "import os\n",
        "\n",
        "# Auto-detect repository root from current directory or its parents\n",
        "cwd = Path.cwd().resolve()\n",
        "candidates = [cwd] + list(cwd.parents)\n",
        "project_root = None\n",
        "for p in candidates:\n",
        "    if (p / \"server\").exists() and (p / \"train_grpo_mac.py\").exists() and (p / \"pyproject.toml\").exists():\n",
        "        project_root = p\n",
        "        break\n",
        "\n",
        "if project_root is None:\n",
        "    raise FileNotFoundError(\"Could not locate project root. Open notebook inside the project tree.\")\n",
        "\n",
        "os.chdir(project_root)\n",
        "print(f\"Using project root: {project_root}\")\n",
        "\n",
        "# Local Jupyter dependency install (Mac-friendly)\n",
        "%pip install -q -U pip\n",
        "%pip install -q torch transformers datasets trl peft requests openenv-core fastapi uvicorn matplotlib\n",
        "\n",
        "print(\"✅ Environment setup complete.\")"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "## 🌍 2. Booting the OpenEnv API Server\n",
        "The environment is decoupled from training and exposed through FastAPI.\n",
        "\n",
        "This cell starts `uvicorn` in the current Jupyter session and verifies `/health` so we know training can interact with the environment."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 2,
      "metadata": {},
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Starting OpenEnv server...\n"
          ]
        },
        {
          "name": "stderr",
          "output_type": "stream",
          "text": [
            "INFO:     Started server process [62942]\n",
            "INFO:     Waiting for application startup.\n",
            "INFO:     Application startup complete.\n",
            "INFO:     Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit)\n"
          ]
        },
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Testing /health endpoint...\n",
            "INFO:     127.0.0.1:58733 - \"GET /health HTTP/1.1\" 200 OK\n",
            "Health status: 200\n",
            "Testing /step endpoint...\n",
            "INFO:     127.0.0.1:58734 - \"POST /step HTTP/1.1\" 200 OK\n",
            "Step status: 200\n",
            "Step response: {'observation': {'transaction_id': 'TX-1024', 'amount': 1200.0, 'verified_facts': [], 'system_alerts': 'Analyst Report: Transaction appears CLEAN_VERIFIED.'}, 'reward': -0.05, 'done': False}\n",
            "✅ Server is ready for training.\n"
          ]
        }
      ],
      "source": [
        "import subprocess\n",
        "import time\n",
        "import requests\n",
        "import sys\n",
        "\n",
        "# Best effort cleanup of previous server\n",
        "subprocess.run([\"pkill\", \"-f\", \"uvicorn\"], check=False)\n",
        "\n",
        "print(\"Starting OpenEnv server...\")\n",
        "server_process = subprocess.Popen(\n",
        "    [sys.executable, \"-m\", \"uvicorn\", \"server.app:app\", \"--host\", \"0.0.0.0\", \"--port\", \"8000\"]\n",
        ")\n",
        "\n",
        "time.sleep(4)\n",
        "\n",
        "print(\"Testing /health endpoint...\")\n",
        "health = requests.get(\"http://127.0.0.1:8000/health\", timeout=5)\n",
        "print(\"Health status:\", health.status_code)\n",
        "\n",
        "print(\"Testing /step endpoint...\")\n",
        "step = requests.post(\n",
        "    \"http://127.0.0.1:8000/step\",\n",
        "    json={\"action\": {\"target_actor\": \"Tier_1_Analyst\", \"operation\": \"fetch_triage_report\"}},\n",
        "    timeout=5,\n",
        ")\n",
        "print(\"Step status:\", step.status_code)\n",
        "print(\"Step response:\", step.json())\n",
        "\n",
        "assert health.status_code == 200 and step.status_code == 200, \"Server failed smoke test\"\n",
        "print(\"✅ Server is ready for training.\")\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "## 🧠 3. Execute the GRPO Training Loop (Mac/Jupyter Path)\n",
        "For local Mac testing, run the lightweight training script first (`train_grpo_mac.py`).\n",
        "\n",
        "This gives you a reproducible baseline run, adapter artifacts, and trainer logs you can plot.\n",
        "\n",
        "Once you have access to stronger GPU, run `train_grpo_unsloth.py` for full-scale training."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 3,
      "metadata": {},
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Loading Tiny Model for Mac...\n",
            "[transformers] `torch_dtype` is deprecated! Use `dtype` instead!\n",
            "Loading weights: 100%|███████████████████████| 290/290 [00:01<00:00, 285.40it/s]\n",
            "Starting GRPO Training on Mac...\n",
            "[transformers] The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'bos_token_id': None, 'pad_token_id': 151643}.\n",
            "  0%|                                                    | 0/20 [00:00<?, ?it/s]INFO:     127.0.0.1:58920 - \"POST /step HTTP/1.1\" 422 Unprocessable Content\n",
            "INFO:     127.0.0.1:58921 - \"POST /step HTTP/1.1\" 422 Unprocessable Content\n",
            "{'loss': '-0.3328', 'grad_norm': '0.3514', 'learning_rate': '5e-05', 'num_tokens': '243', 'completions/mean_length': '43.5', 'completions/min_length': '41', 'completions/max_length': '46', 'completions/clipped_ratio': '0', 'completions/mean_terminated_length': '43.5', 'completions/min_terminated_length': '41', 'completions/max_terminated_length': '46', 'rewards/interact_with_env/mean': '-0.5', 'rewards/interact_with_env/std': '0', 'rewards/format_reward_func/mean': '0.1', 'rewards/format_reward_func/std': '0.07071', 'reward': '-0.4', 'reward_std': '0.07071', 'frac_reward_zero_std': '0', 'entropy': '0.6262', 'clip_ratio/low_mean': '0', 'clip_ratio/low_min': '0', 'clip_ratio/high_mean': '0', 'clip_ratio/high_max': '0', 'clip_ratio/region_mean': '0', 'step_time': '5.2', 'epoch': '0.008333'}\n",
            "{'loss': '0.3737', 'grad_norm': '0.3424', 'learning_rate': '4.75e-05', 'entropy': '0.6428', 'clip_ratio/low_mean': '0', 'clip_ratio/low_min': '0', 'clip_ratio/high_mean': '0', 'clip_ratio/high_max': '0', 'clip_ratio/region_mean': '0', 'step_time': '0.3951', 'epoch': '0.01667'}\n",
            "{'loss': '0', 'grad_norm': '0', 'learning_rate': '4.5e-05', 'num_tokens': '511', 'completions/mean_length': '64', 'completions/min_length': '64', 'completions/max_length': '64', 'completions/clipped_ratio': '1', 'completions/mean_terminated_length': '0', 'completions/min_terminated_length': '0', 'completions/max_terminated_length': '0', 'rewards/interact_with_env/mean': '-1', 'rewards/interact_with_env/std': '0', 'rewards/format_reward_func/mean': '0', 'rewards/format_reward_func/std': '0', 'reward': '-1', 'reward_std': '0', 'frac_reward_zero_std': '1', 'entropy': '1.28', 'clip_ratio/low_mean': '0', 'clip_ratio/low_min': '0', 'clip_ratio/high_mean': '0', 'clip_ratio/high_max': '0', 'clip_ratio/region_mean': '0', 'step_time': '6.791', 'epoch': '0.025'}\n",
            "{'loss': '0', 'grad_norm': '0', 'learning_rate': '4.25e-05', 'entropy': '1.351', 'clip_ratio/low_mean': '0', 'clip_ratio/low_min': '0', 'clip_ratio/high_mean': '0', 'clip_ratio/high_max': '0', 'clip_ratio/region_mean': '0', 'step_time': '0.5054', 'epoch': '0.03333'}\n",
            "{'loss': '0', 'grad_norm': '0', 'learning_rate': '4e-05', 'num_tokens': '793', 'completions/mean_length': '64', 'completions/min_length': '64', 'completions/max_length': '64', 'completions/clipped_ratio': '1', 'completions/mean_terminated_length': '0', 'completions/min_terminated_length': '0', 'completions/max_terminated_length': '0', 'rewards/interact_with_env/mean': '-1', 'rewards/interact_with_env/std': '0', 'rewards/format_reward_func/mean': '0', 'rewards/format_reward_func/std': '0', 'reward': '-1', 'reward_std': '0', 'frac_reward_zero_std': '1', 'entropy': '0.6643', 'clip_ratio/low_mean': '0', 'clip_ratio/low_min': '0', 'clip_ratio/high_mean': '0', 'clip_ratio/high_max': '0', 'clip_ratio/region_mean': '0', 'step_time': '6.806', 'epoch': '0.04167'}\n",
            "{'loss': '0', 'grad_norm': '0', 'learning_rate': '3.75e-05', 'entropy': '0.7579', 'clip_ratio/low_mean': '0', 'clip_ratio/low_min': '0', 'clip_ratio/high_mean': '0', 'clip_ratio/high_max': '0', 'clip_ratio/region_mean': '0', 'step_time': '0.4457', 'epoch': '0.05'}\n",
            " 30%|█████████████▏                              | 6/20 [00:20<00:41,  2.98s/it]INFO:     127.0.0.1:59067 - \"POST /step HTTP/1.1\" 422 Unprocessable Content\n",
            "{'loss': '-0.3169', 'grad_norm': '0.3267', 'learning_rate': '3.5e-05', 'num_tokens': '1063', 'completions/mean_length': '58', 'completions/min_length': '52', 'completions/max_length': '64', 'completions/clipped_ratio': '0.5', 'completions/mean_terminated_length': '52', 'completions/min_terminated_length': '52', 'completions/max_terminated_length': '52', 'rewards/interact_with_env/mean': '-0.75', 'rewards/interact_with_env/std': '0.3536', 'rewards/format_reward_func/mean': '0.075', 'rewards/format_reward_func/std': '0.1061', 'reward': '-0.675', 'reward_std': '0.4596', 'frac_reward_zero_std': '0', 'entropy': '0.8329', 'clip_ratio/low_mean': '0', 'clip_ratio/low_min': '0', 'clip_ratio/high_mean': '0', 'clip_ratio/high_max': '0', 'clip_ratio/region_mean': '0', 'step_time': '6.858', 'epoch': '0.05833'}\n",
            "{'loss': '0.3901', 'grad_norm': '0.2715', 'learning_rate': '3.25e-05', 'entropy': '0.78', 'clip_ratio/low_mean': '0', 'clip_ratio/low_min': '0', 'clip_ratio/high_mean': '0', 'clip_ratio/high_max': '0', 'clip_ratio/region_mean': '0', 'step_time': '0.4466', 'epoch': '0.06667'}\n",
            " 40%|█████████████████▌                          | 8/20 [00:27<00:36,  3.04s/it]INFO:     127.0.0.1:59069 - \"POST /step HTTP/1.1\" 422 Unprocessable Content\n",
            "INFO:     127.0.0.1:59070 - \"POST /step HTTP/1.1\" 422 Unprocessable Content\n",
            "{'loss': '-0.3403', 'grad_norm': '0.4167', 'learning_rate': '3e-05', 'num_tokens': '1300', 'completions/mean_length': '41.5', 'completions/min_length': '40', 'completions/max_length': '43', 'completions/clipped_ratio': '0', 'completions/mean_terminated_length': '41.5', 'completions/min_terminated_length': '40', 'completions/max_terminated_length': '43', 'rewards/interact_with_env/mean': '-0.5', 'rewards/interact_with_env/std': '0', 'rewards/format_reward_func/mean': '0.1', 'rewards/format_reward_func/std': '0.07071', 'reward': '-0.4', 'reward_std': '0.07071', 'frac_reward_zero_std': '0', 'entropy': '0.2117', 'clip_ratio/low_mean': '0', 'clip_ratio/low_min': '0', 'clip_ratio/high_mean': '0', 'clip_ratio/high_max': '0', 'clip_ratio/region_mean': '0', 'step_time': '4.747', 'epoch': '0.075'}\n",
            "{'loss': '0.3658', 'grad_norm': '0.4137', 'learning_rate': '2.75e-05', 'entropy': '0.7309', 'clip_ratio/low_mean': '0', 'clip_ratio/low_min': '0', 'clip_ratio/high_mean': '0', 'clip_ratio/high_max': '0', 'clip_ratio/region_mean': '0', 'step_time': '0.3909', 'epoch': '0.08333'}\n",
            "{'loss': '0', 'grad_norm': '0', 'learning_rate': '2.5e-05', 'num_tokens': '1584', 'completions/mean_length': '64', 'completions/min_length': '64', 'completions/max_length': '64', 'completions/clipped_ratio': '1', 'completions/mean_terminated_length': '0', 'completions/min_terminated_length': '0', 'completions/max_terminated_length': '0', 'rewards/interact_with_env/mean': '-1', 'rewards/interact_with_env/std': '0', 'rewards/format_reward_func/mean': '0', 'rewards/format_reward_func/std': '0', 'reward': '-1', 'reward_std': '0', 'frac_reward_zero_std': '1', 'entropy': '0.9837', 'clip_ratio/low_mean': '0', 'clip_ratio/low_min': '0', 'clip_ratio/high_mean': '0', 'clip_ratio/high_max': '0', 'clip_ratio/region_mean': '0', 'step_time': '6.796', 'epoch': '0.09167'}\n",
            "{'loss': '0', 'grad_norm': '0', 'learning_rate': '2.25e-05', 'entropy': '0.9493', 'clip_ratio/low_mean': '0', 'clip_ratio/low_min': '0', 'clip_ratio/high_mean': '0', 'clip_ratio/high_max': '0', 'clip_ratio/region_mean': '0', 'step_time': '0.4483', 'epoch': '0.1'}\n",
            " 60%|█████████████████████████▊                 | 12/20 [00:39<00:22,  2.84s/it]INFO:     127.0.0.1:59072 - \"POST /step HTTP/1.1\" 422 Unprocessable Content\n",
            "{'loss': '0.4309', 'grad_norm': '0.4818', 'learning_rate': '2e-05', 'num_tokens': '1843', 'completions/mean_length': '52.5', 'completions/min_length': '41', 'completions/max_length': '64', 'completions/clipped_ratio': '0.5', 'completions/mean_terminated_length': '41', 'completions/min_terminated_length': '41', 'completions/max_terminated_length': '41', 'rewards/interact_with_env/mean': '-0.75', 'rewards/interact_with_env/std': '0.3536', 'rewards/format_reward_func/mean': '0.075', 'rewards/format_reward_func/std': '0.1061', 'reward': '-0.675', 'reward_std': '0.4596', 'frac_reward_zero_std': '0', 'entropy': '0.6089', 'clip_ratio/low_mean': '0', 'clip_ratio/low_min': '0', 'clip_ratio/high_mean': '0', 'clip_ratio/high_max': '0', 'clip_ratio/region_mean': '0', 'step_time': '6.835', 'epoch': '0.1083'}\n",
            "{'loss': '-0.276', 'grad_norm': '0.2118', 'learning_rate': '1.75e-05', 'entropy': '0.2715', 'clip_ratio/low_mean': '0', 'clip_ratio/low_min': '0', 'clip_ratio/high_mean': '0', 'clip_ratio/high_max': '0', 'clip_ratio/region_mean': '0', 'step_time': '0.4526', 'epoch': '0.1167'}\n",
            " 70%|██████████████████████████████             | 14/20 [00:47<00:17,  2.97s/it]INFO:     127.0.0.1:59074 - \"POST /step HTTP/1.1\" 422 Unprocessable Content\n",
            "{'loss': '-0.3361', 'grad_norm': '0.2174', 'learning_rate': '1.5e-05', 'num_tokens': '2121', 'completions/mean_length': '61', 'completions/min_length': '58', 'completions/max_length': '64', 'completions/clipped_ratio': '0.5', 'completions/mean_terminated_length': '58', 'completions/min_terminated_length': '58', 'completions/max_terminated_length': '58', 'rewards/interact_with_env/mean': '-0.75', 'rewards/interact_with_env/std': '0.3536', 'rewards/format_reward_func/mean': '0.025', 'rewards/format_reward_func/std': '0.03536', 'reward': '-0.725', 'reward_std': '0.3889', 'frac_reward_zero_std': '0', 'entropy': '0.4716', 'clip_ratio/low_mean': '0', 'clip_ratio/low_min': '0', 'clip_ratio/high_mean': '0', 'clip_ratio/high_max': '0', 'clip_ratio/region_mean': '0', 'step_time': '6.82', 'epoch': '0.125'}\n",
            "{'loss': '0.3708', 'grad_norm': '0.4264', 'learning_rate': '1.25e-05', 'entropy': '1.093', 'clip_ratio/low_mean': '0', 'clip_ratio/low_min': '0', 'clip_ratio/high_mean': '0', 'clip_ratio/high_max': '0', 'clip_ratio/region_mean': '0', 'step_time': '0.4532', 'epoch': '0.1333'}\n",
            "{'loss': '0', 'grad_norm': '0', 'learning_rate': '1e-05', 'num_tokens': '2389', 'completions/mean_length': '64', 'completions/min_length': '64', 'completions/max_length': '64', 'completions/clipped_ratio': '1', 'completions/mean_terminated_length': '0', 'completions/min_terminated_length': '0', 'completions/max_terminated_length': '0', 'rewards/interact_with_env/mean': '-1', 'rewards/interact_with_env/std': '0', 'rewards/format_reward_func/mean': '0', 'rewards/format_reward_func/std': '0', 'reward': '-1', 'reward_std': '0', 'frac_reward_zero_std': '1', 'entropy': '2.444', 'clip_ratio/low_mean': '0', 'clip_ratio/low_min': '0', 'clip_ratio/high_mean': '0', 'clip_ratio/high_max': '0', 'clip_ratio/region_mean': '0', 'step_time': '6.796', 'epoch': '0.1417'}\n",
            "{'loss': '0', 'grad_norm': '0', 'learning_rate': '7.5e-06', 'entropy': '1.785', 'clip_ratio/low_mean': '0', 'clip_ratio/low_min': '0', 'clip_ratio/high_mean': '0', 'clip_ratio/high_max': '0', 'clip_ratio/region_mean': '0', 'step_time': '0.4436', 'epoch': '0.15'}\n",
            " 90%|██████████████████████████████████████▋    | 18/20 [01:01<00:06,  3.05s/it]INFO:     127.0.0.1:59082 - \"POST /step HTTP/1.1\" 200 OK\n",
            "INFO:     127.0.0.1:59083 - \"POST /step HTTP/1.1\" 200 OK\n",
            "{'loss': '0', 'grad_norm': '0', 'learning_rate': '5e-06', 'num_tokens': '2579', 'completions/mean_length': '25', 'completions/min_length': '23', 'completions/max_length': '27', 'completions/clipped_ratio': '0', 'completions/mean_terminated_length': '25', 'completions/min_terminated_length': '23', 'completions/max_terminated_length': '27', 'rewards/interact_with_env/mean': '-1.05', 'rewards/interact_with_env/std': '0', 'rewards/format_reward_func/mean': '0.15', 'rewards/format_reward_func/std': '0', 'reward': '-0.9', 'reward_std': '0', 'frac_reward_zero_std': '1', 'entropy': '0.3228', 'clip_ratio/low_mean': '0', 'clip_ratio/low_min': '0', 'clip_ratio/high_mean': '0', 'clip_ratio/high_max': '0', 'clip_ratio/region_mean': '0', 'step_time': '3.237', 'epoch': '0.1583'}\n",
            "{'loss': '0', 'grad_norm': '0', 'learning_rate': '2.5e-06', 'entropy': '0.3562', 'clip_ratio/low_mean': '0', 'clip_ratio/low_min': '0', 'clip_ratio/high_mean': '0', 'clip_ratio/high_max': '0', 'clip_ratio/region_mean': '0', 'step_time': '0.3819', 'epoch': '0.1667'}\n",
            "{'train_runtime': '66.24', 'train_samples_per_second': '0.302', 'train_steps_per_second': '0.302', 'train_loss': '0.01646', 'epoch': '0.1667'}\n",
            "100%|███████████████████████████████████████████| 20/20 [01:06<00:00,  3.31s/it]\n",
            "Saving LoRA adapters safely...\n",
            "Training Complete!\n"
          ]
        }
      ],
      "source": [
        "# Mac-safe baseline training\n",
        "!python train_grpo_mac.py"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "## 📈 4. Generate Reward/Loss Plot Artifacts\n",
        "This cell reads `trainer_state.json` from `outputs_mac/` and exports:\n",
        "- `docs/reward_curve.png`\n",
        "- `docs/loss_curve.png`\n",
        "\n",
        "These are the exact artifacts you need for your hackathon README/submission."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 4,
      "metadata": {},
      "outputs": [
        {
          "name": "stderr",
          "output_type": "stream",
          "text": [
            "Matplotlib is building the font cache; this may take a moment.\n"
          ]
        },
        {
          "data": {
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAxYAAAG4CAYAAADYN3EQAAAAOnRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjEwLjksIGh0dHBzOi8vbWF0cGxvdGxpYi5vcmcvJkbTWQAAAAlwSFlzAAAPYQAAD2EBqD+naQAANf1JREFUeJzt3Qm8XPPdP/BfIpLYElsWIbFr7GqL4CkqlbQURS3VWstDUQSt2CJKU/rYd63SFg9N1VpNRShKCLFUhJRaQiILKqssTeb/+v5e/7nPvTf3Zju5uXNv3u/Xa3IzZ87MnDnnN2fO5/yW06JUKpUSAABAAS2LPBkAAECwAAAAlgo1FgAAQGGCBQAAUJhgAQAAFCZYAAAAhQkWAABAYYIFAABQmGABAAAUJlgAQAFXXHFF6t69e5o3b571uBCDBw9Oq666apo0aZJ1Bc2QYAEsV95///106qmnps022yytvPLK+bbFFlukU045Jf3jH/+oMe/FF1+cWrRoUXVbccUV0wYbbJB+/OMfpy+++GK+147Hqs/fsWPH9F//9V/pgQcemG/eUqmUfv/736evfe1rafXVV8/LsfXWW6dLLrkkTZ8+fZE+S3n5Pv3009QU/O1vf0sHHXRQ6ty5c2rdunVeP9/+9rfTn/70p9RUTZkyJV1++eXppz/9aWrZ8v9+Ustl4Ic//GGdzzv//POr5lmW2++DDz6oUUZjmddcc830zW9+Mw0bNqzB379Pnz5pk002SQMHDmzw9wKWPcECWG48+uijaauttsoH9L169UpXX311uvbaa/NB1WOPPZa222679OGHH873vJtvvjk/54Ybbkg777xzuv7669N+++1X53vEa8S8cTv77LPTuHHj8sH0LbfcUjXP3Llz0+GHH56OOuqoqoBwzTXX5OcOGDAg7bLLLmnChAmpOenfv3/aa6+90siRI9N///d/5/VxzjnnpGnTpqWDDz443XPPPakp+s1vfpP+85//pCOOOGK+x9q2bZvuv//+NHv27Pke+9///d/8eGOJ5Y0yescdd6STTz45vfDCC3n7vPHGGw3+3rH9b7311jR16tQGfy9gGSsBLAfefffd0iqrrFLafPPNS+PGjZvv8Tlz5pSuvfba0pgxY6qm9e/fvxS7yUmTJtWY97DDDsvTX3zxxRrT119//dK+++5bY9onn3yS33ezzTarmvbzn/88P//ss8+ebzkefvjhUsuWLUt9+vRZ6Geqb/kqzaBBg/JyHnLIIaXZs2fP9/jgwYNLjzzyyFJ5r+nTp5eWpW222ab0/e9/f77p8XkPPPDAvC0ffPDBGo8999xz+fGDDz54mW+/999/P7/nL3/5yxrT//KXv+TpJ598coMvw4QJE0orrLBC6fbbb2/w9wKWLTUWwHLTDj6aGMUZ2nXWWWe+x1u1apWbOHXt2nWhrxXNm8K//vWvhc4bzX4233zz3AQrfPnll+mXv/xlbopVV3OQaBp09NFH57bocRZ5aXjyySfzMq+yyiq52dUBBxyQ3nrrrRrzxNnjM844IzfnatOmTW6m9I1vfCO98sorVfO88847uXYhPlOcbV9vvfVyzcvkyZMX+P4XXnhhbm4TZ/ejOVltvXv3rqoBuvPOO3MTnWiyU7sZVUyPv2V77rlnroEaMWJEblIWzcnOO++8/FobbbRRncvSs2fPtOOOO9aYdtddd6UddtghrbTSSnk54zN99NFHaWFim0bzuaj9qsu6666bl6t2bczdd9+dm73Fstf27LPPpu9+97upW7dueTtEeTzzzDNzuant7bffToceemjq0KFDXvavfOUruYnVkqirTJeb2tVW1zaKchPr/e9//3uu1YvyEdvgd7/73XzPj7K1zTbbpIceemiJlhWoXIIFsNw0g4q23T169Cj8WuUDqjXWWGOh886ZMycfpK611lr5fhx4/fvf/07f+973cpipS7mJVCxzUU888UQ+cJ84cWI+UOzbt296/vnn02677VbjwPCkk07KTb4iONx00025GVccrJYDSDTnideJsHPaaaelG2+8MZ144onpvffeq7O/SfUwEgfABx54YFpttdXS0vbZZ5/lpmzRjCyak0VznsMOOywf9L/00ks15o1mbrH8ERzKLrvssry+N91003TVVVflcDV06NAcCBb0uUKsx7D99tvXO09s50ceeSQ3+QrRbGrQoEF5el3isRkzZuTmSdHkLtZ5/C2XibIINFGWIzSecMIJuUlfrON4r4Yu0/V599130yGHHJID6ZVXXplf65hjjklvvvnmfPNGkCuvP6AZWcY1JADL3OTJk6uaptT273//OzdFKd9mzJgxX1Oj0aNH58c++OCD0m9+85vSSiutVOrQocN8zW6iKdQ+++xT9Vqvv/566fDDD8+vcdppp+V5rrnmmnz/gQceqHd5P//88zzPQQcdVLgp1HbbbVfq2LFj6bPPPquaFssVTXSOOuqoqmnt27cvnXLKKfW+zquvvprfK5o1LY6HHnooP+/qq69epPnvuOOOPH802anuqaeeytPjb9kee+yRp91yyy3zbe82bdqUzjrrrBrTr7jiilKLFi1KH374Yb4f2zOa5Fx22WU15nvjjTdKrVq1mm96bRdccEF+/6lTp873WEyP9RnbsnXr1qXf//73efqf//znvAzx3nVtv+rlr2zgwIE1ljt87WtfK6222mo1poV58+YtUlOoAQMG5PcdP3586dlnny3ttNNO823f8vItyjaKsh/TnnnmmappEydOrHM7VG8OGM2igOZDjQXQ7MXIPSGGuawtmtNEU5LyLc7E1xZNTOKxaO5x3HHH5ZqPv/zlL7npTW2PP/541Wttu+22+Qz0D37wgzxyUCh3WF3Q2fvyY+XlXlKffPJJeu211/JZ42jiUxbNUOKscnRYL4smUi+++GLubF6X9u3b579//etf8xn1RVX+DA1RWxGiudCxxx5bY1q7du1yLcYf/vCHPPpW2X333Zc7xkczoxCjUcUQsdGcKEZmKt+iqVfUYDz11FMLrS2JWqe6ylVZnLWPkZCis3aIZlG77rprWn/99eucP2qJyqLpXixPzB+f49VXX83TY6jWZ555JpfF8mcpq6vpUn2d6aOMxmeNZlBRMxW1DFHjsKRidLVyk6oQrx/fnajVqq1cM9JURjQDFo1gATR75YPacnOU6mJ0miFDhuR29vWJkX1injgojAPTaFZU/QCwumieEvNGE6Ro6hEHTtHOvDx/eVkWNCLOooSPRVEe4SoO7mqLfh+xbOWhbaMPSozYFG36o418NJuqfkC44YYb5mZUv/71r9Paa6+dm+hECFtY/4o4yK/+mZa26McQQ9fWFs2hoglaeQjV6DsQfTFievVmWnHAHiGieriMWxxox3ZeGqLZU5SJMWPGpAcffLDeZlAh5ikHwQgssSx77LFHfqy8rsvbpa4+GosqmrHFMkXTqXIfjhitrIjaIaccIKLpX23lwLeoQQhoGupu4AvQjMTZ9uiwHQfOtZX7XNTuLFxdtLePg+ly5+roeHvkkUfmA9Xq1y4IMV99nXnLB/TlNvLRJr4u5etpxBngZSXO2pevuRG1LtHBPGpZ4qx+nP0PcUY7Dnqj023ME53dowN69FuIjtx1iQvHhUUdxrS+A836DnrrC3ixnaJGKWot4ox//I1tFR2jy6K2It4vap9WWGGF+V5jQTURIfrNRJ+JCE0LCoH7779/rlmJTvmzZs3K67q+zxg1SZ9//nm+Lkasu+hwP3bs2Lzel+YF+CJMlctpdLqOz3/uuefmPirlzu2Luy3qWoeheq1RWTlslL9XQPOgxgJYLuy77765c+nw4cMLvU4cbEYzkmhiFAeri2v33XfPzY6i9qO+A7TySDr1XStjUZWb24wePXq+x6JDdRzUxYFrWYSvH/3oR/msenR+jgPn6NxcXYSqCy64IDfFiRGM4qC3+jU6aovRr6LGJMJIXTVG9TWRqd1xuq7riyxIfK5Yf9EULQ7IoxlUBKcuXbpUzbPxxhvng96ojYmD7Nq3qJ1akHJoKo/4VZ8IPxEiY0SrCA71HUxH+PrnP/+ZA1wEixi9K5aj+jKH8ohXdQXlJRWjSUU4im27tLdFXWKdxXqIGhmg+RAsgOXCT37yk3wGO9ql13XxubrOqtYnaiviDH2538TiiGWIEZfiYL+uoUH//Oc/5+E8o6nRwg5sFyaCQoyW9Nvf/rbGwWEckEaNw7e+9a18PwJO7SZNMSRoHNDGGfZyX4k4O187ZEQtQHme+sRF/6I/QlyFuvZrhFiW8ghYcbAfIriUxfLddttti/35o9lT9BmJ5luvv/56jWZQIS5cGGfZY/lqb/+4H8u8IDF0bXj55ZcXuiyxzSOQxtC79Smf8a++LPH/GPGpujgYj1q0GL43mk7VXu4lEWE3LlwXfWgiNNe3LaLpXJSnoqK2r7z+gOZDUyhguRBNP6KWIK44HGfQIxxE5+o4EIuzp/FYHCTX16SnurgWw+mnn56vHB3Xm4jOuYsjmpxER9wIJtEHIIZ4jbPaMRRt9PWI5lKLc/AWw6TW7kgenyWu6RBNmqIpUxzEHX/88bktfQxfGs3Doh9FiKY88bmj426sk6iViT4iMVxrnD0PMazpqaeempsSRS1EBIS4cnMcDMfyL0gc0MfZ+Kj9iM8d2yBqU+LAPdZfDO9avtbDlltumQNVv379cpOg6Gtw77331hlIFiaCU5yFj4P6upYzDpwvvfTS/F7RFK48JG6Uh2gSFv0Q4rn1iZqD6OcQ6yoC64LEeo3bwmpAYpniPaMmKPqnRP+euvooXHfddbn2K4a6jeWMWpf4DBFMy8FgcUWZjiF7f/GLX+R1vs8+++R+E1FuoqzHOowwE8GmdqBZHNF3JZr7nXLKKUv8GkCFauxhqQCW9RW44+rCm2yySalt27Z56Nju3buXTjrppNJrr722yMO5xpCmMURrDHm6oCtv12fu3Ll52M7ddtut1K5du7wsW265ZR4GdNq0aYv0GuXlq+sWw6iWPfHEE/l94rPGe337298ujRo1qurxWbNmlc4555zStttum4cwjSuFx/9vuummqnnee++90nHHHVfaeOON87Kuueaapb322iu/9qIaOnRo6YADDsjD38ZwrjFkbyxLDElb3b/+9a9Sr1698lClnTp1Kp133nmlIUOG1DncbKyzBTnyyCPz8+L16nP//feXdt999/y54xblIYaKjWGGF+aqq64qrbrqqvMNE1sebnZB6ipfsV1iWeM111577dIJJ5yQhweO+aK8VDdy5MjSd77zndLqq6+et8lXvvKV0oUXXrhEV94uO+aYY3LZie9JGDFiRKlHjx55yNxu3brlz1vfcLN1lf3YRtW/I+Hmm28urbzyyqUpU6YscFmBpqdF/NPY4QYAmqJoQhY1FzGqVpzZZ+G++tWv5mGer776aqsLmhnBAgAKiCZtd9xxRxo1atR8o4RRUzR9iyZ3MWRu9OMBmhfBAgAAKMypFQAAoDDBAgAAKEywAAAAChMsAACAwlwgbymYN29evrprXFipRYsWS+MlAQCg0cWVKeJCql26dFnoyHeCxVIQoaJr165L46UAAKDifPTRR2m99dZb4DyCxVIQNRXlFd6uXbul8ZIspZqkSZMmpQ4dOhhbHmWGBmE/gzJDc9/PTJkyJZ9ALx/vLohgsRSUmz9FqBAsKuuLOHPmzLxNXLQKZQb7GSqB3yaaaplZlOb+Om8DAACFCRYAAEBhggUAAFCYYAEAABQmWAAAAIUJFgAAQGGCBQAAUJhgAQAAFCZYAAAAhQkWAABAYYIFAABQmGABAAAUJlgAAACFCRYAAEBhggUAAFCYYAEAABQmWAAAAIUJFgAAQGGCBQAAUJhgAQAAFCZYAAAAhQkWAABAYYIFAABQmGABAAAUJlgAAACFCRYAAEBhggUAAFCYYAEAABQmWAAAAIUJFgAAQGGCBQAAUJhgAQAAFCZYAAAAhQkWAABAYYIFAABQmGABAAAUJlgAAACFCRYAAEBhggUAAFCYYAEAABQmWAAAAMtfsLjxxhvTBhtskNq2bZt69OiRhg8fvsD5Bw0alLp3757n33rrrdNjjz1W77wnnXRSatGiRbrmmmsaYMkBAKD5alLB4r777kt9+/ZN/fv3T6+88kradtttU+/evdPEiRPrnP/5559PRxxxRDr++OPTq6++mg488MB8Gzly5HzzPvDAA+mFF15IXbp0WQafBAAAmpcmFSyuuuqqdMIJJ6Rjjz02bbHFFumWW25JK6+8cvrNb35T5/zXXntt6tOnTzrnnHPS5ptvnn72s5+l7bffPt1www015hs7dmw67bTT0t13351WXHHFZfRpAACg+WgywWL27NlpxIgRqVevXlXTWrZsme8PGzaszufE9Orzh6jhqD7/vHnz0g9+8IMcPrbccssG/AQAANB8tUpNxKeffprmzp2bOnXqVGN63H/77bfrfM748ePrnD+ml11++eWpVatW6cc//vEiL8usWbPyrWzKlClVISVuVIbYFqVSyTZBmcF+horht4mmVmYW532bTLBoCFEDEs2lor9GdNpeVAMHDkwDBgyYb/qkSZPSzJkzl/JSUuSLMHny5PxljNotUGZY2uxnUGZo7vuZqVOnNr9gsfbaa6cVVlghTZgwocb0uN+5c+c6nxPTFzT/s88+mzt+d+vWrerxqBU566yz8shQH3zwQZ2v269fv9yJvHqNRdeuXVOHDh1Su3btCn1Olu4XMQJjbBfBAmWGhmA/gzJDc9/PtG3btvkFi9atW6cddtghDR06NI/sVF7Rcf/UU0+t8zk9e/bMj59xxhlV04YMGZKnh+hbUVcfjJgeHcTr06ZNm3yrLTa2A9jKEl9E2wVlBvsZKonfJppSmVmc92wywSJELcHRRx+ddtxxx7TzzjvnWoXp06dXhYCjjjoqrbvuurmpUjj99NPTHnvska688sq07777pnvvvTe9/PLL6bbbbsuPr7XWWvlWXYwKFTUaX/nKVxrhEwIAQNPUpILFYYcdlvsxXHTRRbkD9nbbbZcGDx5c1UF7zJgxNVLVrrvumu655550wQUXpPPOOy9tuumm6cEHH0xbbbVVI34KAABoflqUoicIhUQfi/bt2+eONfpYVI5oKhd9aDp27KiJGsoM9jNUBL9NNLUyszjHuYbKAQAAChMsAACAwgQLAACgMMECAAAoTLAAAAAKEywAAIDCBAsAAKAwwQIAAChMsAAAAAoTLAAAgMIECwAAoDDBAgAAKEywAAAAChMsAACAwgQLAACgMMECAAAoTLAAAAAKEywAAIDCBAsAAKAwwQIAAChMsAAAAAoTLAAAgMIECwAAoDDBAgAAKEywAAAAChMsAACAwgQLAABAsAAAABqfGgsAAKAwwQIAAChMsAAAAAoTLAAAgMIECwAAoDDBAgAAKEywAAAAChMsAACAwgQLAACgMMECAAAoTLAAAAAKEywAAIDCBAsAAKAwwQIAAChMsAAAAAoTLAAAgMIECwAAoDDBAgAAKEywAAAAChMsAACAwgQLAACgMMECAAAoTLAAAAAKEywAAIDCBAsAAKAwwQIAAFj+gsWNN96YNthgg9S2bdvUo0ePNHz48AXOP2jQoNS9e/c8/9Zbb50ee+yxqsfmzJmTfvrTn+bpq6yySurSpUs66qij0rhx45bBJwEAgOajSQWL++67L/Xt2zf1798/vfLKK2nbbbdNvXv3ThMnTqxz/ueffz4dccQR6fjjj0+vvvpqOvDAA/Nt5MiR+fEZM2bk17nwwgvz3z/96U9p9OjRaf/991/GnwwAAJq2FqVSqZSaiKih2GmnndINN9yQ78+bNy917do1nXbaaencc8+db/7DDjssTZ8+PT366KNV03bZZZe03XbbpVtuuaXO93jppZfSzjvvnD788MPUrVu3RVquKVOmpPbt26fJkyendu3aLfHnY+mK8hGhs2PHjqllyyaVoWkkygzKDPYzVJp5jXw8szjHua1SEzF79uw0YsSI1K9fv6ppsXJ79eqVhg0bVudzYnrUcFQXNRwPPvhgve8TK61FixZp9dVXr3eeWbNm5Vv1FV7e8HGjMsS2iNxsm6DMYD9DpfDbRFMrM4vzvk0mWHz66adp7ty5qVOnTjWmx/233367zueMHz++zvljel1mzpyZ+1xE86kFJbKBAwemAQMGzDd90qRJ+TWoDPFFiKAYX0Y1Figz2M9QCfw20dTKzNSpU5tfsGho0ZH70EMPzRvt5ptvXuC8UWtSvSYkaiyiSVaHDh00haqwL2LUPsV2ESxQZrCfoRL4baKplZkYAKnZBYu11147rbDCCmnChAk1psf9zp071/mcmL4o85dDRfSrePLJJxcaDtq0aZNvtcXGdgBbWeKLaLugzGA/QyXx20RTKjOL855Npkdr69at0w477JCGDh1aI8HF/Z49e9b5nJheff4wZMiQGvOXQ8U777yTnnjiibTWWms14KcAAIDmqcnUWIRofnT00UenHXfcMY/cdM011+RRn4499tj8eFyDYt111819IMLpp5+e9thjj3TllVemfffdN917773p5ZdfTrfddltVqDjkkEPyULMxclT04Sj3v1hzzTVzmAEAAJpZsIjhY6OD9EUXXZQDQAwbO3jw4KoO2mPGjKlRXbPrrrume+65J11wwQXpvPPOS5tuumkeEWqrrbbKj48dOzY9/PDD+f/xWtU99dRTac8991ymnw8AAJqqJnUdi0rlOhaVqbHHfabpUWZQZrCfodLMa0LXsXC0BQAAFCZYAAAAhQkWAABAYYIFAABQmGABAAAUJlgAAACFCRYAAEBhggUAAFCYYAEAABQmWAAAAIUJFgAAQGGCBQAAUJhgAQAAFCZYAAAAhQkWAABAYYIFAABQmGABAAAUJlgAAACFCRYAAEBhggUAAFCYYAEAABQmWAAAAIUJFgAAQGGCBQAAUJhgAQAAFCZYAAAAhQkWAABAYYIFAABQmGABAAAUJlgAAACFCRYAAEBhggUAAFCYYAEAABQmWAAAAIUJFgAAQGGCBQAAUJhgAQAAFCZYAAAAhQkWAABAYYIFAABQmGABAAAUJlgAAACFCRYAAEBhggUAAFCYYAEAABQmWAAAAI0TLD766KP08ccfV90fPnx4OuOMM9Jtt91WfIkAAIDlI1h873vfS0899VT+//jx49M3vvGNHC7OP//8dMkllyztZQQAAJpjsBg5cmTaeeed8///8Ic/pK222io9//zz6e6770533nnn0l5GAACgOQaLOXPmpDZt2uT/P/HEE2n//ffP/+/evXv65JNPlu4SAgAAzTNYbLnllumWW25Jzz77bBoyZEjq06dPnj5u3Li01lprLe1lBAAAmmOwuPzyy9Ott96a9txzz3TEEUekbbfdNk9/+OGHq5pIAQAAy49WS/KkCBSffvppmjJlSlpjjTWqpp944olp5ZVXXprLBwAANNcaiy+//DLNmjWrKlR8+OGH6ZprrkmjR49OHTt2TA3pxhtvTBtssEFq27Zt6tGjRx6NakEGDRqU+37E/FtvvXV67LHHajxeKpXSRRddlNZZZ5200korpV69eqV33nknNQVz55XSsH99lh56bWz+G/f5v3Xzwnufpcff/jz/tW6UmUX5Pikz9jOLuw9WZvw+KTNLh2Oa5rGfWaIaiwMOOCAddNBB6aSTTkpffPFFPsBfccUVcy3GVVddlU4++eSlv6Qppfvuuy/17ds39++I94ww07t373oDTYxUFU21Bg4cmPbbb790zz33pAMPPDC98soreSSrcMUVV6Trrrsu/fa3v00bbrhhuvDCC/Nrjho1KoeRSjV45CdpwCOj0ieTZ1ZNW6d929T/21ukPlutk5Zn86+b960bZUaZWSrfJfsZ+xnlxm/T0mdf03yOZ1qU4pT9Ylp77bXT008/nTtx//rXv07XX399evXVV9P999+fz/6/9dZbDbKwESZ22mmndMMNN+T78+bNS127dk2nnXZaOvfcc+eb/7DDDkvTp09Pjz76aNW0XXbZJW233XY5nMRH79KlSzrrrLPS2WefnR+fPHly6tSpUx429/DDD1+k5YomYe3bt8/PbdeuXVoWBe3ku15JtTdci///9+bvb1+xBa6hWTfWizLju2Q/Yx9cafw2WTdNucwsznHuEtVYzJgxI6222mr5/48//niuvWjZsmU+aI9mUQ1h9uzZacSIEalfv35V0+I9o+nSsGHD6nxOTI8ajuqiNuLBBx/M/3///ffzBf7iNcpixUWAiecuarBYlqIKLNJrXWmw9P8L3MUPj0q7bbJ2WqFlufgtH2Ld9H/4TevGelFmfJfsZ+yDK4bfJuumIcpMHAt+Y4vOFXest0TBYpNNNskH59/5znfSX//613TmmWfm6RMnTmywM/bRzGru3Lm5NqG6uP/222/X+ZwIDXXNH9PLj5en1TdPXaJ/SdyqJ7lyDUrcGtKL731Wo1lCXQVu/JSZaeuLH2/Q5WiKrBvrRZnxXbKfsQ+uNH6brJslKTNxLPjie5+mXTZq+Ms8LM6x7RIFi2ju9L3vfS8Hiq9//eupZ8+eVbUXX/3qV1NzF302BgwYMN/0SZMmpZkz6z/oXxre/fjzBn19AAAq37sfT0obrTq3wd9n6tSpDRssDjnkkLT77rvnq2yXr2ER9t5771yL0RCiX8cKK6yQJkyYUGN63O/cuXOdz4npC5q//DemxahQ1eeJfhj1ieZY1ZtYRY1F9PXo0KFDg/ex2GTaCrnzzsL85ugd0s4brpmWJ8Pf/zwd99sRC51veVs31ot1o8z4PtnX2AdXIr9PxdbLJut1SB07NnyNxeIMZrREwaJ8UB63jz/+ON9fb731GvTieK1bt0477LBDGjp0aB7ZqVw1E/dPPfXUOp8TNSnx+BlnnFE1La4UXq5hiVGg4jPEPOUgESHhxRdfXODIVm3atMm32qLPR9waUo+N1s4jAoyfPLPOtnfR0q5z+7Zpj690qrh2dw0tPrN1Y70oM75L9jP2wZXEb5N101BlJo4JWy6DY73FObZdoqPgOKC/5JJLckfn9ddfP99WX3319LOf/axB+xhELcGvfvWrPDRsjDwVB/8x6tOxxx6bHz/qqKNqdO4+/fTT0+DBg9OVV16Z+2FcfPHF6eWXX64KIi1atMih49JLL81XDX/jjTfya8RIUeXwUmkiLMQwY6F2USrfj8eXt1ARrBvrRZnxXbKfsQ+uNH6brJvlqcwsUbA4//zz85Cvv/jFL/Iws3H7+c9/noedjetANJQYPvZ//ud/ch+PqGF47bXXcnAod74eM2ZMbp5Vtuuuu+ZrV9x22225ydYf//jH3Om8fA2L8JOf/CQPVxtXDY+hbKdNm5Zfs5KvYRHDi8UwY5FWq4v7y/NQs8G6sV6UGd8l+xn74Erjt8m6WV7KzBJdxyLO6Md1IPbff/8a0x966KH0ox/9KI0dOzYtT5b1dSyqD0cW7fAmTp2ZOq7WNvcbqMT02hhi3cRoCdGxKdogRnWhdaPMKDNL9l2yn7GfUW78NjU0+5rKPZ5ZnOPcJQoWcTb/H//4R9pss81qTI8rYEdNwpdffpmWJ40VLFiwaJYXQyDHVdkbuu8LzYMygzKD/QyVZl4jH88sznHuEi1dNCsqX/26upi2zTbbLMlLAgAATdgSjQp1xRVXpH333Tc98cQTVSMsxZWqP/roo/TYY48t7WUEAAAq3BLVWOyxxx7pn//8Z75mxRdffJFvBx10UHrzzTfT73//+6W/lAAAQEVb4utYRAfuyy67rMa0119/Pd1+++15FCYAAGD5oUcrAABQmGABAAAUJlgAAADLto9FdNBekOjEDQAALH8WK1jExTEW9vhRRx1VdJkAAIDmHCzuuOOOhlsSAACgydLHAgAAECwAAIDGp8YCAAAoTLAAAAAKEywAAIDCBAsAAKAwwQIAAChMsAAAAAoTLAAAgMIECwAAoDDBAgAAKEywAAAAChMsAACAwgQLAACgMMECAAAoTLAAAAAKEywAAIDCBAsAAKAwwQIAAChMsAAAAAoTLAAAgMIECwAAoDDBAgAAKEywAAAAChMsAACAwgQLAACgMMECAAAoTLAAAAAKEywAAIDCBAsAAKAwwQIAAChMsAAAAAoTLAAAgMIECwAAoDDBAgAAKEywAAAAChMsAACAwgQLAACgMMECAAAoTLAAAAAKEywAAIDCBAsAAGD5CRaff/55OvLII1O7du3S6quvno4//vg0bdq0BT5n5syZ6ZRTTklrrbVWWnXVVdPBBx+cJkyYUPX466+/no444ojUtWvXtNJKK6XNN988XXvttcvg0wAAQPPSZIJFhIo333wzDRkyJD366KPpmWeeSSeeeOICn3PmmWemRx55JA0aNCg9/fTTady4cemggw6qenzEiBGpY8eO6a677sqvff7556d+/fqlG264YRl8IgAAaD5alEqlUqpwb731Vtpiiy3SSy+9lHbcccc8bfDgwelb3/pW+vjjj1OXLl3me87kyZNThw4d0j333JMOOeSQPO3tt9/OtRLDhg1Lu+yyS53vFTUc8X5PPvnkIi/flClTUvv27fN7Ro0KlWHevHlp4sSJOTy2bNlkMjSNSJlBmcF+hkozr5GPZxbnOLdJHG1FEIjmT+VQEXr16pVX7osvvljnc6I2Ys6cOXm+su7du6du3brl16tPrLQ111xzKX8CAABo3lqlJmD8+PE5pVXXqlWrHADisfqe07p16xxIquvUqVO9z3n++efTfffdl/785z8vcHlmzZqVb9WTXDlRxo3KENsiKuRsE5QZ7GeoFH6baGplZnHet1GDxbnnnpsuv/zyBc4TzZKWhZEjR6YDDjgg9e/fP+2zzz4LnHfgwIFpwIAB802fNGlS7jBOZYgvQtRAxZdRUyiUGexnqAR+m2hqZWbq1KlNI1icddZZ6ZhjjlngPBtttFHq3LlzbltW3X/+8588UlQ8VpeYPnv27PTFF1/UqLWIUaFqP2fUqFFp7733zp3BL7jggoUud3Tw7tu3b40aixhZKvp06GNRWV/EFi1a5O0iWKDMYD9DJfDbRFMrM23btm0awSJWUNwWpmfPnjkgRL+JHXbYIU+LztWxonv06FHnc2K+FVdcMQ0dOjQPMxtGjx6dxowZk1+vLEaD+vrXv56OPvrodNllly3Scrdp0ybfaouN7QC2ssQX0XZBmcF+hkrit4mmVGYW5z2bROftGMmpT58+6YQTTkjDhw9Pzz33XDr11FPT4YcfXjUi1NixY3Pn7Hg8RO/1uNZF1Cw89dRTOZQce+yxOVSUR4SK5k977bVXbvoU80Xfi7hFkyYAAKCZdd4Od999dw4T0WQpklPUQlx33XVVj8cIUFEjMWPGjKppV199ddW80dm6d+/e6aabbqp6/I9//GMOEXEdi7iVrb/++umDDz5Yhp8OAACatiZxHYtK5zoWlamxx32m6VFmUGawn6HSzHMdCwAAYHniNC4AAFCYYAEAABQmWAAAAIUJFgAAQGGCBQAAUJhgAQAAFCZYAAAAhQkWAABAYYIFAABQmGABAAAUJlgAAACFCRYAAEBhggUAAFCYYAEAABQmWAAAAIUJFgAAQGGCBQAAUJhgAQAAFCZYAAAAhQkWAABAYYIFAABQmGABAAAUJlgAAACFCRYAAEBhggUAAFCYYAEAABQmWAAAAIUJFgAAQGGCBQAAUJhgAQAACBYAAEDjU2MBAAAUJlgAAACFCRYAAEBhggUAAFCYYAEAABQmWAAAAIUJFgAAQGGCBQAAUJhgAQAAFCZYAAAAhQkWAABAYYIFAABQmGABAAAUJlgAAACFCRYAAEBhggUAAFCYYAEAABQmWAAAAIUJFgAAQGGCBQAAUJhgAQAAFCZYAAAAy0+w+Pzzz9ORRx6Z2rVrl1ZfffV0/PHHp2nTpi3wOTNnzkynnHJKWmuttdKqq66aDj744DRhwoQ65/3ss8/Seuutl1q0aJG++OKLBvoUAADQPDWZYBGh4s0330xDhgxJjz76aHrmmWfSiSeeuMDnnHnmmemRRx5JgwYNSk8//XQaN25cOuigg+qcN4LKNtts00BLDwAAzVuTCBZvvfVWGjx4cPr1r3+devTokXbfffd0/fXXp3vvvTeHhbpMnjw53X777emqq65KX//619MOO+yQ7rjjjvT888+nF154oca8N998c66lOPvss5fRJwIAgOalVWoChg0blps/7bjjjlXTevXqlVq2bJlefPHF9J3vfGe+54wYMSLNmTMnz1fWvXv31K1bt/x6u+yyS542atSodMkll+TXee+99xZpeWbNmpVvZVOmTMl/582bl29UhtgWpVLJNkGZwX6GiuG3iaZWZhbnfZtEsBg/fnzq2LFjjWmtWrVKa665Zn6svue0bt06B5LqOnXqVPWcCAdHHHFE+uUvf5kDx6IGi4EDB6YBAwbMN33SpEm5XweVIb4IUXMVX8YIoaDMYD9DY/PbRFMrM1OnTm0aweLcc89Nl19++UKbQTWUfv36pc033zx9//vfX+zn9e3bt0aNRdeuXVOHDh1y53Iq54sYnfFjuwgWKDPYz1AJ/DbR1MpM27Ztm0awOOuss9IxxxyzwHk22mij1Llz5zRx4sQa0//zn//kkaLisbrE9NmzZ+e+E9VrLWJUqPJznnzyyfTGG2+kP/7xj/l+JMGw9tprp/PPP7/OWonQpk2bfKstNrYD2MoSX0TbBWUG+xkqid8mmlKZWZz3bNRgEckrbgvTs2fPHBCi30R0wi6Hgkhw0Zm7LjHfiiuumIYOHZqHmQ2jR49OY8aMya8X7r///vTll19WPeell15Kxx13XHr22WfTxhtvvJQ+JQAANH9Noo9FNFfq06dPOuGEE9Itt9ySO2Wfeuqp6fDDD09dunTJ84wdOzbtvffe6Xe/+13aeeedU/v27fMQstFkKfpiRBOl0047LYeKcsft2uHh008/rXq/2n0zAACAJh4swt13353DRISHqJKJWojrrruu6vEIG1EjMWPGjKppV199ddW80VG7d+/e6aabbmqkTwAAAM1Xi1K5YwFLLDpvRw1J9NjXebtyRFO56JsTI4rp+4Iyg/0MlcBvE02tzCzOca4xOAEAgMIECwAAoDDBAgAAKEywAAAAChMsAACAwgQLAACgMMECAAAoTLAAAAAKEywAAIDCBAsAAKAwwQIAAChMsAAAAAoTLAAAgMIECwAAoDDBAgAAKEywAAAAChMsAACAwgQLAACgMMECAAAoTLAAAAAKEywAAIDCBAsAAKAwwQIAAChMsAAAAAoTLAAAgMIECwAAoDDBAgAAKEywAAAAChMsAACAwgQLAACgMMECAAAoTLAAAAAKEywAAIDCBAsAAKAwwQIAAChMsAAAAAoTLAAAgMIECwAAoDDBAgAAKEywAAAAChMsAACAwloVfwlKpVJeCVOmTLEyKsi8efPS1KlTU9u2bVPLljI0ygz2MzQ+v000tTJTPr4tH+8uiGCxFMTGDl27dl0aLwcAABV3vNu+ffsFztOitCjxg4UmyXHjxqXVVlsttWjRwtqqEJGwI+x99NFHqV27do29ODQBygzKDPYzVJopjXw8E1EhQkWXLl0WWmOixmIpiJW83nrrLY2XogHEl1CwQJmhIdnPoMzQnPczC6upKNPwHAAAKEywAAAAChMsaLbatGmT+vfvn/+CMoP9DJXAbxPNuczovA0AABSmxgIAAChMsAAAAAoTLAAAgMIEC5qVgQMHpp122ilfrLBjx47pwAMPTKNHj27sxaIJ+cUvfpEvdHnGGWc09qJQ4caOHZu+//3vp7XWWiuttNJKaeutt04vv/xyYy8WFWru3LnpwgsvTBtuuGEuLxtvvHH62c9+li8+BuGZZ55J3/72t/OF6OJ36MEHH0zVRVm56KKL0jrrrJPLUK9evdI777yTKolgQbPy9NNPp1NOOSW98MILaciQIWnOnDlpn332SdOnT2/sRaMJeOmll9Ktt96attlmm8ZeFCrcv//977TbbrulFVdcMf3lL39Jo0aNSldeeWVaY401GnvRqFCXX355uvnmm9MNN9yQ3nrrrXz/iiuuSNdff31jLxoVYvr06WnbbbdNN954Y52PR3m57rrr0i233JJefPHFtMoqq6TevXunmTNnpkphVCiatUmTJuWaiwgcX/va1xp7cahg06ZNS9tvv3266aab0qWXXpq22267dM011zT2YlGhzj333PTcc8+lZ599trEXhSZiv/32S506dUq333571bSDDz44n3m+6667GnXZqDwtWrRIDzzwQG55Ua6tiJqMs846K5199tl52uTJk3OZuvPOO9Phhx+eKoEaC5q1+NKFNddcs7EXhQoXNV377rtvrlqGhXn44YfTjjvumL773e/mkxdf/epX069+9SsrjnrtuuuuaejQoemf//xnvv/666+nv//97+mb3/ymtcZCvf/++2n8+PE1fqPat2+fevTokYYNG5YqRavGXgBoKPPmzcvt5KO5wlZbbWVFU6977703vfLKK7kpFCyK9957Lzdr6du3bzrvvPNy2fnxj3+cWrdunY4++mgrkTpruaZMmZK6d++eVlhhhdzn4rLLLktHHnmktcVCRagIUUNRXdwvP1YJBAua9RnokSNH5jNCUJ+PPvoonX766blPTtu2ba0oFvnERdRY/PznP8/3o8Yi9jfR9lmwoC5/+MMf0t13353uueeetOWWW6bXXnstn/yK5i3KDM2FplA0S6eeemp69NFH01NPPZXWW2+9xl4cKtiIESPSxIkTc/+KVq1a5Vv0yYkOcvH/OKsItcWoLFtssUWNaZtvvnkaM2aMlUWdzjnnnFxrEW3hYwSxH/zgB+nMM8/MoxnCwnTu3Dn/nTBhQo3pcb/8WCUQLGhWonNThIro8PTkk0/mYf1gQfbee+/0xhtv5LOH5VuciY7mCfH/aLIAtUUTy9pDWUfb+fXXX9/Kok4zZsxILVvWPOyK/UvUfsHCxPFMBIjop1MWTetidKiePXumSqEpFM2u+VNUMz/00EP5WhbldofRwSlG3oDaopzU7oMTQ/jFtQn0zaE+caY5OuNGU6hDDz00DR8+PN122235BnWJ6xNEn4pu3brlplCvvvpquuqqq9Jxxx1nhVE1OuG7775bo8N2nOCKAWii3ETTuRi1cNNNN81BI66LEk3pyiNHVQLDzdLshmeryx133JGOOeaYZb48NE177rmn4WZZqGhu2a9fv3yBqviRj47cJ5xwgjVHnaZOnZoPBKNGPZpfxgHhEUcckS94Fp3+4W9/+1vaa6+95lsR0QcnhpSNVhn9+/fPJzC++OKLtPvuu+ch0jfbbLOKWXmCBQAAUJg+FgAAQGGCBQAAUJhgAQAAFCZYAAAAhQkWAABAYYIFAABQmGABAAAUJlgAAACFCRYAAEBhggUAjWbSpEnp5JNPTt26dUtt2rRJnTt3Tr17907PPfdcfrxFixbpwQcftIUAmoBWjb0AACy/Dj744DR79uz029/+Nm200UZpwoQJaejQoemzzz5r7EUDYDG1KJVKpcV9EgAU9cUXX6Q11lgj/e1vf0t77LHHfI9vsMEG6cMPP6y6v/7666cPPvgg//+hhx5KAwYMSKNGjUpdunRJRx99dDr//PNTq1atqmo6brrppvTwww/n119nnXXSFVdckQ455BAbDqCBaAoFQKNYddVV8y2aOs2aNWu+x1966aX894477kiffPJJ1f1nn302HXXUUen000/PweLWW29Nd955Z7rssstqPP/CCy/MNSKvv/56OvLII9Phhx+e3nrrrWX06QCWP2osAGg0999/fzrhhBPSl19+mbbffvtccxEBYJtttqmqeXjggQfSgQceWPWcXr16pb333jv169evatpdd92VfvKTn6Rx48ZVPe+kk05KN998c9U8u+yyS36PqMkAYOlTYwFAo4kahQgD0WSpT58+udlSHPxHDUR9ogbikksuqarxiFuEk6jVmDFjRtV8PXv2rPG8uK/GAqDh6LwNQKNq27Zt+sY3vpFv0Xzphz/8Yerfv3865phj6px/2rRpuX/FQQcdVOdrAdA41FgAUFG22GKLNH369Pz/FVdcMc2dO7fG41GjMXr06LTJJpvMd2vZ8v9+1l544YUaz4v7m2+++TL6FADLHzUWADSKGFL2u9/9bjruuONyn4rVVlstvfzyy3n0pgMOOKBqZKgYfna33XbL17mIUaQuuuiitN9+++VrX8QoTxEmonnUyJEj06WXXlr1+oMGDUo77rhj2n333dPdd9+dhg8fnm6//XZbG6CB6LwNQKOIkaAuvvji9Pjjj6d//etfac6cOalr1645bJx33nlppZVWSo888kjq27dvHmZ23XXXrRpu9q9//WvuZ/Hqq6/mWo3u3bvnJlTR16LcefvGG2/MI04988wzebjZyy+/PB166KG2NkADESwAaHbqGk0KgIaljwUAAFCYYAEAABSm8zYAzU6pVGrsRQBY7qixAAAAChMsAACAwgQLAACgMMECAAAoTLAAAAAKEywAAIDCBAsAAKAwwQIAAChMsAAAAFJR/w+F7HbxY8WDywAAAABJRU5ErkJggg==",
            "text/plain": [
              "<Figure size 800x450 with 1 Axes>"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "data": {
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAxYAAAG4CAYAAADYN3EQAAAAOnRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjEwLjksIGh0dHBzOi8vbWF0cGxvdGxpYi5vcmcvJkbTWQAAAAlwSFlzAAAPYQAAD2EBqD+naQAAPHpJREFUeJzt3Qd8VFX+//9PIJIAUpUWepOioAIugiC4VEWp0kQBRVxYdWmKIAqiFCmylF0FG6BgQ6q4UqQIsggoZQUxUqWEEoWQ0CGZ3+Nzvv87/0mf5CRMbvJ6Ph5DmDt3Zu6cOTe573vKDfJ4PB4BAAAAAAu5bJ4MAAAAAAQLAAAAABmCFgsAAAAA1ggWAAAAAKwRLAAAAABYI1gAAAAAsEawAAAAAGCNYAEAAADAGsECAAAAgDWCBQDghjl8+LAEBQXJnDlzcnSpHz16VEJDQ2XTpk2B3pQs79q1a1K2bFl5++23A70pAFJBsADgaocOHZLnnntObrvtNsmXL5+51axZU5599ln53//+F2/d1157zRzUOrebbrpJKlSoIP/4xz8kKioq0WvrY77rFy9eXBo3biyLFy9OtK7H45GPP/5Y7r//filcuLDZjlq1asnrr78uFy5c8OuzpHX7coJTp07JCy+8INWrVzdlmj9/fqlbt66MGTPG1WWi9aJ+/fpy3333eZf17t3bfO8FCxaUS5cuJXrOvn37vHVj8uTJN3R7mzZtGq9u5s2bV2rXri1Tp06VuLi4TH1v3Q8GDx4sY8eOlcuXL2fqewGwE2z5fAAImOXLl0vXrl0lODhYevToIXfeeafkypVLfv31V1m0aJG88847JniUL18+3vN0+c0332wO+NesWSMzZsyQ7du3y/fff5/oPe666y4ZMmSI+X9ERITMmjVLOnbsaF6jX79+ZnlsbKw89thj8sUXX5jgoQFBD4I3btwoo0ePlgULFsi3334rJUqU8OtzpWX7srNt27bJQw89JOfPn5fHH3/cBAr1448/yptvvikbNmyQVatWidtERkbK3LlzzS0hrcsXL16Ur776Srp06RLvsfnz55tWjkAdXJcpU0bGjx9v/v/HH3/IJ598IoMGDTKfRw/6M9OTTz4pw4YNM+/51FNPZep7AbDgAQAX2r9/vyd//vyeGjVqeCIiIhI9fu3aNc+0adM8R44c8S4bNWqUR3/tRUZGxlu3a9euZvmWLVviLS9fvrynTZs28ZadOHHCvO9tt93mXTZu3Djz/BdeeCHRdixbtsyTK1cuT+vWrVP9TGndvqzqwoULyT526NAh81lmz56d4mucPXvWU7p0aU+JEiU8e/fuTfT4yZMnPW+88UaGbO/58+c9N9KUKVM8efPm9cTExMRb3qtXL1O3WrZs6Wnfvn2i51WtWtXTqVMnU36TJk26gVvs8TRp0sRz++23x1t26dIls48UKFDAc/369UzfhocfftjTuHHjTH8fAOlHVygArjRx4kRzRn/27NlSqlSpJM/8ahci7ZudGm1lUAcOHEh13ZIlS0qNGjVMS4jSLiuTJk0yXbGcs7m+HnnkEenVq5esWLFCfvjhBz8/nX/bt2XLFmndurUUKlTItJA0adIkXp997Qqm3VaWLVvmXfbTTz+ZZXXq1In3Wg8++KDpmuNYunSptGnTRsLCwiQkJEQqV64sb7zxhmmdSdhF5o477jCvq93AdDtefvll85h2VdLuPbp92j1My8Hf7kvaMnT8+HGZMmWK6QaVkLb+vPLKK977+pm0pSgh7Uqm2+DQsR267nfffSd///vfTfc2PRP/5ZdfepcntS362O7du73LtFXs0UcflaJFi5pWhHr16sUr55QsWbLElLW2SiVFW7+++eabeGWlrTfaFUofS+jMmTOmu5h2vdPX1K5U+n3u2rUr0bra2qHlpPVVt1v3HW2B86fuJ6TPv+eeeyQmJkZOnz6d6hiahN+R0/Vv//795jvSOqJ1RVsntNUmoRYtWphWO/28ALImggUA13aDqlKlSryD4fTSgyFVpEgRvwaS6sDbW265xdzXA52zZ8+aAz4NM0np2bOnd5szavvWrl1rDuSjo6Nl1KhRMm7cOHMg+te//lW2bt1q1tEDfj1Y0y5DDu2epd3F9KBTn6u0j/x///tf83oOPTDUg1Tt2z5t2jTTDWnkyJGmO0pCf/75pzmQ1W5j2uf+gQceMGNO2rVrZ8adaDcmHRNx7NgxEy78oQfp2o9fD94zg4aKX375xfuZNETp59XubAl9/vnncvvtt5vyVHv27JF7771X9u7da5771ltvmbEf7du3T3L8TcL6oyEhYbDzpQf6esCt3fkc2gVIA1ZSzzt48KAJKw8//LAJYi+++KL8/PPPJmhq9z2HhkJdR7vn6fep2z1gwAA5d+5cvNCUFk6Q0HqWXtrlS8OJBnP9v9Y93caEdJu1XmldBZBFWbR2AEBAnDt3znQHSaq7iHah0a5Ezu3ixYuJuhqFh4ebxw4fPuz58MMPTbeUYsWKJerCo908tFuK81q7du3ydOvWzbzG888/b9aZOnWqub948eJkt/fMmTNmnY4dO6b4ufzdvri4ONMtplWrVub/Dv2sFStW9LRo0cK7TLty/eUvf/He123QW+7cuT3ffPONWbZ9+3bzvkuXLo33Wgn97W9/8+TLl89z+fLleF1k9LkzZ86Mt+6SJUvM8okTJ3qXaXcZ7criT1eoIkWKeO68806Pv/Q1tfwS0u9Quxg59H113UaNGiXqvtO9e3dP8eLF4y3Xrm/ale3111/3LmvWrJmnVq1a8cpBv4eGDRua7yW1Lnz6/jNmzEj0mNMVSj366KPmfVRsbKynZMmSntGjR3u7kvl2hdLt0HV86XohISHxtlvrkj5Xu2Il5FuPkqLfc/Xq1b37wq+//up58cUXzev5dhdMqatbwu/Iqe9PPfVUvPU6dOjgueWWWxI9X7s86voTJkxIcVsBBA4tFgBcxznTnlRXEu2aU6xYMe/t3//+d6J1qlWrZh7TbjI6EFRbPrTriXbjSUgHBzuvpYPDdSD2E088IRMmTDCP65lWVaBAgWS313nM2e7UpLZ9O3fu9HaL0dYCHUirN+0a1qxZM9NC4czUo92odOC3MzOVtrDogGhtXdDWC6U/9axzo0aNvNugrQUO/Yz6+vpa2kVFuwH50q5S2n3F13/+8x/TgtO/f3/vsty5c8vzzz/vVxloWaVUprb69u1rtseXTgSgXXrWr1/vXaZdpLQs9TGl3XC0tcg5y+6UvX4PrVq1Mt+LduFKjq7nT+uYfre6HSdPnjTvpz+T6gbllL+2QjmtEvoeum9oPdLv3rFw4UK59dZbk/wO9PtPjX7vzr6grSfaBbBt27bWUwc7kyA4tJ7pZ0i4vzhlpuUNIGtiVigAruMccOpsQUn1h9cDPp2mVLvgJEUPsLQfus5mM336dDNewvdA2pd2tdJuPHrgpQf2Or7Ct9uHsy1OwEiKP+EjLdunB68qpW5F2r1FD8T0IO369euyefNmM95ED5x1mXbn8Q0WOkWvjhdw6OM6hkEPahMe4Olr+ypdurTkyZMn3rLff//d9N9PGP70YNcf+vlTKlNbFStWTLTMGa+iXZ80oCn9v4YwHZOgdDyAnnx/9dVXzS0pWsZaJin5vxP4ydPwp/VF31+DpI5l0IDpdIvzpcFHu6vpdR60rviOg3G67CkdR6Hln1yXvdRo0H3vvffM++lr6UxQWkd1rIWNcuXKJRkgtIuh1oOEZeZPCAIQGAQLAK6jB3960JpUv3BnzEVSB2AOHUugZ26dwdU66FWnq9UByM6ZX4eu17x582RfS4OGM1Ba+9gnxbmehh68+yO17XNaI/SMsR70JsU5oNdBxXrgp60YegCng5X1IFnDhR6IXrlyxQSLDh06eJ+rYzW0f74e1On1FnTgtr6Gnv1+6aWXEl23ILlQZkPPiOsB9dWrVxOFlrRIONg8pW3WM//OOAktGw2nOhhex684nM+ug6W1hSIpGgCS4xzo60FzSnRbdKyFTkmrYyiSGpju0O3TkKOtWzrAXgOi1pOBAwdm6DUmdByJ776g1+DQMR86WF8DcEoH/cl9Dyphy1Fy4cspM2ffAJD1ECwAuJIOtn3//ffNQOW//OUv6X4dPQDXwc/alUcH7nbr1i1Nz9fuQ9qCoYNrR4wYkeRB0kcffWR+6sDZjNg+PdBXeuCfUuhRelCu5aPhQYOFM8OU/tRQoddG0ANo34Hb2gVHu6Lo4GHf5c5MWP7Qa4foNTi0Vcm31SI8PNyv52ug0lYWbb3p3r17quvrWe6EM05pKDlx4oSkhXZ50oN53XYdnK0Ht043KFWpUiXvRdtSK/uk6HegocafstSuTx9++KEJCSnVS+2upQPmP/jgg3jLtTx8D8K13uhMYjqAXLffll4gT1sFtZVQg5Z+Nqe1IeF3oS1Ytpwyc8I8gKyHMRYAXGno0KGma5KepdUD47R2NfGlrQE65agzbiItdBv0oEoPmDVYJPT111+bPuh6dltnEkqPhNuns+PoQaJefTmp7mDaPcWXhgg9oFy3bp03WOgBpx6gOa/pLFdOOPItQz1I17P4/tKuPNoFSy/253vWWi/252+/e22V0osT/vbbb0l2N9Iuag4tD9/Zr9S7776b4pnypGhY0DP+2gVJbxrKfLtNaYuPjuPRg+mkQkvCsk9ID+i1FUkv8pcaDQvaAvGvf/3LTHOcHP2+EtZ3HQuUcKxHp06dzPgEfT2b/SXhfqhBRWejcsKu1q2E30Va6k5ynKmSGzRoYP1aADIHLRYAXKlq1aqmlUDPZmu/cefK23qApGc29TE906sH5KnRgz2ddlOn6dTrTWhf+7TQKUd37NhhDtL1LLsewOlZaR0oPW/ePHMAn9RVlv2V1PZpa41O8arToGprhvbp1wNJDQ96cKdXbnZoaND+8DpNrm+A0NYIPUDWvvO+5dSwYUNz5lnHcOi1QPRgTqeNTcvBp7Y4aFcZLRvtlqbdwLQFJOH4jOTo+2uXJGegue+Vt7VL1qeffhrvAPPpp582YUTLXq93oNPprly5Ms3dZrSstQvSZ599Zga8a3hLSCcE0JYq7aKmg8C1FUPDrX73OqVuUteP8KXT8GoI1bErvmMIEtL663utjuRoS5h2WdN6oN+dTjWrLVFO64rvtMfaeqZTCGtLn9YF/Yx6VXidfle3K630e9XvSOujdsfSrl76XeiV0fWnhigNGUmFw7RavXq1qVO+40YAZDEBnJEKAKzp9J39+/f3VKlSxRMaGmqmZtVpMfv16+fZuXOnX1e2dqawLVSokJlWM6UrbydHp/vUKTbvu+8+T8GCBc226JWKdYpQf6/snNbt27Fjh5k6Vqfm1KlFdXu7dOniWbNmTbznRkdHm+llE14hed68eeb9nnjiiUTvt2nTJs+9995ryjMsLMwzdOhQz8qVK83669atS/GKzI4///zTvLaWh267/l+32Z/pZn2nGB00aJC50rmWqU53W7duXc/YsWNNmfiW/0svveS59dZbzTo6Fa/WjeSmm922bVuy77l69WqzTlBQkOfo0aNJrnPgwAFPz549zTSwN910k7lKuF4Z+ssvv0z1M506dcoTHBzs+fjjj5OdbjY5yU03O2TIEE+pUqXM96V1cPPmzea78a0vzjTCI0aMMNMS63br9uvUtvp5UpLS97x+/fp4U8nqe/Tp08d851rntE6ePn062elmE9Z35zvSz+qIiory5MmTx/P++++nuJ0AAitI/wl0uAEAICfp06ePOYvvzMyFlOmFFydOnGhmo8qMyQIAZAyCBQAAN9iRI0fM7Fw6SFy79yB5OoZDx9BotzrtsgUg6yJYAAAAALDGrFAAAAAArBEsAAAAAFgjWAAAAACwRrAAAAAAYI0L5GWAuLg4iYiIkAIFCpgLSQEAAADZgV6ZIiYmRsLCwsyFO1NCsMgAGirKli2bES8FAAAAZDlHjx6VMmXKpLgOwSIDaEuFU+AFCxaUQLSYREZGSrFixVJNkqDsqHdZA/stZUe9cx/2W8ouJ9a76OhocwLdOd5NCcEiAzjdnzRUBCpYXL582bw3wYKyo965A/stZUe9cx/2W8ouJ9e7ID+6+3N6GwAAAIA1ggUAAAAAawQLAAAAANYIFgAAAACsESwAAAAAWCNYAAAAALBGsAAAAABgjWABAAAAwBrBAgAAAIA1ggUAAAAAawQLAAAAANYIFgAAAACsESwAAAAAWCNYAAAAALBGsAAAAABgjWABAAAAwBrBAgAAAIA1ggUAAAAAawQLAAAAANYIFgAAAACsESwAAAAAWCNYAAAAALBGsAAAAABgjWABAAAAwBrBAgAAAIA1ggUAAAAAawQLAAAAANYIFgAAAACsESwAAAAAWCNYAAAAALBGsAAAAABgjWABAAAAwBrBAgAAAIA1ggUAAAAAawQLAAAAANYIFgAAAACsESwAAAAAWCNYAAAAALBGsAAAAABgjWABAAAAwBrBAgAAAEDOCRZnzpyRHj16SMGCBaVw4cLSp08fOX/+fIrPOXDggHTo0EGKFStmntelSxc5depUovW+/vprqV+/vuTNm1eKFCki7du3z8RPAgAAAGQ/rgkWGir27Nkjq1evluXLl8uGDRvkmWeeSXb9CxcuSMuWLSUoKEjWrl0rmzZtkqtXr8ojjzwicXFx3vUWLlwoTzzxhDz55JOya9cus95jjz12gz4VAAAAkD0Eiwvs3btXVqxYIdu2bZN69eqZZTNmzJCHHnpIJk+eLGFhYYmeowHh8OHDsmPHDtNaoebOnWtaJDRoNG/eXK5fvy4DBgyQSZMmmRYQR82aNW/gpwMAAADczxUtFps3bzbdn5xQoTQY5MqVS7Zs2ZLkc65cuWJaK0JCQrzLQkNDzXO+//57c3/79u1y/Phxs+zuu++WUqVKyYMPPii7d+++AZ8KAAAAyD5c0WJx8uRJKV68eLxlwcHBUrRoUfNYUu69917Jnz+/vPTSSzJu3DjxeDwybNgwiY2NlRMnTph1Dh48aH6+9tprMmXKFKlQoYK89dZb0rRpU/ntt9/M6ycXWvTmiI6ONj+1i5VvN6sbRd9TP18g3tvtKDvKjrrnPuy3lB11z33Yb91bdml534AGCz3QnzBhQqrdoNJDB2wvWLBA+vfvL9OnTzetEt27d5c6deqY//sW1IgRI6RTp07m/7Nnz5YyZcqY5/7tb39L8rXHjx8vo0ePTrQ8MjJSLl++LDeafo5z586ZSud8NlB21Lusjf2WsqPeuQ/7LWWXE+tdTEyMO4LFkCFDpHfv3imuU6lSJSlZsqScPn063nIdH6EzReljydHB2zoz1B9//GFaOLQ7la6vr6m061PCMRXadUofP3LkSLKvO3z4cBk8eHC8FouyZct6Z58KRIXTbl/6/gQLyo565w7st5Qd9c592G8pu5xY70JDQ90RLLSA9JaaBg0aSFRUlPz0009St25ds0wHYGtB6zSxqbn11lu9z9GA0rZtW3NfX0uDRHh4uDRq1Mgsu3btmhn0Xb58+WRfT5/jO3bDoV92oA7stcIF8v3djLKj7Kh77sN+S9lR99yH/dadZZeW93TFUWiNGjWkdevW0rdvX9m6dauZ8em5556Tbt26eWeE0kHY1atXN487tFvTDz/8YFot5s2bJ507d5ZBgwZJtWrVzOPautCvXz8ZNWqUrFq1ygQM7TqldF0AAAAA2Wjwtpo/f74JE82aNTPJScdE6NgJh7Y0aDC4ePGid5ne125L2mVKB2brWAoNFr50qlntJqXXsrh06ZJpAdGWDZ2WFgAAAIB/gjw6EgRWdIxFoUKFzMCaQI2x0C5eOnMWXaEoO+qdO7DfUnbUO/dhv6XscmK9i07Dca4rukIBAAAAyNoIFgAAAACsESwAAAAAWCNYAAAAALBGsAAAAABgjWABAAAAwBrBAgAAAIA1ggUAAAAAawQLAAAAANYIFgAAAACsESwAAAAAWCNYAAAAALBGsAAAAABgjWABAAAAwBrBAgAAAIA1ggUAAAAAawQLAAAAANYIFgAAAACsESwAAAAAWCNYAAAAALBGsAAAAABgjWABAAAAwBrBAgAAAIA1ggUAAAAAawQLAAAAANYIFgAAAACsESwAAAAAECwAAAAABB4tFgAAAACsESwAAAAAWCNYAAAAALBGsAAAAABgjWABAAAAwBrBAgAAAIA1ggUAAAAAawQLAAAAANYIFgAAAACsESwAAAAAWCNYAAAAALBGsAAAAABgjWABAAAAwBrBAgAAAIA1ggUAAAAAawQLAAAAANYIFgAAAACsESwAAAAAWCNYAAAAALBGsAAAAABgjWABAAAAwBrBAgAAAIA1ggUAAAAAawQLAAAAANYIFgAAAACsESwAAAAA5JxgcebMGenRo4cULFhQChcuLH369JHz58+n+JwDBw5Ihw4dpFixYuZ5Xbp0kVOnTsVb57fffpN27drJrbfeatZp1KiRrFu3LpM/DQAAAJC9uCZYaKjYs2ePrF69WpYvXy4bNmyQZ555Jtn1L1y4IC1btpSgoCBZu3atbNq0Sa5evSqPPPKIxMXFedd7+OGH5fr162adn376Se68806z7OTJkzfokwEAAADuFywusHfvXlmxYoVs27ZN6tWrZ5bNmDFDHnroIZk8ebKEhYUleo4GicOHD8uOHTtMS4SaO3euFClSxISI5s2byx9//CH79u2TDz74QGrXrm3WefPNN+Xtt9+W3bt3S8mSJW/wJwUAAADcyRXBYvPmzab7kxMqlAaDXLlyyZYtW0x3p4SuXLliWitCQkK8y0JDQ81zvv/+e/P8W265RapVqyYfffSR1KlTx6w7a9YsKV68uNStWzfZ7dHX1psjOjra/NSWEN/WkBtF39Pj8QTkvd2OsqPsqHvuw35L2VH33If91r1ll5b3dUWw0G5JerDvKzg4WIoWLZpsl6V7771X8ufPLy+99JKMGzfOfCHDhg2T2NhYOXHihFlHg8e3334r7du3lwIFCpjQoe+jrSPaspGc8ePHy+jRoxMtj4yMlMuXL0sgvvBz586Zz6ifAZQd9S7rY7+l7Kh37sN+S9nlxHoXExPjjmChB/oTJkxItRtUeuiA7QULFkj//v1l+vTp5ovo3r27aZlwvhT9gp599lkTJjZu3Ch58+aV999/34zD0G5XpUqVSvK1hw8fLoMHD47XYlG2bFnvIPFAVDgNSfr+BAvKjnrnDuy3lB31zn3Ybym7nFjvQkND3REshgwZIr17905xnUqVKpmxDqdPn463XAdc60xRKY2D0MHbOjOUjqXQFg7tTqXr62sqHWuhA8HPnj3rDQQ6vkIHiOt4DA0+SdEuU75drBz6ZQfqwF4rXCDf380oO8qOuuc+7LeUHXXPfdhv3Vl2aXnPgAYLTV56S02DBg0kKirKzNrkjH3QUKAJrn79+qk+X6eSdZ6jAaVt27bm/sWLF5MsML3PeAUAAADAf644vV2jRg1p3bq19O3bV7Zu3WpmfHruueekW7du3hmhjh8/LtWrVzePO2bPni0//PCDabWYN2+edO7cWQYNGmQGbDuBRcdS9OrVS3bt2mWuafHiiy/KoUOHpE2bNgH7vAAAAIDbuGLwtpo/f74JE82aNTMtCp06dTJjJxzXrl2T8PBwbyuE0vs6HkK7TFWoUEFGjBhhgoVvS4YO1Nblf/3rX81r3H777bJ06VJzPQsAAAAA2SxY6AxQn3zySbKPa3DQwdi+9JoUekuJTmG7cuXKDNtOAAAAICdyRVcoAAAAAFkbwQIAAACANYIFAAAAAGsECwAAAADWCBYAAAAArBEsAAAAAFgjWAAAAACwRrAAAAAAYI1gAQAAAMAawQIAAACANYIFAAAAAGsECwAAAADWCBYAAAAArBEsAAAAAFgjWAAAAACwRrAAAAAAYI1gAQAAAMAawQIAAACANYIFAAAAAGsECwAAAADWCBYAAAAArBEsAAAAAFgjWAAAAACwRrAAAAAAYI1gAQAAAMAawQIAAACANYIFAAAAAGsECwAAAADWCBYAAAAArBEsAAAAAFgjWAAAAACwRrAAAAAAYI1gAQAAAMAawQIAAACANYIFAAAAAGvB/q44ePBgv190ypQp6d0eAAAAANk5WOzYsSPe/e3bt8v169elWrVq5v5vv/0muXPnlrp162b8VgIAAADIHsFi3bp18VokChQoIHPnzpUiRYqYZWfPnpUnn3xSGjdunDlbCgAAACB7jbF46623ZPz48d5QofT/Y8aMMY8BAAAAyFnSFSyio6MlMjIy0XJdFhMTkxHbBQAAACC7B4sOHTqYbk+LFi2SY8eOmdvChQulT58+0rFjx4zfSgAAAADZY4yFr5kzZ8oLL7wgjz32mFy7du3/Xig42ASLSZMmZfQ2AgAAAMhuwSI2NlZ+/PFHGTt2rAkRBw4cMMsrV64s+fPnz4xtBAAAAJDdgoVOKduyZUvZu3evVKxYUWrXrp05WwYAAAAge4+xuOOOO+TgwYMZvzUAAAAAck6w0GlldYzF8uXL5cSJE2aWKN8bAAAAgJwlXYO3H3roIfOzbdu2EhQU5F3u8XjMfR2HAQAAACDnSFew8L0KNwAAAACkK1g0adKEkgMAAABgFywcFy9elCNHjsjVq1fjLWemKAAAACBnSVewiIyMNFfe/uabb5J8nDEWAAAAQM6SrlmhBg4cKFFRUbJlyxbJmzevrFixQubOnStVq1aVZcuWZfxWAgAAAMh+LRZr166VpUuXSr169SRXrlxSvnx5adGihRQsWFDGjx8vbdq0yfgtBQAAAJC9WiwuXLggxYsXN/8vUqSI6RqlatWqJdu3b5fMMHbsWGnYsKHky5dPChcu7NdzdPrbkSNHSqlSpUzLSvPmzWXfvn3x1jlz5oz06NHDhCJ93T59+sj58+fFLWLjYmX94fWyeP9i81PvA9Q7ZFf8zgN1DzlJrMuO89LVYlGtWjUJDw+XChUqyJ133imzZs0y/585c6Y5iM8MOkC8c+fO0qBBA/nggw/8es7EiRNl+vTppptWxYoV5dVXX5VWrVrJL7/8IqGhoWYdDRV6kb/Vq1fLtWvXzNiRZ555Rj755BPJ6hbtXSQDVgyQY9HHvMvKFCwj01pPk441OgZ025B9Ue9A3UNOw+89UO/8E+TR0/ppNG/ePLl+/br07t1bfvrpJ2ndurU5858nTx6ZM2eOdO3aVTKLvr4zxiMl+rHCwsJkyJAh5irh6ty5c1KiRAnzGt26dZO9e/dKzZo1Zdu2baZbl9LxInoBwGPHjpnn+0OvNl6oUCHz+trycaN+yT36xaPikfhfX5D83wULv+zyJeHCD3FxcXL69GnTAqfd+kC9u1Goe2nD7zzqXaBQ96h7Ob3eRafhODddwSKpaWd//fVXKVeunNx6662SmfwNFgcPHpTKlSvLjh075K677op3DQ69P23aNPnwww9N8Dh79qz3cQ1M2pqxYMEC6dChQ5YMFtoMVmFahXgtFQkrXekCpWXP3/dI7ly5M3173H5wp135ihUrRrDwo97VfLumHI85nuTj1DvqXmah7mUcfudR9wKFupexv/O0h8qhAYduyHFeWo5z09UVSg/aK1Wq5L2v4x7q1KkjWcnJkyfNT22h8KX3ncf0pzNWxBEcHCxFixb1rpOUK1eumJtvgTs7jd4y23eHv0s2VChNt8dijkmhCYUyfVsA6h0Cjd95oO4hp/3OOxp91BwPNq3QNNPfLy3HtukKFlWqVJEyZcqYs/9NmzY1P3VZWg0bNkwmTJiQ4jraXal69eqSlejMV6NHj060XM98X758OdPfPzwiPNPfAwAAAFlXeES41MxXM9PfJyYmJnODxdGjR2X9+vXy3XffmQHSffv2NeMRNGA88MAD8vTTT/v1OtoNScdppMS3ZSQtSpYsaX6eOnUq3oByve90jdJ1tH+9L+0KpeNFnOcnZfjw4TJ48OB4LRZly5Y13WluRFeoaher+bXe192/lsblGmf69riZpvA//vjDdOFjjEXKNh7ZKG0+TX0qaeoddS+jUfcyDr/zqHuBQt3L+N951cKqJep5kxmcCY8yLViULl3azKakN6VTuOp0sPPnz5fPPvvM72ChB+J6yww6C5SGgzVr1niDhAYAvahf//79zX2dYUrHaugA9Lp163qv0aGVv379+sm+dkhIiLklpAemN+LgtEmFJqZv3fHo44kG9fj2vWtVpRVjLFKh3/WlPJekQGgBgkUqtD5R7zIOdc9/1D3qXaBQ96h7WbneNanQ5IYcu6TlPXKld7D2qlWr5OWXXzbXlqhdu7bs2rVLnnvuOVm0aJFkhiNHjsjOnTvNz9jYWPN/vflec0K7TC1evNj8PygoyAzyHjNmjLka+M8//yw9e/Y0LSvt27c369SoUcPMaKUtLlu3bpVNmzaZz6AzRvk7I1Qg6EAdnVLWd3YAh3N/auuphApQ75At8DsP1D3kJLldfJyXrmChF5J74oknzHgCHScRERFhZl/65z//Ke3atcv4rRQxF7q7++67ZdSoUSZM6P/19uOPP3rX0Wtr6Ih1x9ChQ+X5558316W45557zPN0OlnfJh1tZdFA0qxZMzPNbKNGjeTdd9+VrE6nGNOpxkoXLB1vuSZYppoF9Q7ZDb/zQN1DTtLRpcd56ZpuVs/4f//99+a6FTp427nddtttkhMF4joWvlOS6awAOoBH+9pps1hWTLBZFdcSSB/qHXUvUKh7dvidR90LFOqee3/n3bDrWPzvf/8zA7j1tnHjRjNVqwYMbQXISQIZLBQ7K2UXCNQ7yi9QqHuUHXXPfdhv3Vt2mX4dC0etWrXMLEpXr1413aJWrlwpn3/+eY4LFgAAAEBOl67YM2XKFGnbtq3ccsstZvakTz/91HSDWrhwobmWAwAAAICcJV0tFhok9JoVOii6cePGpnkEAAAAQM6VrmCxbdu2jN8SAAAAAK6V7hEgOlj78ccfNxeZO378uFn28ccfm9miAAAAAOQs6QoWOpaiVatWkjdvXnP9iitXrpjlOlp83LhxGb2NAAAAALJjsNCrWc+cOVPee+89uemmm7zL77vvPtm+fXtGbh8AAACA7Bos9ArX999/f6LlOog7KioqI7YLAAAAQHYPFiVLlpT9+/cnWq7jKypVqpQR2wUAAAAguweLvn37yoABA2TLli0SFBQkERER5qJ4Q4YMkf79+2f8VgIAAADIftPNDhs2zFxevFmzZnLx4kXTLSokJERefPFFefrppzN+KwEAAABkaelqsdBWihEjRsiZM2dk9+7d8sMPP5grbusYi4oVK2b8VgIAAADIPsFCp5UdPny41KtXz8wA9Z///Edq1qwpe/bskWrVqsm0adNk0KBBmbe1AAAAANzfFWrkyJEya9Ysad68ufz3v/+Vzp07y5NPPmlaLN566y1zP3fu3Jm3tQAAAADcHywWLFggH330kbRt29Z0gapdu7Zcv35ddu3aZbpHAQAAAMiZ0tQV6tixY1K3bl3z/zvuuMMM2NauT4QKAAAAIGdLU7CIjY2VPHnyeO8HBwfLzTffnBnbBQAAACC7doXyeDzSu3dv01KhLl++LP369ZP8+fPHW2/RokUZu5UAAAAAsk+w6NWrV7z7jz/+eEZvDwAAAIDsHixmz56deVsCAAAAIGddIA8AAAAAfBEsAAAAAFgjWAAAAACwRrAAAAAAYI1gAQAAAMAawQIAAACANYIFAAAAAGsECwAAAADWCBYAAAAArBEsAAAAAFgjWAAAAACwRrAAAAAAYI1gAQAAAMAawQIAAACANYIFAAAAAGsECwAAAADWCBYAAAAArBEsAAAAAFgjWAAAAACwRrAAAAAAYI1gAQAAAMAawQIAAACANYIFAAAAAGsECwAAAADWCBYAAAAArBEsAAAAAFgjWAAAAACwRrAAAAAAYI1gAQAAAMAawQIAAACANYIFAAAAAGsECwAAAAA5J1iMHTtWGjZsKPny5ZPChQv79RyPxyMjR46UUqVKSd68eaV58+ayb98+7+OHDx+WPn36SMWKFc3jlStXllGjRsnVq1cz8ZMAAAAA2Y9rgoUe7Hfu3Fn69+/v93MmTpwo06dPl5kzZ8qWLVskf/780qpVK7l8+bJ5/Ndff5W4uDiZNWuW7NmzR/75z3+adV9++eVM/CQAAABA9hMsLjF69Gjzc86cOX63VkydOlVeeeUVadeunVn20UcfSYkSJWTJkiXSrVs3ad26tbk5KlWqJOHh4fLOO+/I5MmTM+mTAAAAANmPa1os0urQoUNy8uRJ0/3JUahQIalfv75s3rw52eedO3dOihYteoO2EgAAAMgeXNNikVYaKpS2UPjS+85jCe3fv19mzJiRamvFlStXzM0RHR1tfmq3Kr3daPqe2kITiPd2O8qOsqPuuQ/7LWVH3XMf9lv3ll1a3jegwWLYsGEyYcKEFNfZu3evVK9ePdO35fjx46ZblI7j6Nu3b4rrjh8/3ts1y1dkZKR3/MaN/sK1pUUrXa5c2bYRKlNQdpQddc992G8pO+qe+7DfurfsYmJi3BEshgwZIr17905xHR33kB4lS5Y0P0+dOmVmhXLo/bvuuiveuhEREfLAAw+YWafefffdVF97+PDhMnjw4HgtFmXLlpVixYpJwYIFJRAVLigoyLw/wYKyo965A/stZUe9cx/2W8ouJ9a70NBQdwQLLSC9ZQadQlbDxZo1a7xBQgOAzg7lO7OUtlRoqKhbt67Mnj3bry8sJCTE3BLS5wbqwF4rXCDf380oO8qOuuc+7LeUHXXPfdhv3Vl2aXlP1xyFHjlyRHbu3Gl+xsbGmv/r7fz58951tMvU4sWLvV/AwIEDZcyYMbJs2TL5+eefpWfPnhIWFibt27f3hoqmTZtKuXLlzLgK7cqk4y+SG4MBAAAAwOWDt/VCd3PnzvXev/vuu83PdevWmXCgdKpY7YPmGDp0qFy4cEGeeeYZiYqKkkaNGsmKFSu8TTqrV682A7b1VqZMmXjvp/3YAAAAAPgnyMMRtDXtYqVT2WqoCdQYi9OnT0vx4sXpCkXZUe9cgv2WsqPeuQ/7LWWXE+tddBqOc13TFQoAAABA1kWwAAAAAGCNYAEAAADAGsECAAAAgDWCBQAAAABrBAsAAAAA1ggWAAAAAKwRLAAAAABYI1gAAAAAsEawAAAAAGCNYAEAAADAGsECAAAAgDWCBQAAAABrBAsAAAAA1ggWAAAAAKwRLAAAAABYI1gAAAAAsEawAAAAAGCNYAEAAADAGsECAAAAgDWCBQAAAABrBAsAAAAA1ggWAAAAAKwRLAAAAABYI1gAAAAAsEawAAAAAGCNYAEAAADAGsECAAAAgDWCBQAAAABrBAsAAAAA1ggWAAAAAAgWAAAAAAKPFgsAAAAA1ggWAAAAAKwRLAAAAABYI1gAAAAAsEawAAAAAGCNYAEAAADAGsECAAAAgDWCBQAAAABrBAsAAAAA1ggWAAAAAKwRLAAAAABYI1gAAAAAsEawAAAAAGCNYAEAAADAGsECAAAAgDWCBQAAAABrBAsAAAAA1ggWAAAAAKwRLAAAAABYI1gAAAAAsEawAAAAAGCNYAEAAAAg5wSLsWPHSsOGDSVfvnxSuHBhv57j8Xhk5MiRUqpUKcmbN680b95c9u3bl+S6V65ckbvuukuCgoJk586dGbz1AAAAQPbmmmBx9epV6dy5s/Tv39/v50ycOFGmT58uM2fOlC1btkj+/PmlVatWcvny5UTrDh06VMLCwjJ4qwEAAICcwTXBYvTo0TJo0CCpVauW360VU6dOlVdeeUXatWsntWvXlo8++kgiIiJkyZIl8db95ptvZNWqVTJ58uRM2noAAAAgewuWbOrQoUNy8uRJ0/3JUahQIalfv75s3rxZunXrZpadOnVK+vbta8KGdrPyh3ab0psjOjra/IyLizO3G03fU4NUIN7b7Sg7yo665z7st5Qddc992G/dW3Zped9sGyw0VKgSJUrEW673ncf0S+rdu7f069dP6tWrJ4cPH/brtcePH29aUBKKjIxMspvVjfjCz507Zz5PrlyuaYTKEig7yo665z7st5Qddc992G/dW3YxMTHuCBbDhg2TCRMmpLjO3r17pXr16pny/jNmzDCFNXz48DQ9T9cfPHhwvBaLsmXLSrFixaRgwYISiAqng871/QkWlB31zh3Ybyk76p37sN9Sdjmx3oWGhrojWAwZMsS0GKSkUqVK6XrtkiVLers66axQDr2vsz+ptWvXmm5RISEh8Z6rrRc9evSQuXPnJvnaun7C5yj9sgN1YK8VLpDv72aUHWVH3XMf9lvKjrrnPuy37iy7tLxnQIOFJi+9ZYaKFSuacLFmzRpvkNCWBZ0dyplZSmeMGjNmjPc5OrBbZ436/PPPzVgMAAAAANlsjMWRI0fkzJkz5mdsbKz3WhNVqlSRm2++2fxfu0zp+IcOHTqYZDdw4EATHKpWrWqCxquvvmqmlG3fvr1Zv1y5cvHew3mdypUrS5kyZW74ZwQAAADcyjXBQi9059s16e677zY/161bJ02bNjX/Dw8PN4NbfK9NceHCBXnmmWckKipKGjVqJCtWrEhTXzEAAAAA2ShYzJkzx9xSoqPlfWmrxeuvv25u/qhQoUKi1wAAAACQOkb6AgAAALBGsAAAAABgjWABAAAAwBrBAgAAAIA1ggUAAAAAawQLAAAAANYIFgAAAACsESwAAAAAWCNYAAAAALBGsAAAAABgjWABAAAAwBrBAgAAAIA1ggUAAAAAawQLAAAAANYIFgAAAACsESwAAAAAWCNYAAAAALBGsAAAAABgjWABAAAAwBrBAgAAAIA1ggUAAAAAawQLAAAAANYIFgAAAACsESwAAAAAWCNYAAAAALBGsAAAAABgjWABAAAAwBrBAgAAAIA1ggUAAAAAawQLAAAAANYIFgAAAACsESwAAAAAWCNYAAAAALBGsAAAAABgjWABAAAAwBrBAgAAAIA1ggUAAAAAawQLAAAAANYIFgAAAACsESwAAAAAWCNYAAAAALAWbP8S8Hg8phCio6MDUhhxcXESExMjoaGhkisXWZGyo965AfstZUe9cx/2W8ouJ9a76P/v+NY53k0JwSID6JetypYtmxEvBwAAAGS5491ChQqluE6Qx5/4gVSTZEREhBQoUECCgoICkiQ11Bw9elQKFix4w9/fzSg7yo665z7st5Qddc992G/dW3YaFTRUhIWFpdpiQotFBtBCLlOmjASaVjaCBWVHvXMX9lvKjnrnPuy3lF1Oq3eFUmmpcNAhHwAAAIA1ggUAAAAAawSLbCAkJERGjRplfoKyo965A/stZUe9cx/2W8qOepcyBm8DAAAAsEaLBQAAAABrBAsAAAAA1ggWAAAAAKwRLFxsw4YN8sgjj5gLluiF+ZYsWRLoTXKF8ePHyz333GMuaFi8eHFp3769hIeHB3qzXOOdd96R2rVre+fTbtCggXzzzTeB3ixXevPNN82+O3DgwEBviiu89tprprx8b9WrVw/0ZrnG8ePH5fHHH5dbbrlF8ubNK7Vq1ZIff/wx0JuV5VWoUCFRvdPbs88+G+hNy/JiY2Pl1VdflYoVK5o6V7lyZXnjjTfMBdfgH70wnf6NKF++vCnDhg0byrZt2ySr4gJ5LnbhwgW588475amnnpKOHTsGenNc47vvvjN/EDRcXL9+XV5++WVp2bKl/PLLL5I/f/5Ab16WpxeD1APiqlWrmj8Oc+fOlXbt2smOHTvk9ttvD/TmuYb+YZg1a5YJafCf1rFvv/3Wez84mD9j/jh79qzcd9998sADD5gTAcWKFZN9+/ZJkSJFqH5+7Kt6gOzYvXu3tGjRQjp37kzZpWLChAnmZJT+ndB9V4Psk08+aS629o9//IPy88PTTz9t6tzHH39sTiTPmzdPmjdvbo5ZSpcuLVkNs0JlE3r2ZPHixebsO9ImMjLStFxo4Lj//vspvnQoWrSoTJo0Sfr06UP5+eH8+fNSp04defvtt2XMmDFy1113ydSpUyk7P1ostGV2586dlFUaDRs2TDZt2iQbN26k7Czp2ePly5ebYKZ/e5G8hx9+WEqUKCEffPCBd1mnTp3MmXc9QEbKLl26ZHpXLF26VNq0aeNdXrduXXnwwQfN34+shq5QyPHOnTvnPThG2uhZvM8++8y0nmmXKPhHW8z0j4SedULa6MGcnrWrVKmS9OjRQ44cOUIR+mHZsmVSr149c5ZdT6Tcfffd8t5771F2aXT16lVzQKw9BQgVqdNuO2vWrJHffvvN3N+1a5d8//335qAYqdNeFfp3NjQ0NN5yDWZajlkRbcjI0eLi4szZJ+0icMcddwR6c1zj559/NkHi8uXLcvPNN5vWspo1awZ6s1xBg9j27duzdB/ZrKp+/foyZ84cqVatmpw4cUJGjx4tjRs3Nt0E9Kweknfw4EHTJWXw4MGm+6fWP+2KkidPHunVqxdF5ydtMYuKipLevXtTZn62lEVHR5uxULlz5zYHyWPHjjUnBZA6/b2mf2t1XEqNGjVM68+nn34qmzdvlipVqkhWRLCA5PQzx3pQklWTf1alB3baHUVbe7788ktzYKJdyQgXKTt69KgMGDBAVq9enegMFFLne5ZTx6Zo0NABjV988QXd8Pw4iaItFuPGjTP3tcVCf/fNnDmTYJEG2qVH66G2miF1um/Onz9fPvnkEzPGQv9u6Mk8LT8CrX90bIW2kOl4Cg1n2o22e/fu8tNPP0lWRLBAjvXcc8+ZfrI6u5YOSIb/9Cync7ZE+3rq2c9p06aZwchInv4hOH36tPnD4NAzeFoH//Wvf8mVK1fMHw74p3DhwnLbbbfJ/v37KbJUlCpVKlHw1zOgCxcupOz89Pvvv5uJAxYtWkSZ+enFF180rRbdunUz93UmMi1HnZ2RYOEfnUlLT9xpl2Nt/dF9uWvXrqY7aFbEGAvkODqTkYYK7b6zdu1aMw0e7M+G6kExUtasWTPTjUzP2jk3PYus3QL0/4SKtA+CP3DggPlDi5Rpd8+E02prv3dt8YF/Zs+ebcan+A6iRcouXrwouXLFP9TU33P6NwNpo7NW6u86neFt5cqVZjbGrIgWC5f/UfU9U3fo0CFzcKKDkMuVKxfQbcvq3Z+0WVZnWdD+iydPnjTLdfo7HRCFlA0fPtx0BdA6pvNra1muX7/e/KJDyrS+JRzLo38s9LoCjPFJ3QsvvGCu3aMHwxERETJq1ChzkKLdApCyQYMGmYG02hWqS5cusnXrVnn33XfNDanTA2ENFnqWnSmO/af7q46p0L8X2hVKpyWfMmWK6doD/+jfVj0hql2Q9ZhPW4F0zIpO25sleeBa69at0yvMJLr16tUr0JuWpSVVZnqbPXt2oDfNFZ566ilP+fLlPXny5PEUK1bM06xZM8+qVasCvVmu1aRJE8+AAQMCvRmu0LVrV0+pUqVM3StdurS5v3///kBvlmt89dVXnjvuuMMTEhLiqV69uufdd98N9Ca5xsqVK83fifDw8EBviqtER0eb32/lypXzhIaGeipVquQZMWKE58qVK4HeNNf4/PPPTbnp772SJUt6nn32WU9UVJQnq+I6FgAAAACsMcYCAAAAgDWCBQAAAABrBAsAAAAA1ggWAAAAAKwRLAAAAABYI1gAAAAAsEawAAAAAGCNYAEAAADAGsECAAAAgDWCBQAgYCIjI6V///5Srlw5CQkJkZIlS0qrVq1k06ZN5vGgoCBZsmQJ3xAAuEBwoDcAAJBzderUSa5evSpz586VSpUqyalTp2TNmjXy559/BnrTAABpFOTxeDxpfRIAALaioqKkSJEisn79emnSpEmixytUqCC///6793758uXl8OHD5v9Lly6V0aNHyy+//CJhYWHSq1cvGTFihAQHB3tbOt5++21ZtmyZef1SpUrJxIkT5dFHH+WLA4BMQlcoAEBA3HzzzeamXZ2uXLmS6PFt27aZn7Nnz5YTJ05472/cuFF69uwpAwYMMMFi1qxZMmfOHBk7dmy857/66qumRWTXrl3So0cP6datm+zdu/cGfToAyHlosQAABMzChQulb9++cunSJalTp45pudAAULt2bW/Lw+LFi6V9+/be5zRv3lyaNWsmw4cP9y6bN2+eDB06VCIiIrzP69evn7zzzjvede69917zHtqSAQDIeLRYAAACRlsUNAxol6XWrVubbkt68K8tEMnRFojXX3/d2+KhNw0n2qpx8eJF73oNGjSI9zy9T4sFAGQeBm8DAAIqNDRUWrRoYW7afenpp5+WUaNGSe/evZNc//z582Z8RceOHZN8LQBAYNBiAQDIUmrWrCkXLlww/7/pppskNjY23uPaohEeHi5VqlRJdMuV6///s/bDDz/Ee57er1Gjxg36FACQ89BiAQAICJ1StnPnzvLUU0+ZMRUFChSQH3/80cze1K5dO+/MUDr97H333Weuc6GzSI0cOVIefvhhc+0LneVJw4R2j9q9e7eMGTPG+/oLFiyQevXqSaNGjWT+/PmydetW+eCDD/i2ASCTMHgbABAQOhPUa6+9JqtWrZIDBw7ItWvXpGzZsiZsvPzyy5I3b1756quvZPDgwWaa2dKlS3unm125cqUZZ7Fjxw7TqlG9enXThUrHWjiDt//973+bGac2bNhgppudMGGCdOnShW8bADIJwQIAkO0kNZsUACBzMcYCAAAAgDWCBQAAAABrDN4GAGQ7Ho8n0JsAADkOLRYAAAAArBEsAAAAAFgjWAAAAACwRrAAAAAAYI1gAQAAAMAawQIAAACANYIFAAAAAGsECwAAAADWCBYAAAAAxNb/Azh96Oh9s7HrAAAAAElFTkSuQmCC",
            "text/plain": [
              "<Figure size 800x450 with 1 Axes>"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "✅ Created adapter archive: /Users/md.kamranalam/Programming/hackathon/global_syndicate_taskforce_env/grpo_trained_auditor_mac.zip\n",
            "✅ Plot artifacts ready: docs/reward_curve.png, docs/loss_curve.png\n"
          ]
        }
      ],
      "source": [
        "import json\n",
        "import shutil\n",
        "from pathlib import Path\n",
        "import matplotlib.pyplot as plt\n",
        "\n",
        "state_file = Path(\"outputs_mac/checkpoint-10/trainer_state.json\")\n",
        "if not state_file.exists():\n",
        "    checkpoints = sorted(Path(\"outputs_mac\").glob(\"checkpoint-*/trainer_state.json\"))\n",
        "    if not checkpoints:\n",
        "        raise FileNotFoundError(\"No trainer_state.json found in outputs_mac.\")\n",
        "    state_file = checkpoints[-1]\n",
        "\n",
        "state = json.loads(state_file.read_text())\n",
        "log_history = state.get(\"log_history\", [])\n",
        "\n",
        "steps, losses = [], []\n",
        "reward_steps, rewards = [], []\n",
        "\n",
        "for row in log_history:\n",
        "    step = row.get(\"step\")\n",
        "    if step is None:\n",
        "        continue\n",
        "    if row.get(\"loss\") is not None:\n",
        "        steps.append(step)\n",
        "        losses.append(float(row[\"loss\"]))\n",
        "    if row.get(\"reward\") is not None:\n",
        "        reward_steps.append(step)\n",
        "        rewards.append(float(row[\"reward\"]))\n",
        "\n",
        "Path(\"docs\").mkdir(exist_ok=True)\n",
        "\n",
        "plt.figure(figsize=(8, 4.5))\n",
        "plt.plot(steps, losses, marker=\"o\")\n",
        "plt.title(\"GRPO Loss Curve (Mac Run)\")\n",
        "plt.xlabel(\"Step\")\n",
        "plt.ylabel(\"Loss\")\n",
        "plt.grid(alpha=0.3)\n",
        "plt.tight_layout()\n",
        "plt.savefig(\"docs/loss_curve.png\", dpi=180)\n",
        "plt.show()\n",
        "\n",
        "plt.figure(figsize=(8, 4.5))\n",
        "plt.plot(reward_steps, rewards, marker=\"o\", color=\"green\")\n",
        "plt.title(\"GRPO Reward Curve (Mac Run)\")\n",
        "plt.xlabel(\"Step\")\n",
        "plt.ylabel(\"Reward\")\n",
        "plt.grid(alpha=0.3)\n",
        "plt.tight_layout()\n",
        "plt.savefig(\"docs/reward_curve.png\", dpi=180)\n",
        "plt.show()\n",
        "\n",
        "# Zip trained adapters for portability\n",
        "if Path(\"grpo_trained_auditor_mac\").exists():\n",
        "    zip_path = shutil.make_archive(\"grpo_trained_auditor_mac\", \"zip\", \"grpo_trained_auditor_mac\")\n",
        "    print(f\"✅ Created adapter archive: {zip_path}\")\n",
        "else:\n",
        "    print(\"⚠️ Adapter folder grpo_trained_auditor_mac not found yet.\")\n",
        "\n",
        "print(\"✅ Plot artifacts ready: docs/reward_curve.png, docs/loss_curve.png\")"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "## 🚀 5. Optional Full GPU Run (When Available)\n",
        "If you get access to stronger GPU later, run the upgraded Unsloth pipeline:\n",
        "\n",
        "`python train_grpo_unsloth.py --max-steps 120 --output-dir grpo_trained_auditor --plot-dir docs`\n",
        "\n",
        "This will train with the larger model path and auto-generate submission plots."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 6,
      "metadata": {},
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Traceback (most recent call last):\n",
            "  File \u001b[35m\"/Users/md.kamranalam/Programming/hackathon/global_syndicate_taskforce_env/train_grpo_unsloth.py\"\u001b[0m, line \u001b[35m13\u001b[0m, in \u001b[35m<module>\u001b[0m\n",
            "    from unsloth import FastLanguageModel\n",
            "\u001b[1;35mModuleNotFoundError\u001b[0m: \u001b[35mNo module named 'unsloth'\u001b[0m\n"
          ]
        }
      ],
      "source": [
        "# Optional GPU-scale training command\n",
        "!python train_grpo_unsloth.py --max-steps 120 --output-dir grpo_trained_auditor --plot-dir docs"
      ]
    }
  ],
  "metadata": {
    "accelerator": "GPU",
    "colab": {
      "gpuType": "T4",
      "provenance": []
    },
    "kernelspec": {
      "display_name": ".venv",
      "language": "python",
      "name": "python3"
    },
    "language_info": {
      "codemirror_mode": {
        "name": "ipython",
        "version": 3
      },
      "file_extension": ".py",
      "mimetype": "text/x-python",
      "name": "python",
      "nbconvert_exporter": "python",
      "pygments_lexer": "ipython3",
      "version": "3.13.7"
    }
  },
  "nbformat": 4,
  "nbformat_minor": 0
}