vynly commited on
Commit
a0feeea
·
verified ·
1 Parent(s): 84d5097

Release CAEL 0.3.8: code-only update on the 0.3.7 model bundle (AI-assisted)

Browse files
Files changed (10) hide show
  1. .gitattributes +1 -0
  2. CAEL-0.3.8.zip +3 -0
  3. CHANGELOG.md +45 -0
  4. LICENSE +70 -0
  5. NOTICE.md +47 -0
  6. README.md +126 -0
  7. SHA256SUMS.json +10 -0
  8. bundle_config.json +7 -0
  9. cael-0.3.7.cael +3 -0
  10. release_manifest.json +64 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ cael-0.3.7.cael filter=lfs diff=lfs merge=lfs -text
CAEL-0.3.8.zip ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c0d1771d54e9e5b77e84462cc00411e5cadede076ae4709fe06440c9e535dd6e
3
+ size 21562557
CHANGELOG.md ADDED
@@ -0,0 +1,45 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Changelog
2
+
3
+ ## 0.3.8 (release candidate, not yet published)
4
+
5
+ Code-only release. It loads the unchanged published `cael-0.3.7.cael` model bundle
6
+ (same SHA-256 checksum); no weights or bundle files changed. AI-assisted.
7
+
8
+ ### Fixed
9
+
10
+ - Personal facts: CAEL no longer invents a personal fact it was never told (for example a
11
+ birthplace). It answers from what the user said in the conversation, or says it has not
12
+ been told.
13
+ - Listening requests: an emotional message that asks for no advice and no questions now gets
14
+ a short reflection without advice or questions, for more phrasings than before.
15
+ - Word problems: a checked quantity graph handles more multi-step quantity problems
16
+ (receive, give away, buy, share). The older exact inventory helper still answers first
17
+ when it can, so its worked steps and multi-turn "Add:" state are kept. A leading
18
+ "and"/"then" in a step is handled; "to" is no longer taken as part of a quantity noun.
19
+ - Linear equations such as `Solve 6*x + 5 = 47` are solved exactly.
20
+ - Python generation: the requested function name and signature are kept; a single function
21
+ stub is checked against the request; prompts that contain real code plus extra steps are
22
+ left to the task and data tools instead of being asked to clarify.
23
+ - Code execution: generated specs and recurrences run only inside the restricted Python VM
24
+ (no native `eval`). The VM gained a bounded `dict.fromkeys`.
25
+
26
+ ### Evaluation (read-only, no tuning on evaluation items)
27
+
28
+ - 80-item read-only replay, raw automatic grading: 59/80, against 54/80 recorded for 0.3.7
29
+ (memory 17/20, conversation 10/20, Python 16/20, controls 16/20). Seven replies changed:
30
+ memory-20, conversation-04, python-15 and controls-05 now pass; controls-16 now passes the
31
+ automatic check (it had been accepted in review before); python-05 and python-19 still fail.
32
+ Memory-20 is the item from the public bug report, so it is no longer a clean held-out item.
33
+ Review of the replies was done by AI coding agents (unblinded).
34
+ - Public 128-question comparison: math 0/32 and Python 1/32, the same as 0.3.7. CAEL does
35
+ not pass the competitive math gate and 0.3.8 makes no math improvement claim.
36
+ - GSM8K train split, 400-question development check (informational only): 1 correct, 17 wrong, 382 abstained. Coverage is very low and the 17 wrong answers come from routes that should have abstained.
37
+ - The 400-question comparison is unchanged: Qwen3.5 leads clearly (181/400 original phrase
38
+ passes against CAEL 121/400; Qwen3 116/400). Qwen is also better at open conversation.
39
+
40
+ ### Known limitations
41
+
42
+ - Bundle builds still name the bundle after the code version; 0.3.8 ships the 0.3.7 bundle.
43
+ - The restricted VM refuses `math.*` expressions.
44
+ - Word-problem coverage is still low; some routes give wrong numbers instead of abstaining.
45
+ - Python-19 still uses an import although the prompt asks for no imports.
LICENSE ADDED
@@ -0,0 +1,70 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ CAEL NON-COMMERCIAL LICENSE (Personal and Research Use Only)
2
+
3
+ Copyright (c) 2026 Vovala14. All rights reserved except as granted below.
4
+
5
+ This license applies to CAEL (Cellular Automaton Event Language) and to the
6
+ code, models, weights, prompts, data, documentation and other files in this
7
+ repository and in CAEL model bundles that are owned by the copyright holder
8
+ (the "Software"). Third-party components are covered by section 8 instead.
9
+
10
+ 1. GRANT OF PERMISSION
11
+ Permission is granted, free of charge, to any person obtaining a copy of
12
+ the Software to use, copy, modify, and run it, solely for:
13
+ (a) Personal Use: private, non-commercial use by an individual for their
14
+ own learning, hobby, or experimentation; and
15
+ (b) Research Use: non-commercial academic, scientific, or educational
16
+ research, and publication of the results of that research.
17
+
18
+ 2. COMMERCIAL USE REQUIRES A SEPARATE LICENSE
19
+ You may NOT use the Software, or anything derived from it, for any
20
+ commercial purpose without a separate written license from the copyright
21
+ holder. Commercial purposes include, without limitation:
22
+ (a) selling, licensing, sublicensing, renting, or otherwise charging for
23
+ the Software or derivatives, or access to them;
24
+ (b) using the Software in, or to provide, a product or service that is
25
+ sold, or that generates revenue, directly or indirectly (including
26
+ through advertising, subscriptions, or paid APIs);
27
+ (c) using the Software in the operations of a for-profit business or
28
+ for any other commercial advantage; and
29
+ (d) using the Software or its outputs to train, fine-tune, or distill
30
+ models or systems that are used commercially.
31
+ The copyright holder keeps all commercial rights and may use and license
32
+ the Software commercially.
33
+
34
+ 3. REDISTRIBUTION
35
+ You may share copies or modified versions only for non-commercial
36
+ purposes, and only if you (a) include this license and the copyright
37
+ notice with them, (b) clearly mark any changes you made, and (c) license
38
+ your distribution of the Software under these same terms. You may not
39
+ remove or alter this license or the copyright notice.
40
+
41
+ 4. ATTRIBUTION
42
+ Any research publication or public work that uses the Software must
43
+ credit "CAEL by Vovala14" and link to https://github.com/Vovala14/CAEL .
44
+
45
+ 5. OWNERSHIP
46
+ The Software is licensed, not sold. The copyright holder retains all
47
+ rights not expressly granted here. No trademark rights are granted.
48
+
49
+ 6. TERMINATION
50
+ This license terminates automatically if you breach it. On termination
51
+ you must stop using the Software and delete your copies.
52
+
53
+ 7. NO WARRANTY AND LIMITATION OF LIABILITY
54
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS
55
+ OR IMPLIED, INCLUDING BUT NOT LIMITED TO WARRANTIES OF MERCHANTABILITY,
56
+ FITNESS FOR A PARTICULAR PURPOSE, AND NONINFRINGEMENT. IN NO EVENT SHALL
57
+ THE COPYRIGHT HOLDER BE LIABLE FOR ANY CLAIM, DAMAGES, OR OTHER LIABILITY,
58
+ WHETHER IN CONTRACT, TORT, OR OTHERWISE, ARISING FROM, OUT OF, OR IN
59
+ CONNECTION WITH THE SOFTWARE OR ITS USE.
60
+
61
+ 8. THIRD-PARTY COMPONENTS
62
+ Third-party data, software and graphics included in or used to build CAEL
63
+ keep their own licenses, listed in licenses/, in each model folder's
64
+ SOURCES.md / TRAINING_NOTICES.md and in the bundle. This license does not
65
+ replace or restrict them. In particular, components derived from Creative
66
+ Commons Attribution-ShareAlike material (for example the Wikipedia,
67
+ Stack Exchange, Dolly, Wikibooks, Wikivoyage and Universal Dependencies
68
+ derived knowledge and count tables) are shared under their CC BY-SA terms,
69
+ which also allow commercial use. CAEL only uses third-party material whose
70
+ license allows commercial use.
NOTICE.md ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Provenance and separation
2
+
3
+ CAEL (Cellular Automaton Event Language) is a separate model family owned by Vovala14. Version0.1 derives from the locally preserved constrained symbolic event-CA experiment of2026-10-13. It is not the native MICA architecture or a MICA foundation-model release.
4
+
5
+ The original experiment is retained unchanged outside this repository. Earlier CAEL releases (up to 0.2.9 / 0.3) carried that experiment's licence text verbatim, which named MICA Ember / MICA Flame. CAEL and MICA have the same copyright holder (Vovala14), who now licenses CAEL under its own CAEL Non-Commercial License (LICENSE): free for personal and research use, with commercial use reserved to the copyright holder. CAEL is a separate model family and contains no MICA code, weights or outputs. CAEL is not released under an OSI open-source license.
6
+
7
+ ## Commercial-use policy for third-party material
8
+
9
+ CAEL only uses third-party data, software and graphics whose licence allows commercial use (MIT, Apache, BSD, CC BY, CC BY-SA, WordNet, Unicode, CreativeML OpenRAIL-M). Removed in 0.3.1: the 0.2.1 small-talk reply models (`chat/model_v1.json.gz`, `chat/model_v2.json.gz`), which were fitted on EmpatheticDialogues (CC BY-NC 4.0). The ARC Corpus is never used at runtime (its terms forbid redistribution); a local research reproduction can opt in only with `CAEL_RESEARCH_ARC=1`.
10
+
11
+ Changes: standalone portable training/evaluation, CAEL naming, cumulative event-memory training, explicit multi-event API, stricter supported-question handling, reports and public packaging. Runtime includes handwritten parsing and slot formatting plus learned cellular event rules, plans and a template-like regular grammar. No neural model is used for training or inference; the curriculum is expert-authored synthetic data.
12
+
13
+ ## CAEL 0.2 emoji model and data attribution
14
+ - models/cael-emoji-64-v2 was trained on Noto Emoji (Copyright Google Inc., Apache License 2.0, github.com/googlefonts/noto-emoji @ e20cbc2b, 2D/png/128)
15
+ and Blobmoji (C1710 and contributors, based on Noto Emoji, Apache License 2.0, github.com/C1710/blobmoji @ 7dd14d2b, SVGs rendered to 128x128 PNG).
16
+ The model stores learned counts, not the images. Licences in licenses/.
17
+ - Captions: Unicode emoji-test.txt short names + Unicode CLDR English annotations (Unicode License).
18
+ - Transparent pixels were composited on white before training.
19
+
20
+ ## CAEL 0.2.1 changes and synthetic-image teacher
21
+
22
+ 0.2.1 adds a shared application, one integrity-checked model bundle, portable
23
+ legacy chat fallback, exact arithmetic, the current v7 emoji engine, sanitized
24
+ v15 aggregate portrait parameters, and a new categorical general-image student.
25
+ The preceding description of expert-authored training and no neural model
26
+ applies to Story 0.1, not the new synthetic-image training pipeline.
27
+
28
+ The general-image student is trained on outputs generated locally by neural
29
+ Stable Diffusion 1.5 through stable-diffusion.cpp. It is treated as a derivative
30
+ under CreativeML OpenRAIL-M. Original diffusion/text-encoder weights are replaced
31
+ by subject-specific registered 64x64 statistical appearance/deformation modes.
32
+ Use and redistribution must comply with the included teacher license, paragraph
33
+ 5 and Attachment A, in addition to the CAEL Non-Commercial License for owned
34
+ modifications. Full teacher license: licenses/LICENSE-stable-diffusion-v1-5.txt.
35
+ Primary sources: https://huggingface.co/stable-diffusion-v1-5/stable-diffusion-v1-5
36
+ and https://github.com/CompVis/stable-diffusion/blob/main/LICENSE.
37
+
38
+ stable-diffusion.cpp is a separate locally installed MIT-licensed teacher tool:
39
+ https://github.com/leejet/stable-diffusion.cpp. Neither its binary nor the neural
40
+ teacher checkpoint is redistributed in this release. Runtime student sampling
41
+ is non-neural, but its neural teacher's contribution is explicit.
42
+
43
+ v7 emoji data sources remain Noto Emoji and Blobmoji, with the same Apache and
44
+ Unicode attribution above. Public fitting references are included for numerical
45
+ rejection and silhouette statistics. Private portrait photos and alignments,
46
+ endpoint credentials and private chat logs are not included.
47
+
README.md ADDED
@@ -0,0 +1,126 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: other
5
+ license_name: cael-non-commercial
6
+ license_link: https://huggingface.co/vynly/CAEL-0.3.8/blob/main/LICENSE
7
+ pipeline_tag: text-generation
8
+ tags:
9
+ - cael
10
+ - non-neural
11
+ - cellular-automata
12
+ - symbolic-reasoning
13
+ - conversation-memory
14
+ - code-generation
15
+ inference: false
16
+ ---
17
+
18
+ # CAEL 0.3.8
19
+
20
+ A CPU assistant built from non-neural symbolic, count and automaton engines.
21
+ It is a custom Python runtime; Qwen and Transformers are not part of CAEL.
22
+ CAEL is source-available, non-commercial software (see LICENSE).
23
+
24
+ 0.3.8 is a code-only update. It reuses the unchanged published 0.3.7 model
25
+ bundle (cael-0.3.7.cael, same checksum); see CHANGELOG.md.
26
+
27
+ Picture and portrait generator weights are excluded. Chat, helper, math,
28
+ stories, prompt writing, retrieval and emoji remain available. Image requests
29
+ can produce a prompt for an external image tool.
30
+
31
+ ## Start
32
+
33
+ Use Python3.11 or later. Extract the source archive or clone this repository,
34
+ then run in its folder:
35
+
36
+ ```bash
37
+ python -m pip install -r requirements-unified.txt
38
+ python -m cael_unified --download
39
+ python -m cael_unified --ui
40
+ ```
41
+
42
+ Open http://127.0.0.1:8765. Windows SETUP.bat and RUN.bat provide the same flow.
43
+ The checksum-verified no-images resource download is about563MB; source and
44
+ resource archives are separate. Existing local models/selections are preserved
45
+ by the installer. The licence is unchanged; see LICENSE and NOTICE.md.
46
+
47
+ ## Changes in 0.3.8
48
+
49
+ - Personal facts: a question about your own details (birthplace, address and
50
+ similar) that you never stated is answered with "you have not told me",
51
+ instead of a fact borrowed from retrieval or another person.
52
+ - Requests to just listen ("no advice", "don't ask me questions", and
53
+ paraphrases) are kept on every conversational route, not only some phrasings.
54
+ - Word problems: a checked quantity-event graph, exact fractions/decimals and
55
+ stricter clause handling. Unsupported clauses lead to a clarifying question.
56
+ The older inventory helper still answers first when it is exact.
57
+ - Python: requested function names and declared signatures are kept, and
58
+ rules that cannot be resolved lead to a question, not to simpler code.
59
+ - Safety: arithmetic-expression and recurrence checks no longer use Python's
60
+ native eval. They run in the bounded AST VM or a closed +, -, * evaluator.
61
+ - The model weights and bundle are unchanged.
62
+
63
+ ## Changes in 0.3.7
64
+
65
+ - Session-local explicit facts/preferences, corrections, conflict clarification,
66
+ forgetting and provenance. Quoted/hypothetical statements are treated cautiously.
67
+ - A larger authored vocabulary for mixed/negated feelings, speaker attribution,
68
+ bereavement and requests to listen. These are bounded rules, not human experience.
69
+ - Natural-language ordered numeric/text/record workflows compose existing Python
70
+ operations; simple list/array chunk contracts are restored. Generated functions
71
+ are checked in a bounded AST VM. Unsupported clauses need clarification.
72
+ - The learned model weights, protected choice/word-math solvers and CA kernels
73
+ are unchanged. These upgrades are implementation changes.
74
+
75
+ ## Named local confirmation
76
+
77
+ CAEL-CMP-R2-20261028 contains 80 locally authored synthetic items, 20 per category.
78
+ Every full reply was reviewed by AI coding agents (unblinded), including apparent
79
+ automatic passes and code.
80
+ The source, inputs and primary grading were frozen before final answers.
81
+
82
+ | System | Memory | Conversation | Python | Controls | Reviewed total |
83
+ |---|---:|---:|---:|---:|---:|
84
+ | CAEL 0.3.7 | 16/20 | 10/20 | 15/20 | 16/20 | 57/80 |
85
+ | Qwen3-0.6B | 8/20 | 13/20 | 6/20 | 16/20 | 43/80 |
86
+ | Qwen3.5-0.8B | 12/20 | 14/20 | 3/20 | 12/20 | 41/80 |
87
+
88
+ Functional Python: CAEL15/18, Qwen3 6/18, Qwen3.5 3/18. Original automatic totals
89
+ were54,43,42; full-review totals differ because regex matches can miss correct
90
+ answers or accept incorrect explanations. All raw replies/flags and every
91
+ adjudication are included under benchmarks/cael_cmp_r2_20261028/.
92
+
93
+ 0.3.8 offline replay of the same 80 frozen inputs (automatic grader, no
94
+ re-review, no Qwen rerun): 59/80 automatic, versus 54/80 for the recorded 0.3.7
95
+ replies (memory 17, conversation 10, Python 16, controls 16). Seven replies
96
+ changed, listed in CHANGELOG.md. One of them (an invented birthplace) is also the
97
+ bug in a public report fixed in this release, so that item is not a clean
98
+ held-out test any more. The table above remains the 0.3.7 reviewed result.
99
+
100
+ This is an authored family-overlap test with unblinded review by AI coding
101
+ agents, not an independent leaderboard or evidence of general superiority. Qwen is stronger
102
+ on the conversation category here. On an older, broader 400-question test,
103
+ Qwen3.5 leads clearly: CAEL 121/400 versus Qwen3.5 181/400 original phrase
104
+ passes (Qwen3 116/400), with phrase-grading flaws disclosed. The targeted result
105
+ must not erase that limitation.
106
+
107
+ CAEL's measured full-portable process peak was558.648MiB in this shared-host
108
+ run. Qwen3 float32/eager peaked5896.336MiB; Qwen3.5 bfloat16/SDPA peaked2668.309MiB.
109
+ These are different runtimes/precisions, not an equal-size or optimized quantized
110
+ comparison. Disk size, model bytes, load time and median latency are separate
111
+ quantities recorded in the report. The earlier167MiB source-only run is not
112
+ this portable-build measurement.
113
+
114
+ ## Remaining weaknesses
115
+
116
+ CAEL still misses factual/emotional paraphrases and fails tracing, leftmost
117
+ binary search under a no-imports rule, and much reasoning. It solves few
118
+ ordinary grade-school word problems: on a 400-problem GSM8K training sample
119
+ (a development check, not a release benchmark) it gave very few correct answers
120
+ and asked for clarification on most. Qwen is better at open conversation.
121
+ It does not understand arbitrary Python or replace a general LLM.
122
+ Do not enter personal information into shared demos. This release does not
123
+ change any running Vynly site or shared worker.
124
+
125
+ Read CHANGELOG.md, RELEASE_0_3_7.md and benchmarks/cael_cmp_r2_20261028/REPRODUCE.md for exact
126
+ settings, uncertainty, disclosures and the offline CAEL reply-regression replay.
SHA256SUMS.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "CAEL-0.3.8.zip": "c0d1771d54e9e5b77e84462cc00411e5cadede076ae4709fe06440c9e535dd6e",
3
+ "CHANGELOG.md": "6e7476618384caacbeed11890bcb28268f0017d02f4cd733a88c3e44b8d3a050",
4
+ "LICENSE": "d5d32c0f00aa08ac59843f80cd36b51717c6365585a9ead644ddf0db1f492661",
5
+ "NOTICE.md": "d12deb61adb80197d3976b97540c103bbfe85e5b9281abb0e94a468bbf6f53dc",
6
+ "README.md": "e08b22812c038d0e65a9ac4488c7df96211cefcb087ba20560ed201e19d8e9d2",
7
+ "bundle_config.json": "8aa7534c18a7be3f340834becad6e5d9ebbebec3e69d5a905e975c548fc34e44",
8
+ "cael-0.3.7.cael": "8efd22d7fa670e7f011d262c33a7e026941f279e71ee2014614d5d4cf5ecf79b",
9
+ "release_manifest.json": "479f5a095634cecab86f07ea76b4fede9c75c116e50b7e0369f4edd0cd24c900"
10
+ }
bundle_config.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "version": "0.3.7",
3
+ "url": "https://github.com/Vovala14/CAEL/releases/download/v0.3.7/cael-0.3.7.cael",
4
+ "sha256": "8efd22d7fa670e7f011d262c33a7e026941f279e71ee2014614d5d4cf5ecf79b",
5
+ "bytes": 562714794,
6
+ "profile": "no-images"
7
+ }
cael-0.3.7.cael ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8efd22d7fa670e7f011d262c33a7e026941f279e71ee2014614d5d4cf5ecf79b
3
+ size 562714794
release_manifest.json ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "version": "0.3.8",
3
+ "profile": "no-images",
4
+ "source_commit": "7a2322743ec8083eb3eef2b257e99289831735dc",
5
+ "source_archive": {
6
+ "file": "CAEL-0.3.8.zip",
7
+ "bytes": 21562557,
8
+ "sha256": "c0d1771d54e9e5b77e84462cc00411e5cadede076ae4709fe06440c9e535dd6e"
9
+ },
10
+ "resource_archive": {
11
+ "version": "0.3.7",
12
+ "url": "https://github.com/Vovala14/CAEL/releases/download/v0.3.7/cael-0.3.7.cael",
13
+ "sha256": "8efd22d7fa670e7f011d262c33a7e026941f279e71ee2014614d5d4cf5ecf79b",
14
+ "bytes": 562714794,
15
+ "profile": "no-images"
16
+ },
17
+ "code_only_release": true,
18
+ "resource_archive_unchanged_from": "0.3.7",
19
+ "checks": {
20
+ "pytest_passed": 1770,
21
+ "pytest_failed_environment_or_preexisting": 4,
22
+ "pytest_failed_on_v0_3_7_baseline_too": 4
23
+ },
24
+ "replay": {
25
+ "name": "CAEL-CMP-R2-20261028",
26
+ "items": 80,
27
+ "raw_automatic": {
28
+ "0.3.7_recorded": 54,
29
+ "0.3.8": 59
30
+ },
31
+ "per_category_0.3.8": {
32
+ "memory": 17,
33
+ "conversation": 10,
34
+ "python": 16,
35
+ "controls": 16
36
+ },
37
+ "changed_replies": 7,
38
+ "review": "AI coding agents, unblinded; not an independent evaluation",
39
+ "note": "memory-20 comes from a public bug report and is no longer a clean held-out item"
40
+ },
41
+ "public128_math_python": {
42
+ "math": "0/32",
43
+ "python": "1/32",
44
+ "same_as_0.3.7": true,
45
+ "competitive_math_gate_passed": false
46
+ },
47
+ "gsm8k_train_dev_400": {
48
+ "correct": 1,
49
+ "wrong": 17,
50
+ "abstain": 382,
51
+ "informational_only": true
52
+ },
53
+ "comparison_400": {
54
+ "CAEL": 121,
55
+ "Qwen3.5-0.8B": 181,
56
+ "Qwen3-0.6B": 116,
57
+ "note": "Qwen3.5 leads; evidence kept in local research files, not in this archive"
58
+ },
59
+ "image_portrait_weights": false,
60
+ "private_data_included": false,
61
+ "opponent_weights_or_runtime": false,
62
+ "licence": "source-available, non-commercial; unchanged",
63
+ "attribution": "AI-assisted"
64
+ }